JavaScript is slow if you need to do things that JavaScript can’t do, such as
- lots of stack-allocated objects/arrays (in JavaScript you have to heap-allocate them)
- hash maps with non-primitive types as keys (in JavaScript you have to serialize them to a string)
- count trailing zero bits (in JavaScript you have to use a lookup table)
If the situation is as you described, you are definitely in the right.