Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I work in data engineering and Scala fades even in this field.


What's used instead? Python? (complete outsider, just curious.)


Python mostly, and Java if you are using Flink. We do both. The thing with Scala is, it's mostly linked to Spark, and then probably a good portion of the gigs out there using Spark are using Databricks, and Databricks is pretty expensive, so people are moving away from it. At least this has been my case for two companies -- one moved to self-host Vertica and the other is about to move to Flink.


Yes. Java, Python.


Ok so boring things won. (Well I'm writing Java and Python every day outside Data context this is not dissing.)


Just curious what do you do? I'm thinking about moving away from data, maybe into something that is a little bit lower-level.


Java (+Kotlin) for Android, Python for its automation and tooling (and obviously, data.) These aren't very low-level - For Android there is always C++ if you want to go down to metal.


Ah that's interesting. And there is ofc Swift and ObjC for Apple devices. Maybe I should get into app dev.

Thanks. Do you think there is a strong market of Android/iOS native app development? As a DE I don't think my previous experience worths much -- maybe a bit more when we move to Flink which uses Java, and the might would rather hire new graduates instead of me.


I don't expect native mobile dev market to grow and was wondering how other disciplines like data is doing ;-)


Data is still a big thing, but nowadays vendors successfully removed most of the management because people just want to get things done, so a lot of companies are moving to Snowflake and similar places. You basically do some click ops and hopefully shit sticks on the walls.

Interesting if you just like data, but bad if you like the tech beneath. I'd recommend moving away from DWH part of data engineering if you can, and focus on OLTP, streaming which are more technical. The culture is also different.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: