Scala Developer with Spark, Hbase & Cassandra
Company: Resilience Infotech
Posted on: December 9, 2018
Please email your updated resume to . I may also be reached at JD:
- The candidate must have at least 6+ Years of experience in Scala and Java Programming
- Writing high-performance, reliable and maintainable code in Scala
- Good experience to write Data ingestion using Spark SQL to fetch the data from structured storage and store it into Cassandra and Hbase DB using Scala.
- Good Hands on experience on Hadoop/ HDFS, MapReduce, Flume Installations and configurations
- Hands-on experience on data loading tools like Flume, Sqoop.
- Ability to stream near real time log information from SFTP through Apache flume
- .Good experience on handling large data sets using Partitions, Spark in Memory capabilities, Broadcasts in Spark, Effective & efficient Joins, Transformations and other during ingestion process itself.
- Good Experience in consuming messages from Kafka using Spark Streaming
- Good Experience in transforming Spark Data Frames into JSON and publish the messages to Kafka Topic
- Good Understanding on Scala, Spark and Kafka Installations and configurations
- Responsible for troubleshooting and resolving the issues in Spark cluster
- Performance tuning of spark applications for fixing right batch operations and memory tuning.
- Analytical and problem solving skills, applied to Big Data domain
- Hands on experience on performance improvements like partitioning and bucketing.
- Data Science knowledge
- Good aptitude in multi-threading and concurrency concepts.
- Good experience on complete end to end code deployment process in Production.
- Working experience on HBase, Created HBase tables to load large sets of structured, semi-structured and unstructured data coming from UNIX, NoSQL and a variety of portfolios
- Good knowledge on workflow/schedulers like Oozie
- Code/design analysis, strategy development and project planning. - provided by Dice Scala, Casandra, Spark, Java, Hbase
Keywords: Resilience Infotech, Aurora , Scala Developer with Spark, Hbase & Cassandra, IT / Software / Systems , Aurora, Colorado
Didn't find what you're looking for? Search again!