Sevatec Inc.

  • Big Data Engineer

    Job Locations US-VA-Fairfax
    Posted Date 2 weeks ago(11/5/2018 9:25 AM)
    Job ID
    2018-1632
    # of Openings
    1
    Category
    Information Technology
  • Overview

    Sevatec, Inc. is looking for a Big Data Engineer to join a team of highly motivated and talented engineers tasked with evolving a traditional data warehouse to Big Data and emerging technologies.   The ideal candidate is a seasoned engineer (15+ overall years) well-versed in data with hands-on experience implementing big data solutions with next-generation technologies.  Should have a good understanding Apache Spark/Databricks, Hadoop, Kafka streaming, REST API, and AWS Ecosystem. Hands on coding experience with Scala, Python, Java.

    Responsibilities

    • Proficiency with Scala programming leveraging RDDs, DFs, UDFs to process/aggregate structured and unstructured data for ETL processing to S3 and relational databases (oracle/postgres).  Familiarity with data partitioning techniques for performance;
    • Good understanding of Hive Metastore and ACLs; Parquet/Avro data formats;
    • Experience with Apache Spark (Databricks) clusters and performance tuning;
    • Configure and automate tasks using DevOps pipeline components employing Jenkins, Lambda and Github 
    • Maintain and upgrade big data infrastructure components (databricks, hdfs, kafka etc).
    • Assist users troubleshooting big data connectivity (Drivers, Security Groups, Firewall etc)
    • Analyze and performance tune queries running in databricks/Apache Spark clusters using DAG
    • Advise teams on best practices related to big data clusters.
    • Apply hardening scripts on the big data clusters.

     

    Qualifications

    • 15+ years total experience or Master’s Degree Computer Science, Information Technology or equivalent Experience
    • Hands-on experience with AWS infrastructure including cloud formation templates
    • 3-5 years’ experience with Scala, SQL, Hive
    • 1-2 years’ experience with Big Data (e.g. Hadoop, Apache Spark)
    • 1-2 years’ experience working with Kafka streaming technology
    • 1-2 years’ experience scripting in Python or Scala
    • Strong teamwork, co-ordination, planning and influencing skills
    • Self-driven, and ability to work at pace in a dynamic organization
    • Excellent analytical, communication and organizational skills

    Desired Skills/Experience:

    • Experience with Apache Spark/Databricks, Scala/Java programming, HDFS, Hive
    • Experience with DevSecOps pipeline
    • Federal contracting experience
    • Related technical certifications
    • Experience with Agile/Scrum.
    • Experience with Apigee

    Security Clearance:  US Citizenship is required along with the ability to obtain an Agency Suitability Clearance.

     

     

     

     

    EEO Statement:  Sevatec is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.

    Options

    Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
    Share on your newsfeed