Data Engineering
- Data pipelines and ETL automation
- Spark and PySpark performance tuning
- Data modeling and normalization
- Integration with Oracle, SQL Server, Teradata, Netezza, SharePoint, and SFTP sources
Navy Veteran • New York City Metropolitan Area • On-site · Hybrid · Remote
Data engineering and cloud solutions that solve the unsolvable.
CJM Tech Services is the consulting practice of Christopher Marotta, data engineering consultant with deep expertise in enterprise Hadoop ecosystems, data pipelines, release support, and process automation.
8 hrs → 30 min
Data processing time cut by converting Python/Pandas to PySpark and Koalas at Duke Energy
1.5 hrs → <10 min
Deployment time cut by refactoring deployments at Bank of America
160K+ files
Deployed across 5 Hadoop clusters, earning a Global Recognition Award from Bank of America
99.999%
Uptime for U.S. Navy ship and shore Unclassified, Secret, and Top Secret messaging
About
Christopher Marotta, Founder
- U.S. Navy veteran: served aboard USS Whidbey Island (LSD-41) and as an Information Systems Technician Second Class (IT2) at NCTAMS EURCENT, Naples, Italy
- Granted Top Secret clearance during Navy service
- Inventive, solution-oriented IT professional supporting multi-sized, multi-industry corporations with 24x7 operations and large-scale projects
- Deep expertise in enterprise-level Hadoop ecosystems, release support, process automation, and customized script development
- Excels in fast-paced environments, routinely rectifying issues deemed unsolvable by others
- Works closely with diverse internal staff and external vendors
- Software engineer, cloud architect, DevOps engineer, and cybersecurity engineer specializing in cloud-based solutions
Services
Big Data Platforms
- Cloudera Hadoop administration and CDH upgrades
- HDFS, Hive, Impala, Oozie, YARN, and Sqoop
- Cluster smoke testing and troubleshooting
- Kerberos-secured cluster configuration
Migrations
- Oracle SQL to HiveQL application conversion
- Hadoop cluster migrations with automated table DDL
- Platform upgrades and system migrations
Cloud Solutions
- Amazon Web Services (AWS)
- Cloud-based solution architecture
- Containerization with Docker
DevOps & Release Support
- Code deployment across SDLC environments
- CI with Jenkins, Bitbucket, Git, and SVN
- Job scheduling with Autosys and CA Workload Automation
- Linux shell and Python automation
Security & Access
- Kerberos, Sentry, and LDAP
- Active Directory and Unix group access management
- Firewalls, VPN, and network troubleshooting
Packages
Four tiers modeled on the medallion data architecture. Each tier includes everything in the one before it, from a first look at your raw data (Bronze) to business-ready data (Gold) to ongoing support (Platinum). Every engagement starts with a free introductory call.
Bronze · Start here
Assess
Data Health Check · 2 weeks
- Review of your pipelines, data sources, and job scheduling
- Performance, reliability, and access-control findings
- Prioritized remediation roadmap
Quote after a free call
Book a Health CheckSilver
Modernize
Everything in Bronze, plus pipeline modernization
- Replace fragile scripts with automated, scheduled ETL
- Convert Python/Pandas jobs to Spark and PySpark
- CI/CD for pipeline code with Git and Jenkins
Quote after a free call
Ask about SilverGold
Migrate
Everything in Silver, plus legacy migration
- Move on-premises Hadoop, Oracle, or SQL Server workloads to the cloud
- SQL conversion and automated table DDL deployment
- Cutover testing and production support
Quote after a free call
Ask about GoldPlatinum
Support
Everything in Gold, plus Office Hours: 4 hours a month
- Direct Slack or Zoom access
- Architecture and code reviews
- Ongoing guidance for your data team
Quote after a free call
Ask about PlatinumOn demand
Emergency Pipeline Fix
Outside the tiers, whenever something breaks
- Rapid diagnosis of failed or stalled data jobs
- Root-cause fix and documentation
- Recommendations to prevent repeats
Experience
-
Senior Data Engineer / Big Data Consultant
Meridian Technologies · On-site at Duke Energy · Contract
- Built data pipelines supporting Integrated Systems Operational Planning and integrated load forecasting
- Converted business-written Python/Pandas transformations to PySpark and Koalas, cutting processing time from 8 hours to 30 minutes
- Wrote Linux shell, Python, and SQL to process data from Oracle, SQL Server, SharePoint, and SFTP sites to model the electrical grid and produce a 10-year load forecast
- Ingested data with Spark into SQL Server, SQL Server Analysis Services, and Power BI for business users
- Contributed to an internal Scala framework for Spark ETL pipelines
- Built a proof-of-concept Angular web UI to demonstrate back-end data models
- Managed CI with Bitbucket and Jenkins, and access through Active Directory and Unix groups
-
Assistant Vice President / Programmer, Professional Markets
Bank of America
- Deployed Wholesale Risk Analytics (WRAP) application code, Autosys jobs, and files from Subversion and Git across Hadoop clusters through the SDLC
- Diagnosed and fixed Hadoop application issues spanning ~600 Oozie workflows and ~15 systems of record
- Supported the monthly production deployment of a commercial asset quality forecast application for the Federal Reserve's CCAR review on a $450B loan portfolio
- Converted 35K lines of Oracle SQL to HiveQL and wrote Java user-defined Hive functions
- Streamlined Oozie workflow processes from 10 dissimilar functions into 3 repeatable steps
- Cut deployment times from over 1.5 hours to under 10 minutes
- Automated table DDL with shell scripts, deploying hundreds of tables and views across 5 databases
- Earned a Global Recognition Award for the GRX application: 160K+ files deployed on 5 Hadoop clusters
-
Programming Consultant
FDM Group
- Supported 5 application teams in Global Risk Analytics on an 8-person Hadoop shared platform team
- Programmed cluster smoke tests using Bash, HQL, Oozie, Pig, Java, and iXP, controlled with Autosys
- Key contributor to CDH and Cloudera Manager upgrades and testing for 5 Hadoop clusters
- Recognized as subject matter expert for Datameer administration on Kerberos-secured Hadoop clusters, using the REST API and Bash scripting
- Refactored and troubleshot code in tandem with Cloudera technical support
-
Desktop Support Analyst
Hess Energy Trading Co.
- Supported front- and back-office energy trading operations in a 24x7 global environment
- Migrated 300 users in New York City, London, Singapore, and Geneva from Windows XP to Windows 7 using SCCM
- Created the Windows 7 template and coordinated compatibility testing for legacy and in-house applications
- Authored technical documentation and resolved escalated issues with vendors and senior engineers
-
Network Engineer
Precision IT Group
- Supported 50+ enterprise and small business clients in the retail, legal, and financial industries
- Engineered major New York City office relocations and enterprise platform upgrades and migrations
- Reduced network downtime by monitoring performance with SolarWinds N-able
-
Information Systems Technician Second Class (IT2)
United States Navy · NCTAMS EURCENT
- Maintained desktops, servers, and network equipment for U.S. Navy 5th Fleet customers
- Achieved 99.999% uptime for ship and shore Unclassified, Secret, and Top Secret messaging systems
- Trained junior sailors and watch teams
- Granted Top Secret clearance
-
Main Machinery Room 2
United States Navy · USS Whidbey Island (LSD-41)
Skills
Big Data
Languages & Data
Cloud & DevOps
Security & Infrastructure
Credentials
Apps I built so small organizations in niche markets can run better: less time on the phone and on paperwork, more time on the work itself.
Live prototype
PallCall
Funeral homes & pallbearers · pallcall.cjmtech.net
- No more phone trees: pallbearers post the days they can carry, and a funeral director books them in a couple of taps
- Directors keep their own crew of regulars and outside bearers, and request every available regular in one tap
- Bearers accept or decline on the site or by replying YES or NO to a text; the first to accept get the spots, and everyone still waiting is told when the service fills
- Day-before reminder texts to confirmed bearers, a nudge on unanswered requests, and a heads-up to the director on open spots
- Email and Google sign-in through Google Workspace; texting through Twilio
MVP
Digital Operations for the New York Firefighters Burn Center Foundation
Nonprofit fundraising · 501(c)(3) founded by firefighters in 1975
- Software that runs the Foundation's giving end to end, so staff and volunteers spend less time on admin and more of each dollar goes to burn care
- New mobile-first website with one-time or monthly PayPal donations, each gift credited to a firehouse
- Every website gift verified with PayPal and recorded within 30 seconds, with its thank-you letter and official receipt PDF made automatically; gifts reported by email are recorded within 15 minutes, and none can be counted twice
- Password-protected staff dashboard: live recent gifts, a donation map, top donors, top firehouses, and partner organizations
- Per-firehouse QR posters, a mailing-list sign-up, a one-page board report PDF, text-to-donate campaigns, and staff and supporter phone apps
Certifications, Education & Recognition
Certifications & Training
- CompTIA A+ (Sep 2008)
- CompTIA Network+ (Sep 2008)
- Learning Docker, LinkedIn (Mar 2022)
- U.S. Navy Information Systems Technician “A” School, Illinois
Education
- American Military University: Information Technology, Computer Science (2017–2019)
- Chaminade (1994–1998)
Recognition & Languages
- Global Recognition Award, Bank of America
- English: native or bilingual
- Italian: limited working proficiency
- Spanish: limited working proficiency
What would Chris do?
Ask Chris what you'd normally ask your IT staff or provider. You'll get a straight answer, and how Chris would handle it next to what you have today.
Let's talk
Available on-site, hybrid, or remote in the New York City Metropolitan Area. Tell me about your project, and I'll follow up.