jeff@homelab:~$ whoami

Systems Administrator · Omaha, NE · Homelab Junkie

Jeff Riffle

For more than 30 years I've helped businesses keep their people and technology working, across Windows, macOS, and Linux.

My work has spanned banks, retail chains, restaurants, law firms, and other fast-growing companies: field repairs on tight SLAs, deskside support in large banks, and moving hundreds of users through mergers and acquisitions. At home I run a six-node Kubernetes cluster that I have built, broken, and rebuilt until recovering it became routine. I'm also a father to a wonderful daughter, my other full-time job.

jeff@homelab:~$ fastfetch
user
jeff.riffle
role
IT Systems Administrator
exp
30+ years
desktop
Omarchy · Hyprland · Linux
cluster
K3s HA · 6 nodes
uptime
1,672,518,456 Seconds
motto
“It is what it is!”
jeff@homelab:~$ cat interests.md

Off the clock

  • Dad first. Raising my daughter as a single dad is my top priority.
  • Building my homelab to learn DevOps and cybersecurity
  • Exploring new technology, such as AI in IT support and Improving Linux skills
  • Photographing wildlife and nature, and getting better at it
jeff@homelab:~/career$ git log --graph

Career

30+ years in IT. Select an entry to read the details.

jeff@homelab:~/career$ git show 5545b59

Apr 2022 – Present · ~5 years · Omaha, NE · Hybrid

Jr. System Administrator @ Revco Solutions, Inc.

I'm providing day-to-day technical support for a growing company. I handle Tier 1 and Tier 2 issues across nearly 900 endpoints and currently I work with the infrastructure team, formerly, with the help desk support team, including through several company mergers.

What I do

  • Work with a team of about 20 others with the resolution of hundreds of tickets a month, with a very high first-call resolution rate. Also work on tasks escalated from the Help Desk to Level 2 and higher teams. Work on networking gear, building out servers in a cloud environment. Also responsible for daily patching and resolving out of date software.
  • Resolve hardware, software, and network issues, from simple to complex
  • Provide technology support to executives and senior leadership
  • Train end users so the same issue doesn't come back

Key results

  • Moved hundreds of users onto company systems during the mergers of several companies
  • Improved department performance by writing structured documentation for several processes
  • Created processes to track technology hardware and control spare-device inventory
  • Completed every IT training program offered
Scope, tools and more

Scope

endpoints
~900
team
~20 members across Help Desk, Infrastructure, & Security
tickets
100s / month
tiers
Tier 1 & Tier 2
users
regular staff through senior leadership

Environment

  • Windows
  • macOS
  • Active Directory
  • Microsoft 365
  • Azure
  • Remote Desktop
  • SnipeIT
  • LAN / WAN
  • VPN and Cloudflare MESH

Ongoing · personal project · self-hosted

k3s-homelab @ home

I built a production-style private cloud at home to learn DevOps and security work my day job doesn't cover. It runs my website, notes app, password manager, and home automation, and I document it well enough for someone else to operate.

What I built

  • A highly available K3s cluster on Ubuntu, provisioned with Ansible, that keeps running if any one node fails
  • GitOps with Argo CD: 26 applications are deployed from Git, and a manual change to the cluster is undone automatically
  • HTTPS ingress through a Cloudflare Tunnel, with no ports open on the home router, and single sign-on with two-factor through Authelia
  • Monitoring, logging, and email alerting

Key results

  • Rebuilt every protected app on a spare host from backup and verified that the data was readable
  • Kept two independent backup paths so one mistake can't delete both
  • Wrote a plain-English guide to the cluster for readers without an IT background
Scope, tools and more

More of what I did

  • Vulnerability scanning with Trivy and admission policies with Kyverno, with secrets kept encrypted in Git using SOPS and age
  • Dependency updates proposed as pull requests by Renovate, tried on a disposable test cluster before production
  • Rolling updates, one node at a time, with health checks between steps

Scope

nodes
6 (3 control, 3 worker)
GitOps
26 apps deployed from Git
storage
3× replicated volumes
backups
3 layers, restore-tested
alerts
152 rules → email
DR test
every app restored and swapped live

Environment

  • Ubuntu
  • K3s
  • Ansible
  • Argo CD
  • Helm
  • Headlamp
  • Cilium
  • Traefik
  • Authelia
  • Longhorn
  • Prometheus
  • Grafana
  • Loki
  • Kyverno
  • Trivy
  • Velero
  • GitHub Actions
  • Renovate
  • SOPS

Sep 2020 – Apr 2022 · 1 yr 8 mos · CompuCom long-term project

IT Support Engineer @ CIT Bank

On a long-term CompuCom project, I supported CIT Bank's large banking environment through the merger of Mutual of Omaha and First Citizens, both at users' desks and remotely.

What I did

  • Deskside and remote support across the bank
  • Resolved service desk tickets in ServiceNow
  • Password resets and user management in Active Directory
  • Cabling and patching, from cubicles to server room switches

Key results

  • Carried out merger migrations: SCCM disk re-imaging, RAM upgrades, software installs, and hardware swaps
Scope, tools and more

More of what I did

  • Set up and managed cloud printers

Scope

client
CIT Bank
via
CompuCom
setting
large banking environment
support
deskside & remote
context
bank merger

Environment

  • SCCM
  • ServiceNow
  • Active Directory
  • Windows
  • Cloud printing
  • Structured cabling

Mar 2019 – Apr 2022 · 3 yrs · Omaha, NE · On-site

IT Field Technician II @ CompuCom

I provided on-site technology support for large retail, banking, and commercial clients, handling priority calls under tight service-level agreements (SLAs).

What I did

  • Full on-site technology support for large retail, banking, and commercial sites
  • Diagnosed and repaired Lexmark, Xerox, and HP single-function and multifunction printers
  • Set up and installed hardware bought at retail stores, in homes and offices

Key results

  • Handled priority-level support: on site within 2 hours and resolved within 4 for large retail stores and banks
  • Performed data backups and disaster recovery, including disk re-imaging and HDD installs
  • Followed data and media destruction procedures
Scope, tools and more

Scope

clients
retail, banking, commercial
SLA
2 hr on-site · 4 hr resolution
where
stores, banks, homes, offices

Environment

  • Disk imaging
  • Backup & DR
  • Data destruction
  • Lexmark
  • Xerox
  • HP MFPs

Jun 2009 – Oct 2017 · 8 yrs · Bellevue, NE

Keno Technician

For eight years I kept a keno operation's computer systems, ticket printers, and barcode scanners running every day.

What I did

  • Oversaw the daily performance of computer systems, ticket printers, and barcode scanners
  • Answered user questions about software and hardware and resolved problems
  • Installed and repaired computer hardware, software, and peripherals to spec
  • Ran computer diagnostics and provided user support

Key results

  • Repaired Zebra commercial printers myself: printheads, cleanings, and broken gears
Scope, tools and more

Scope

systems
computers, ticket printers, scanners
tenure
8 years

Environment

  • Zebra printers
  • Barcode scanners
  • PC hardware
  • Diagnostics

Jun 2001 – May 2003 · Omaha, NE

Microcomputer Support Management @ Metropolitan Community College

Still learning

  • Every IT training program offered at Revco
  • Kubernetes, networking, storage, and disaster recovery through the homelab
  • Emerging technology such as AI in IT support
Scope, tools and more

Program

program
Microcomputer Support Management
credits
63 credit hours completed
jeff@homelab:~/career$ cat projects.md

Notable projects

Migration

Moved 500+ users between Microsoft 365 tenants

No data was lost, and users switched over smoothly.

Hardware refresh

Replaced 400+ laptops

Refreshed laptops during two separate mergers.

Telephony

Moved from analog PBX to VoIP

Supported the switch from a legacy analog phone system to VoIP.

jeff@homelab:~/career$ wc -l career
  • 30+years in IT
  • 1000sendpoints managed
  • 1000sof users assisted
  • Countlesssleepless nights
jeff@homelab:~/skills$ ls support/

Support & Systems Administration

Troubleshooting, system optimization, hardware diagnostics, incident management, end-user training, and technology support for executives and senior leadership.

Systems

  • Windows Server
  • Active Directory
  • Microsoft 365
  • Azure
  • macOS
  • Ubuntu / RHEL Linux
  • RMM (Kaseya VSA)

Service desk & field

  • ServiceNow
  • SnipeIT
  • SCCM imaging
  • Hardware refresh
  • VoIP
  • Cabling & patching
jeff@homelab:~/k3s-homelab$ kubectl get nodes

k3s-homelab

Six ordinary computers working as one small private cloud. Any single machine can fail and every service stays up.

control plane · etcd quorum

control plane - 1control plane - 2control plane - 3
worker node - 1worker node - 2worker node - 3

workers

6× HP ProDesk 405 G4 Mini · Ryzen 5 PRO 2400GE · 32 GB RAM · 256 GB NVMe + 1 TB SSD

internet ─► cloudflare ─► tunnel ─► traefik ─► app
lan      ─────────────────────────► traefik ─► app
Source on GitHub ↗
jeff@homelab:~/k3s-homelab$ ./repo-doctor.sh
  • 6nodes
  • 3×replicated volumes
  • 152alert rules
  • 3backup layers
jeff@homelab:~/k3s-homelab$ ./dr-status.sh

● DR READY

Three backup layers: nightly Longhorn backups to a NAS, etcd recovery bundles, and Velero to Garage S3 on separate hardware. Every protected app has been restored from backup and swapped into production and back, and a full rebuild with data has been tested end to end.

A backup only counts once you've restored from it.

jeff@homelab:~$ cat README

About this site

It's modeled on my desktop: Omarchy running the Hyprland tiling window manager with the Tokyo Night theme. Each section is a workspace and each panel is a window.

Plain HTML, CSS, and a little JavaScript. It's served by nginx from the homelab cluster described on this site. When I make changes to the content in the github repo, the site is updated automatically using Gitops principles.

Try 1–5, hjkl, f, and t.