Jul 23 16:13:34.724357 ip-10-0-138-199 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 16:13:34.724370 ip-10-0-138-199 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 16:13:34.724379 ip-10-0-138-199 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 16:13:34.724634 ip-10-0-138-199 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 16:13:44.908912 ip-10-0-138-199 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 16:13:44.908930 ip-10-0-138-199 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot fbfa0db854ad47128076c294b888d92b --
Jul 23 16:15:45.804845 ip-10-0-138-199 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 16:15:46.214162 ip-10-0-138-199 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 16:15:46.214162 ip-10-0-138-199 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 16:15:46.214162 ip-10-0-138-199 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 16:15:46.214162 ip-10-0-138-199 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 16:15:46.214162 ip-10-0-138-199 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 16:15:46.214162 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.204574    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 16:15:46.214162 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209094    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:46.214162 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209110    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:46.214162 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209114    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:46.214162 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209117    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:46.214162 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209120    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:46.214162 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209125    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:46.214162 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209131    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209135    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209143    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209146    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209149    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209152    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209155    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209158    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209161    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209164    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209167    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209170    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209173    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209176    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209179    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209182    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209185    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209188    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209191    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209193    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:46.215434 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209196    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209198    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209201    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209203    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209206    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209209    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209211    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209214    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209216    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209219    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209221    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209224    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209227    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209229    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209232    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209235    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209237    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209241    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209244    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209246    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:46.216067 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209249    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209251    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209254    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209257    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209259    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209262    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209266    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209268    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209271    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209274    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209276    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209279    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209283    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209287    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209289    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209292    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209296    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209299    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209302    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209305    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:46.216791 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209308    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209310    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209313    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209315    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209318    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209320    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209323    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209325    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209328    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209330    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209333    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209337    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209340    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209343    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209345    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209348    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209350    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209353    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209355    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209358    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:46.217397 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209361    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209363    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209366    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209368    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209371    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209373    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209375    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209378    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209382    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209384    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209387    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209390    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.209392    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210131    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210139    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210143    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210145    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210148    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210151    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210153    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:46.218321 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210156    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210159    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210162    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210164    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210167    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210171    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210175    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210178    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210181    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210184    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210187    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210189    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210192    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210196    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210199    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210202    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210205    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210210    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210213    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:46.218986 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210216    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210219    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210222    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210225    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210228    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210232    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210235    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210238    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210241    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210243    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210246    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210249    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210252    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210255    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210258    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210261    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210263    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210266    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210268    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210270    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:46.219671 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210273    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210276    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210278    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210281    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210286    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210288    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210291    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210293    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210296    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210298    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210301    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210303    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210306    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210309    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210312    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210314    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210317    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210319    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210323    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:46.221037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210326    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210329    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210331    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210334    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210337    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210339    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210342    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210345    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210347    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210350    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210352    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210354    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210357    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210359    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210362    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210364    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210367    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210378    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210382    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210384    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:46.221678 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210387    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210389    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210392    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210395    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210398    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210401    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210404    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210406    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210409    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210412    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210414    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210417    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210427    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210430    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210878    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210884    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210886    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210889    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210892    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210894    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:46.222306 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210897    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210902    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210905    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210908    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210910    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210913    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210916    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210920    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210924    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210927    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210930    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210933    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210935    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210938    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210940    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210943    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210945    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210948    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210950    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210953    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:46.223112 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210956    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210958    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210961    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210964    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210967    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210971    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210974    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210977    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210980    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210983    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210986    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210988    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210991    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210997    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.210999    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211002    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211005    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211008    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211010    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211013    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:46.223745 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211016    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211018    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211021    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211023    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211026    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211028    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211031    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211034    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211036    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211039    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211041    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211044    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211046    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211049    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211051    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211054    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211057    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211060    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211062    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:46.224404 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211065    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211067    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211069    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211072    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211074    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211077    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211081    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211085    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211087    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211090    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211092    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211095    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211097    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211100    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211102    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211105    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211108    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211110    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211113    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211118    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:46.225040 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211120    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211123    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211125    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211128    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211130    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211133    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211135    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211138    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211141    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211143    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211146    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211149    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211152    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211155    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211236    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211254    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211263    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211270    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211278    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211281    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211285    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 16:15:46.422454 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211290    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 16:15:46.279193 ip-10-0-138-199 systemd[1]: Started Kubernetes Kubelet.
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211293    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211296    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211299    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211302    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211306    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211309    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211312    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211315    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211318    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211323    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211328    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211331    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211334    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211337    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211341    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211345    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211348    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211351    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211354    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211357    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211360    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211363    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211367    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 16:15:46.444003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211370    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211375    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211377    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211381    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211384    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211389    2576 flags.go:64] FLAG: --enable-server="true"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211392    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211397    2576 flags.go:64] FLAG: --event-burst="100"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211400    2576 flags.go:64] FLAG: --event-qps="50"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211403    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211406    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211409    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211414    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211416    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211419    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211422    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211425    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211428    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211433    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211436    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211438    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211441    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211445    2576 flags.go:64] FLAG: --feature-gates=""
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211448    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211451    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 16:15:46.445236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211454    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211457    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211461    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211464    2576 flags.go:64] FLAG: --help="false"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211467    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-138-199.ec2.internal"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211470    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211473    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211476    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211480    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211483    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211486    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211489    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211494    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211496    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211499    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211502    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211518    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211522    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211525    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211528    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211531    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211534    2576 flags.go:64] FLAG: --lock-file=""
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211537    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211540    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 16:15:46.446211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211543    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211550    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211553    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211556    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211559    2576 flags.go:64] FLAG: --logging-format="text"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211562    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211565    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211568    2576 flags.go:64] FLAG: --manifest-url=""
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211571    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211576    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211579    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211583    2576 flags.go:64] FLAG: --max-pods="110"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211586    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211589    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211592    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211595    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211598    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211602    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211604    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211612    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211616    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211619    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211622    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 23 16:15:46.447146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211625    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211632    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211634    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211638    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211641    2576 flags.go:64] FLAG: --port="10250"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211645    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211647    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d6c431a516f7a71c"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211651    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211653    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211656    2576 flags.go:64] FLAG: --register-node="true"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211661    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211665    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211668    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211671    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211674    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211678    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211681    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211684    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211687    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211690    2576 flags.go:64] FLAG: --runonce="false"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211693    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211696    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211699    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211702    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211705    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211708    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 16:15:46.447956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211712    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211715    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211717    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211720    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211724    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211727    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211731    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211734    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211736    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211743    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211745    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211748    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211753    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211756    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211759    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211762    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211766    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211769    2576 flags.go:64] FLAG: --v="2"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211777    2576 flags.go:64] FLAG: --version="false"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211781    2576 flags.go:64] FLAG: --vmodule=""
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211784    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.211788    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211907    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211911    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:46.448965 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211914    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211918    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211922    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211925    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211929    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211932    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211935    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211937    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211940    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211943    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211945    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211948    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211951    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211954    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211957    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211959    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211962    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211964    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211967    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:46.449824 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211970    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211972    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211975    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211977    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211980    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211983    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211986    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211989    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211991    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211994    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211996    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.211999    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212002    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212004    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212007    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212011    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212014    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212017    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212020    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212023    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:46.450735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212025    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212028    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212031    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212034    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212036    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212040    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212043    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212045    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212048    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212050    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212053    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212056    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212058    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212061    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212063    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212066    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212068    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212073    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212075    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212078    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:46.451450 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212080    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212083    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212086    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212088    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212091    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212094    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212096    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212098    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212101    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212104    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212107    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212109    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212112    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212114    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212117    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212119    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212122    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212126    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212129    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212131    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:46.452312 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212134    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212137    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212139    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212142    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212144    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212147    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212149    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212152    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212154    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212158    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212161    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212163    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212166    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212169    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212171    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212175    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212178    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:46.453365 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.212181    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.212187    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.220873    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.220908    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.221667    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.221837    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221915    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221923    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221927    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221930    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221933    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221936    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221940    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221943    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:46.456371 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221946    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221949    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221952    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221954    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221957    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221961    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221964    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221967    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221970    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221973    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221977    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221982    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221986    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221989    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221992    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221995    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.221998    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222001    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222005    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222008    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:46.457206 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222011    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222014    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222018    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222021    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222024    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222027    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222031    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222034    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222037    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222040    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222043    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222046    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222049    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222052    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222054    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222058    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222060    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222063    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222066    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222069    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:46.749502 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222072    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222076    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222079    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222082    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222085    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222088    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222091    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222095    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222098    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222101    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222103    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222106    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222109    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222112    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222116    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222119    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222122    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222125    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222127    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222130    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:46.751272 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222135    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222139    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222142    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222145    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222149    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222152    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222155    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222158    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222161    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222164    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222167    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222169    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222172    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222177    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222181    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222184    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222187    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222191    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222193    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:46.753722 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222196    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222199    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222202    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222205    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222207    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222210    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222214    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222216    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222220    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222223    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222227    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222230    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.222236    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222388    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222394    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:46.754393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222397    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222400    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222404    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222407    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222410    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222413    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222416    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222419    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222422    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222426    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222430    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222433    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222436    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222439    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222442    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222444    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222447    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222450    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222453    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222456    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:46.755054 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222459    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222462    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222464    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222467    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222470    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222473    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222475    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222478    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222482    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222485    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222488    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222490    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222493    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222496    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222498    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222501    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222504    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222507    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222510    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:46.755735 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222514    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222518    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222521    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222525    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222529    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222533    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222536    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222539    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222542    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222545    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222549    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222551    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222555    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222558    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222561    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222564    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222567    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222570    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222573    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222575    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222578    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:46.756613 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222597    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222601    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222604    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222607    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222609    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222612    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222615    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222618    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222621    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222624    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222627    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222632    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222635    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222639    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222642    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222645    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222649    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222652    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222655    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:46.757276 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222658    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222661    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222664    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222667    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222670    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222672    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222675    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222678    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222681    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222683    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222686    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222689    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222692    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222694    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222697    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222700    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222702    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:46.758136 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:46.222705    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:46.758709 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.222712    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 16:15:46.758709 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.222859    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 16:15:46.758709 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.225141    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 16:15:46.758709 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.226495    2576 server.go:1019] "Starting client certificate rotation"
Jul 23 16:15:46.758709 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.226615    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 16:15:46.758709 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.226652    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 16:15:46.758709 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.229349    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 16:15:46.758709 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.230593    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 16:15:46.758709 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.238823    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 23 16:15:46.758709 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.241678    2576 log.go:25] "Validated CRI v1 image API"
Jul 23 16:15:46.758709 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.245187    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 16:15:46.758709 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.248771    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ee581a1b-a4b5-4c91-bc44-6d59f039cf28:/dev/nvme0n1p3 fd9e41a2-2297-43a5-b9bc-ffd110c08136:/dev/nvme0n1p4]
Jul 23 16:15:46.759285 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.248794    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 16:15:46.759397 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.255669    2576 manager.go:216] Machine: {Timestamp:2026-07-23 16:15:46.253979102 +0000 UTC m=+0.332407010 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099849 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25db00c88e92381a66a603f68a7563 SystemUUID:ec25db00-c88e-9238-1a66-a603f68a7563 BootID:fbfa0db8-54ad-4712-8076-c294b888d92b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:b8:80:56:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:b8:80:56:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:26:5f:0f:e1:d4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 16:15:46.759397 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.255787    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 16:15:46.759397 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.255890    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 16:15:46.759397 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.258021    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 16:15:46.759397 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.258875    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 16:15:46.759397 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.258905    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-199.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 16:15:46.759397 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.259619    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.259630    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.259638    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.261227    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.262430    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.265644    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.265803    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.265835    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.265849    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.265869    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.265882    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.265899    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.266363    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.266385    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.270763    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.272699    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.272729    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.273705    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.273719    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.273726    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.273732    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.273742    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.273749    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.273757    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.273762    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.273770    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.273776    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.273785    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.273791    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.274530    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.274539    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.278112    2576 server.go:1268] "Started kubelet"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.278271    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.278248    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.278342    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.280699    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.283021    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.284002    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-199.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.284004    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.284022    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 16:15:46.759872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.285937    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w2dqb"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.285788    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-199.ec2.internal.18c4f76085babbfa  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-199.ec2.internal,UID:ip-10-0-138-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-199.ec2.internal,},FirstTimestamp:2026-07-23 16:15:46.278087674 +0000 UTC m=+0.356515559,LastTimestamp:2026-07-23 16:15:46.278087674 +0000 UTC m=+0.356515559,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-199.ec2.internal,}"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.286670    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.288423    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.288428    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.288560    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.288995    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.289003    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.289024    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.289174    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.289185    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.289256    2576 factory.go:55] Registering systemd factory
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.289275    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.289529    2576 factory.go:153] Registering CRI-O factory
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.289548    2576 factory.go:223] Registration of the crio container factory successfully
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.289599    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.289619    2576 factory.go:103] Registering Raw factory
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.289636    2576 manager.go:1196] Started watching for new ooms in manager
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.289987    2576 manager.go:349] Starting recovery of all containers
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.291543    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w2dqb"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.300574    2576 manager.go:354] Recovery completed
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.300611    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.303165    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.309325    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.311494    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.311528    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.311555    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.312120    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.312136    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.312136    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.312175    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.312885    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:46.995943 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.312914    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.312925    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.313382    2576 policy_none.go:49] "None policy: Start"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.313396    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.313407    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.315468    2576 policy_none.go:47] "Start"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.362352    2576 manager.go:337] "Starting Device Plugin manager"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.362630    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.362653    2576 server.go:87] "Starting device plugin registration server"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.362912    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.362927    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.363043    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.363130    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.363139    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.363736    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.363787    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.463633    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.464774    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.464818    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.464831    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.464863    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-199.ec2.internal"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.471102    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-199.ec2.internal"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.471125    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-199.ec2.internal\": node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.484422    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.485753    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.485790    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.485813    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.485851    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.486774    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.488317    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.586603    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-199.ec2.internal"]
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.586694    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.586847    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.588295    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.588327    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.588337    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.589736    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.589852    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:46.998054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.589900    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.590612    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.590612    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.590679    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.590694    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.590643    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.590722    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.590895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d945213242aadc6d4443305d1366e62a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal\" (UID: \"d945213242aadc6d4443305d1366e62a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.590955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d945213242aadc6d4443305d1366e62a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal\" (UID: \"d945213242aadc6d4443305d1366e62a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.592496    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.592533    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.593270    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.593301    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.593317    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.629443    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-199.ec2.internal\" not found" node="ip-10-0-138-199.ec2.internal"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.634701    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-199.ec2.internal\" not found" node="ip-10-0-138-199.ec2.internal"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.687643    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.691166    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d945213242aadc6d4443305d1366e62a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal\" (UID: \"d945213242aadc6d4443305d1366e62a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.691195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d945213242aadc6d4443305d1366e62a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal\" (UID: \"d945213242aadc6d4443305d1366e62a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.691218    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f14cf1c9a8c48460a0bf4348398408ba-config\") pod \"kube-apiserver-proxy-ip-10-0-138-199.ec2.internal\" (UID: \"f14cf1c9a8c48460a0bf4348398408ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.691273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d945213242aadc6d4443305d1366e62a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal\" (UID: \"d945213242aadc6d4443305d1366e62a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:46.999226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.691299    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d945213242aadc6d4443305d1366e62a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal\" (UID: \"d945213242aadc6d4443305d1366e62a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:47.000350 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.788595    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:47.000350 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.794863    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f14cf1c9a8c48460a0bf4348398408ba-config\") pod \"kube-apiserver-proxy-ip-10-0-138-199.ec2.internal\" (UID: \"f14cf1c9a8c48460a0bf4348398408ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:47.000350 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.794816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f14cf1c9a8c48460a0bf4348398408ba-config\") pod \"kube-apiserver-proxy-ip-10-0-138-199.ec2.internal\" (UID: \"f14cf1c9a8c48460a0bf4348398408ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:47.000350 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.895683    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:47.000350 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.934838    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:47.000350 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:46.937581    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:47.000350 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:46.996818    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:47.236950 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:47.097016    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:47.236950 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:47.154101    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:47.236950 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:47.197726    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:47.236950 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:47.227084    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 16:15:47.236950 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:47.227317    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 16:15:47.236950 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:47.227317    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 16:15:47.482962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:47.296876    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 16:10:46 +0000 UTC" deadline="2028-01-23 17:44:41.981855939 +0000 UTC"
Jul 23 16:15:47.482962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:47.296916    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13177h28m54.684943716s"
Jul 23 16:15:47.482962 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:47.298044    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:47.482962 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:47.398368    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:47.498960 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:47.498931    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:47.599802 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:47.599748    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:47.700426 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:47.700391    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:47.724459 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:47.724418    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd945213242aadc6d4443305d1366e62a.slice/crio-e1bb6d9a778d99ab9bd15625c6312b6894f525b813093681cee95ecea45f7d02 WatchSource:0}: Error finding container e1bb6d9a778d99ab9bd15625c6312b6894f525b813093681cee95ecea45f7d02: Status 404 returned error can't find the container with id e1bb6d9a778d99ab9bd15625c6312b6894f525b813093681cee95ecea45f7d02
Jul 23 16:15:47.729968 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:47.729952    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:15:47.776623 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:47.776533    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:47.801075 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:47.801026    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-199.ec2.internal\" not found"
Jul 23 16:15:47.857982 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:47.857948    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:47.889188 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:47.889153    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:47.901108 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:47.901085    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 16:15:47.902173 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:47.902156    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal"
Jul 23 16:15:47.904479 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:47.904455    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14cf1c9a8c48460a0bf4348398408ba.slice/crio-579f3cfcfd7f339a017f144a8dd52b92ca98e31c3f0e5d42c5b4df82ca828d47 WatchSource:0}: Error finding container 579f3cfcfd7f339a017f144a8dd52b92ca98e31c3f0e5d42c5b4df82ca828d47: Status 404 returned error can't find the container with id 579f3cfcfd7f339a017f144a8dd52b92ca98e31c3f0e5d42c5b4df82ca828d47
Jul 23 16:15:47.914227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:47.914209    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 16:15:48.269032 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.268939    2576 apiserver.go:52] "Watching apiserver"
Jul 23 16:15:48.275055 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.275033    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 16:15:48.276087 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.276041    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-ftmhx","kube-system/kube-apiserver-proxy-ip-10-0-138-199.ec2.internal","openshift-dns/node-resolver-kl24z","openshift-image-registry/node-ca-hbbf4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal","openshift-multus/multus-2pv8b","openshift-network-diagnostics/network-check-target-l4cw7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x","openshift-cluster-node-tuning-operator/tuned-bgmjs","openshift-multus/multus-additional-cni-plugins-cnhfg","openshift-multus/network-metrics-daemon-5nt52","openshift-network-operator/iptables-alerter-cpnbc","openshift-ovn-kubernetes/ovnkube-node-6ffs9","kube-system/global-pull-secret-syncer-lrbgb"]
Jul 23 16:15:48.278427 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.278402    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:15:48.278539 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.278480    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:15:48.279934 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.279915    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:48.279995 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.279979    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:15:48.280955 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.280940    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kl24z"
Jul 23 16:15:48.282245 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.282220    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hbbf4"
Jul 23 16:15:48.283170 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.283147    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 16:15:48.283301 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.283159    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 16:15:48.283301 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.283197    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v8fll\""
Jul 23 16:15:48.283461 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.283444    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:48.283523 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.283504    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:15:48.283861 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.283839    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 16:15:48.284147 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.284131    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 16:15:48.284436 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.284418    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fddlj\""
Jul 23 16:15:48.284631 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.284613    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.284700 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.284640    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 16:15:48.285868 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.285851    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.286908 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.286888    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 16:15:48.287205 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.287184    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 16:15:48.287308 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.287264    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.288015 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.287997    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-j9c6v\""
Jul 23 16:15:48.288418 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.288191    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 16:15:48.288418 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.288239    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:15:48.288418 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.288261    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fnw2j\""
Jul 23 16:15:48.288418 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.288293    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 16:15:48.288658 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.288571    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 16:15:48.288658 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.288594    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.289316 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.289295    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 16:15:48.289393 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.289303    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 16:15:48.289393 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.289332    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 16:15:48.289706 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.289688    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 16:15:48.289838 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.289822    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 16:15:48.289924 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.289907    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 16:15:48.290154 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.290140    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.290559 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.290530    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 16:15:48.290697 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.290581    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 16:15:48.290697 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.290596    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w6czs\""
Jul 23 16:15:48.290697 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.290611    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 16:15:48.290927 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.290910    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mmtkj\""
Jul 23 16:15:48.290972 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.290954    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 16:15:48.291476 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.291460    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ftmhx"
Jul 23 16:15:48.292060 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.292042    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 16:15:48.292151 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.292062    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 16:15:48.292488 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.292472    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vgl72\""
Jul 23 16:15:48.292835 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.292817    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cpnbc"
Jul 23 16:15:48.293489 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.293470    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fllwt\""
Jul 23 16:15:48.293589 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.293470    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 16:15:48.293589 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.293472    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 16:15:48.294512 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.294491    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:15:48.294969 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.294952    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p29wf\""
Jul 23 16:15:48.295193 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.295176    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 16:15:48.295275 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.295192    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 16:15:48.303916 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.303893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5760df7-1880-4919-b43c-47398f52a1f7-host\") pod \"node-ca-hbbf4\" (UID: \"c5760df7-1880-4919-b43c-47398f52a1f7\") " pod="openshift-image-registry/node-ca-hbbf4"
Jul 23 16:15:48.304040 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.303920    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5760df7-1880-4919-b43c-47398f52a1f7-serviceca\") pod \"node-ca-hbbf4\" (UID: \"c5760df7-1880-4919-b43c-47398f52a1f7\") " pod="openshift-image-registry/node-ca-hbbf4"
Jul 23 16:15:48.304040 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.303901    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 16:15:48.304040 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.303964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-run-ovn-kubernetes\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.304040 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304022    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8-tmp-dir\") pod \"node-resolver-kl24z\" (UID: \"2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8\") " pod="openshift-dns/node-resolver-kl24z"
Jul 23 16:15:48.304203 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qbbn\" (UniqueName: \"kubernetes.io/projected/ad1d0917-834d-4557-8fa0-96f4b4e5021a-kube-api-access-6qbbn\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.304203 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304113    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-kubernetes\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.304203 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-tmp\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.304203 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-etc-openvswitch\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.304203 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-node-log\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.304446 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304210    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.304446 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-os-release\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.304446 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304295    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-lib-modules\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.304446 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304321    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-run-systemd\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.304446 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304356    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95wgp\" (UniqueName: \"kubernetes.io/projected/449ec165-45d2-4c9e-a3dc-7d07b7768882-kube-api-access-95wgp\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.304446 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ef77fd7-fb93-4940-b1f6-03591148fb4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.304446 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304407    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djmgn\" (UniqueName: \"kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn\") pod \"network-check-target-l4cw7\" (UID: \"f4e3834e-afc5-440d-bc07-f2f6a20c03fe\") " pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:15:48.304446 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-run-k8s-cni-cncf-io\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304482    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad1d0917-834d-4557-8fa0-96f4b4e5021a-multus-daemon-config\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-sysconfig\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v47bj\" (UniqueName: \"kubernetes.io/projected/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-kube-api-access-v47bj\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-kubelet\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g4fp\" (UniqueName: \"kubernetes.io/projected/649ecfc2-c40a-42c7-8265-d7222b74a67b-kube-api-access-7g4fp\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-kubelet-config\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-multus-cni-dir\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-var-lib-kubelet\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-etc-kubernetes\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304669    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-registration-dir\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ef77fd7-fb93-4940-b1f6-03591148fb4f-cnibin\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304730    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-run-netns\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-sysctl-conf\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.304773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-run\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/649ecfc2-c40a-42c7-8265-d7222b74a67b-ovnkube-script-lib\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304807    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-system-cni-dir\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304822    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad1d0917-834d-4557-8fa0-96f4b4e5021a-cni-binary-copy\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-var-lib-cni-multus\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-modprobe-d\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2rd5\" (UniqueName: \"kubernetes.io/projected/c5760df7-1880-4919-b43c-47398f52a1f7-kube-api-access-c2rd5\") pod \"node-ca-hbbf4\" (UID: \"c5760df7-1880-4919-b43c-47398f52a1f7\") " pod="openshift-image-registry/node-ca-hbbf4"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-run-openvswitch\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/649ecfc2-c40a-42c7-8265-d7222b74a67b-env-overrides\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-device-dir\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304967    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-dbus\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.304982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-hostroot\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-log-socket\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ef77fd7-fb93-4940-b1f6-03591148fb4f-os-release\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.305276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8ef77fd7-fb93-4940-b1f6-03591148fb4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.305962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-sys\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.305962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.305962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305130    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhxhc\" (UniqueName: \"kubernetes.io/projected/e3d8907c-035c-46a6-83b3-7ad53449bc36-kube-api-access-mhxhc\") pod \"network-metrics-daemon-5nt52\" (UID: \"e3d8907c-035c-46a6-83b3-7ad53449bc36\") " pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:48.305962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ljtl\" (UniqueName: \"kubernetes.io/projected/2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8-kube-api-access-8ljtl\") pod \"node-resolver-kl24z\" (UID: \"2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8\") " pod="openshift-dns/node-resolver-kl24z"
Jul 23 16:15:48.305962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-var-lib-cni-bin\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.305962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-sysctl-d\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.305962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305219    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-var-lib-kubelet\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.305962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-run-netns\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.305962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-socket-dir\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.305962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ef77fd7-fb93-4940-b1f6-03591148fb4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.305962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5qf6\" (UniqueName: \"kubernetes.io/projected/8ef77fd7-fb93-4940-b1f6-03591148fb4f-kube-api-access-x5qf6\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.305962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305369    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs\") pod \"network-metrics-daemon-5nt52\" (UID: \"e3d8907c-035c-46a6-83b3-7ad53449bc36\") " pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:48.305962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305413    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/649ecfc2-c40a-42c7-8265-d7222b74a67b-ovnkube-config\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.306344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8ef77fd7-fb93-4940-b1f6-03591148fb4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.306344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-cni-bin\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.306344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.306344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ef77fd7-fb93-4940-b1f6-03591148fb4f-system-cni-dir\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.306344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-cnibin\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.306344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-run-ovn\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.306344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-systemd-units\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.306344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305668    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-slash\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.306344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-cni-netd\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.306344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-sys-fs\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.306344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-multus-conf-dir\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.306344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-systemd\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.306344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305775    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:48.306804 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305797    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-var-lib-openvswitch\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.306804 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305821    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/649ecfc2-c40a-42c7-8265-d7222b74a67b-ovn-node-metrics-cert\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.306804 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8-hosts-file\") pod \"node-resolver-kl24z\" (UID: \"2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8\") " pod="openshift-dns/node-resolver-kl24z"
Jul 23 16:15:48.306804 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-run-multus-certs\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.306804 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-tuned\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.306804 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-multus-socket-dir-parent\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.306804 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.305920    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-host\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.331705 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.331682    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2wbhm"
Jul 23 16:15:48.339257 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.339235    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2wbhm"
Jul 23 16:15:48.352112 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.352089    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:48.390148 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.390115    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 16:15:48.406381 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-sysctl-conf\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.406381 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-run\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.406630 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/649ecfc2-c40a-42c7-8265-d7222b74a67b-ovnkube-script-lib\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.406630 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406549    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-system-cni-dir\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.406630 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406558    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-run\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.406630 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad1d0917-834d-4557-8fa0-96f4b4e5021a-cni-binary-copy\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.406630 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406588    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-sysctl-conf\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.406630 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-var-lib-cni-multus\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.406630 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-system-cni-dir\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.406630 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-modprobe-d\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34f8f9c6-0adc-4341-a33c-fac1e87dc98c-iptables-alerter-script\") pod \"iptables-alerter-cpnbc\" (UID: \"34f8f9c6-0adc-4341-a33c-fac1e87dc98c\") " pod="openshift-network-operator/iptables-alerter-cpnbc"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2rd5\" (UniqueName: \"kubernetes.io/projected/c5760df7-1880-4919-b43c-47398f52a1f7-kube-api-access-c2rd5\") pod \"node-ca-hbbf4\" (UID: \"c5760df7-1880-4919-b43c-47398f52a1f7\") " pod="openshift-image-registry/node-ca-hbbf4"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406719    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-modprobe-d\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-run-openvswitch\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/649ecfc2-c40a-42c7-8265-d7222b74a67b-env-overrides\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-var-lib-cni-multus\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406829    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-run-openvswitch\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-device-dir\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-dbus\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-hostroot\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406883    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-device-dir\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-log-socket\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.406994    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-log-socket\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-hostroot\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.407030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407025    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ef77fd7-fb93-4940-b1f6-03591148fb4f-os-release\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8ef77fd7-fb93-4940-b1f6-03591148fb4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-sys\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407113    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ef77fd7-fb93-4940-b1f6-03591148fb4f-os-release\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407113    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-dbus\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407180    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-sys\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407185    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/649ecfc2-c40a-42c7-8265-d7222b74a67b-ovnkube-script-lib\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhxhc\" (UniqueName: \"kubernetes.io/projected/e3d8907c-035c-46a6-83b3-7ad53449bc36-kube-api-access-mhxhc\") pod \"network-metrics-daemon-5nt52\" (UID: \"e3d8907c-035c-46a6-83b3-7ad53449bc36\") " pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407222    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad1d0917-834d-4557-8fa0-96f4b4e5021a-cni-binary-copy\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407248    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ljtl\" (UniqueName: \"kubernetes.io/projected/2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8-kube-api-access-8ljtl\") pod \"node-resolver-kl24z\" (UID: \"2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8\") " pod="openshift-dns/node-resolver-kl24z"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407290    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/649ecfc2-c40a-42c7-8265-d7222b74a67b-env-overrides\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-var-lib-cni-bin\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407473    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-var-lib-cni-bin\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.407615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-sysctl-d\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-var-lib-kubelet\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407561    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-run-netns\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407590    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-socket-dir\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-var-lib-kubelet\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ef77fd7-fb93-4940-b1f6-03591148fb4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407636    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-sysctl-d\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407650    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8ef77fd7-fb93-4940-b1f6-03591148fb4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5qf6\" (UniqueName: \"kubernetes.io/projected/8ef77fd7-fb93-4940-b1f6-03591148fb4f-kube-api-access-x5qf6\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407684    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-run-netns\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs\") pod \"network-metrics-daemon-5nt52\" (UID: \"e3d8907c-035c-46a6-83b3-7ad53449bc36\") " pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407712    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/649ecfc2-c40a-42c7-8265-d7222b74a67b-ovnkube-config\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8ef77fd7-fb93-4940-b1f6-03591148fb4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407748    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-socket-dir\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.408278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34f8f9c6-0adc-4341-a33c-fac1e87dc98c-host-slash\") pod \"iptables-alerter-cpnbc\" (UID: \"34f8f9c6-0adc-4341-a33c-fac1e87dc98c\") " pod="openshift-network-operator/iptables-alerter-cpnbc"
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-cni-bin\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.407806    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.407891    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs podName:e3d8907c-035c-46a6-83b3-7ad53449bc36 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:48.907866272 +0000 UTC m=+2.986294149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs") pod "network-metrics-daemon-5nt52" (UID: "e3d8907c-035c-46a6-83b3-7ad53449bc36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ef77fd7-fb93-4940-b1f6-03591148fb4f-system-cni-dir\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-cnibin\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-run-ovn\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.407902    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-cni-bin\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408026    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-run-ovn\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408074    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ef77fd7-fb93-4940-b1f6-03591148fb4f-system-cni-dir\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408083    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-cnibin\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-systemd-units\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.408747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408120    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-systemd-units\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408119    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-slash\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-cni-netd\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408153    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-slash\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-sys-fs\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408198    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-cni-netd\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408222    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/649ecfc2-c40a-42c7-8265-d7222b74a67b-ovnkube-config\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408261    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-sys-fs\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408328    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-multus-conf-dir\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408504    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8ef77fd7-fb93-4940-b1f6-03591148fb4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-multus-conf-dir\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-systemd\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408748    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn4k4\" (UniqueName: \"kubernetes.io/projected/34f8f9c6-0adc-4341-a33c-fac1e87dc98c-kube-api-access-hn4k4\") pod \"iptables-alerter-cpnbc\" (UID: \"34f8f9c6-0adc-4341-a33c-fac1e87dc98c\") " pod="openshift-network-operator/iptables-alerter-cpnbc"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:48.409227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ef77fd7-fb93-4940-b1f6-03591148fb4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-var-lib-openvswitch\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/649ecfc2-c40a-42c7-8265-d7222b74a67b-ovn-node-metrics-cert\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408824    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-systemd\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8-hosts-file\") pod \"node-resolver-kl24z\" (UID: \"2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8\") " pod="openshift-dns/node-resolver-kl24z"
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408865    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-var-lib-openvswitch\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.408884    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-run-multus-certs\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408907    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8-hosts-file\") pod \"node-resolver-kl24z\" (UID: \"2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8\") " pod="openshift-dns/node-resolver-kl24z"
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-tuned\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-run-multus-certs\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.408944    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret podName:3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:48.908926629 +0000 UTC m=+2.987354523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret") pod "global-pull-secret-syncer-lrbgb" (UID: "3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.408979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-multus-socket-dir-parent\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-host\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.409922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5760df7-1880-4919-b43c-47398f52a1f7-host\") pod \"node-ca-hbbf4\" (UID: \"c5760df7-1880-4919-b43c-47398f52a1f7\") " pod="openshift-image-registry/node-ca-hbbf4"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-multus-socket-dir-parent\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-host\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409103    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c5760df7-1880-4919-b43c-47398f52a1f7-host\") pod \"node-ca-hbbf4\" (UID: \"c5760df7-1880-4919-b43c-47398f52a1f7\") " pod="openshift-image-registry/node-ca-hbbf4"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5760df7-1880-4919-b43c-47398f52a1f7-serviceca\") pod \"node-ca-hbbf4\" (UID: \"c5760df7-1880-4919-b43c-47398f52a1f7\") " pod="openshift-image-registry/node-ca-hbbf4"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-run-ovn-kubernetes\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409182    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409232    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-run-ovn-kubernetes\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8-tmp-dir\") pod \"node-resolver-kl24z\" (UID: \"2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8\") " pod="openshift-dns/node-resolver-kl24z"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qbbn\" (UniqueName: \"kubernetes.io/projected/ad1d0917-834d-4557-8fa0-96f4b4e5021a-kube-api-access-6qbbn\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-kubernetes\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409332    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-tmp\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-etc-openvswitch\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-node-log\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409404    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.410600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-os-release\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-kubernetes\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-lib-modules\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/791c2ce5-f0c6-40c9-a70d-eed11f5a1044-agent-certs\") pod \"konnectivity-agent-ftmhx\" (UID: \"791c2ce5-f0c6-40c9-a70d-eed11f5a1044\") " pod="kube-system/konnectivity-agent-ftmhx"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409486    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-etc-openvswitch\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-run-systemd\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409549    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c5760df7-1880-4919-b43c-47398f52a1f7-serviceca\") pod \"node-ca-hbbf4\" (UID: \"c5760df7-1880-4919-b43c-47398f52a1f7\") " pod="openshift-image-registry/node-ca-hbbf4"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409561    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95wgp\" (UniqueName: \"kubernetes.io/projected/449ec165-45d2-4c9e-a3dc-7d07b7768882-kube-api-access-95wgp\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ef77fd7-fb93-4940-b1f6-03591148fb4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409616    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-os-release\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djmgn\" (UniqueName: \"kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn\") pod \"network-check-target-l4cw7\" (UID: \"f4e3834e-afc5-440d-bc07-f2f6a20c03fe\") " pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409662    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-node-log\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-run-k8s-cni-cncf-io\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409700    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad1d0917-834d-4557-8fa0-96f4b4e5021a-multus-daemon-config\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409703    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-run-k8s-cni-cncf-io\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.411339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-sysconfig\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v47bj\" (UniqueName: \"kubernetes.io/projected/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-kube-api-access-v47bj\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-kubelet\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g4fp\" (UniqueName: \"kubernetes.io/projected/649ecfc2-c40a-42c7-8265-d7222b74a67b-kube-api-access-7g4fp\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-kubelet-config\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ef77fd7-fb93-4940-b1f6-03591148fb4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409841    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8-tmp-dir\") pod \"node-resolver-kl24z\" (UID: \"2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8\") " pod="openshift-dns/node-resolver-kl24z"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409856    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-multus-cni-dir\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409909    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-run-systemd\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-multus-cni-dir\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-lib-modules\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-var-lib-kubelet\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409980    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-sysconfig\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.409986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-etc-kubernetes\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.410013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/791c2ce5-f0c6-40c9-a70d-eed11f5a1044-konnectivity-ca\") pod \"konnectivity-agent-ftmhx\" (UID: \"791c2ce5-f0c6-40c9-a70d-eed11f5a1044\") " pod="kube-system/konnectivity-agent-ftmhx"
Jul 23 16:15:48.412135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.410044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.412856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.410059    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-registration-dir\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.412856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.410080    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-var-lib-kubelet\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.412856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.410086    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ef77fd7-fb93-4940-b1f6-03591148fb4f-cnibin\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.412856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.410132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-run-netns\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.412856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.410259    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-etc-kubernetes\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.412856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.410264    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/649ecfc2-c40a-42c7-8265-d7222b74a67b-host-kubelet\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.412856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.410308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ef77fd7-fb93-4940-b1f6-03591148fb4f-cnibin\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.412856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.410326    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/449ec165-45d2-4c9e-a3dc-7d07b7768882-registration-dir\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.412856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.410359    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-kubelet-config\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:48.412856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.410402    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad1d0917-834d-4557-8fa0-96f4b4e5021a-host-run-netns\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.412856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.410536    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad1d0917-834d-4557-8fa0-96f4b4e5021a-multus-daemon-config\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.415570 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.415543    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-tmp\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.415719 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.415663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-etc-tuned\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.415719 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.415702    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/649ecfc2-c40a-42c7-8265-d7222b74a67b-ovn-node-metrics-cert\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.418150 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.418113    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5qf6\" (UniqueName: \"kubernetes.io/projected/8ef77fd7-fb93-4940-b1f6-03591148fb4f-kube-api-access-x5qf6\") pod \"multus-additional-cni-plugins-cnhfg\" (UID: \"8ef77fd7-fb93-4940-b1f6-03591148fb4f\") " pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.418276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.418168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ljtl\" (UniqueName: \"kubernetes.io/projected/2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8-kube-api-access-8ljtl\") pod \"node-resolver-kl24z\" (UID: \"2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8\") " pod="openshift-dns/node-resolver-kl24z"
Jul 23 16:15:48.418276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.418120    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2rd5\" (UniqueName: \"kubernetes.io/projected/c5760df7-1880-4919-b43c-47398f52a1f7-kube-api-access-c2rd5\") pod \"node-ca-hbbf4\" (UID: \"c5760df7-1880-4919-b43c-47398f52a1f7\") " pod="openshift-image-registry/node-ca-hbbf4"
Jul 23 16:15:48.418276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.418228    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhxhc\" (UniqueName: \"kubernetes.io/projected/e3d8907c-035c-46a6-83b3-7ad53449bc36-kube-api-access-mhxhc\") pod \"network-metrics-daemon-5nt52\" (UID: \"e3d8907c-035c-46a6-83b3-7ad53449bc36\") " pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:48.419849 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.419824    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:48.419849 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.419853    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:48.420028 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.419869    2576 projected.go:196] Error preparing data for projected volume kube-api-access-djmgn for pod openshift-network-diagnostics/network-check-target-l4cw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:48.420028 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.419947    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn podName:f4e3834e-afc5-440d-bc07-f2f6a20c03fe nodeName:}" failed. No retries permitted until 2026-07-23 16:15:48.919930468 +0000 UTC m=+2.998358357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-djmgn" (UniqueName: "kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn") pod "network-check-target-l4cw7" (UID: "f4e3834e-afc5-440d-bc07-f2f6a20c03fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:48.421695 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.421668    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qbbn\" (UniqueName: \"kubernetes.io/projected/ad1d0917-834d-4557-8fa0-96f4b4e5021a-kube-api-access-6qbbn\") pod \"multus-2pv8b\" (UID: \"ad1d0917-834d-4557-8fa0-96f4b4e5021a\") " pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.421809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.421787    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g4fp\" (UniqueName: \"kubernetes.io/projected/649ecfc2-c40a-42c7-8265-d7222b74a67b-kube-api-access-7g4fp\") pod \"ovnkube-node-6ffs9\" (UID: \"649ecfc2-c40a-42c7-8265-d7222b74a67b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.421915 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.421898    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95wgp\" (UniqueName: \"kubernetes.io/projected/449ec165-45d2-4c9e-a3dc-7d07b7768882-kube-api-access-95wgp\") pod \"aws-ebs-csi-driver-node-j7l5x\" (UID: \"449ec165-45d2-4c9e-a3dc-7d07b7768882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.421958 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.421905    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v47bj\" (UniqueName: \"kubernetes.io/projected/3279d09f-1c4f-4bc5-8ba9-40382edbbc5c-kube-api-access-v47bj\") pod \"tuned-bgmjs\" (UID: \"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c\") " pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.491137 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.491088    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-199.ec2.internal" event={"ID":"f14cf1c9a8c48460a0bf4348398408ba","Type":"ContainerStarted","Data":"579f3cfcfd7f339a017f144a8dd52b92ca98e31c3f0e5d42c5b4df82ca828d47"}
Jul 23 16:15:48.492176 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.492146    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal" event={"ID":"d945213242aadc6d4443305d1366e62a","Type":"ContainerStarted","Data":"e1bb6d9a778d99ab9bd15625c6312b6894f525b813093681cee95ecea45f7d02"}
Jul 23 16:15:48.510416 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.510378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/791c2ce5-f0c6-40c9-a70d-eed11f5a1044-agent-certs\") pod \"konnectivity-agent-ftmhx\" (UID: \"791c2ce5-f0c6-40c9-a70d-eed11f5a1044\") " pod="kube-system/konnectivity-agent-ftmhx"
Jul 23 16:15:48.510619 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.510442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/791c2ce5-f0c6-40c9-a70d-eed11f5a1044-konnectivity-ca\") pod \"konnectivity-agent-ftmhx\" (UID: \"791c2ce5-f0c6-40c9-a70d-eed11f5a1044\") " pod="kube-system/konnectivity-agent-ftmhx"
Jul 23 16:15:48.510619 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.510472    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34f8f9c6-0adc-4341-a33c-fac1e87dc98c-iptables-alerter-script\") pod \"iptables-alerter-cpnbc\" (UID: \"34f8f9c6-0adc-4341-a33c-fac1e87dc98c\") " pod="openshift-network-operator/iptables-alerter-cpnbc"
Jul 23 16:15:48.510619 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.510521    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34f8f9c6-0adc-4341-a33c-fac1e87dc98c-host-slash\") pod \"iptables-alerter-cpnbc\" (UID: \"34f8f9c6-0adc-4341-a33c-fac1e87dc98c\") " pod="openshift-network-operator/iptables-alerter-cpnbc"
Jul 23 16:15:48.510619 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.510567    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn4k4\" (UniqueName: \"kubernetes.io/projected/34f8f9c6-0adc-4341-a33c-fac1e87dc98c-kube-api-access-hn4k4\") pod \"iptables-alerter-cpnbc\" (UID: \"34f8f9c6-0adc-4341-a33c-fac1e87dc98c\") " pod="openshift-network-operator/iptables-alerter-cpnbc"
Jul 23 16:15:48.510828 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.510673    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34f8f9c6-0adc-4341-a33c-fac1e87dc98c-host-slash\") pod \"iptables-alerter-cpnbc\" (UID: \"34f8f9c6-0adc-4341-a33c-fac1e87dc98c\") " pod="openshift-network-operator/iptables-alerter-cpnbc"
Jul 23 16:15:48.511098 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.511079    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/791c2ce5-f0c6-40c9-a70d-eed11f5a1044-konnectivity-ca\") pod \"konnectivity-agent-ftmhx\" (UID: \"791c2ce5-f0c6-40c9-a70d-eed11f5a1044\") " pod="kube-system/konnectivity-agent-ftmhx"
Jul 23 16:15:48.511154 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.511089    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34f8f9c6-0adc-4341-a33c-fac1e87dc98c-iptables-alerter-script\") pod \"iptables-alerter-cpnbc\" (UID: \"34f8f9c6-0adc-4341-a33c-fac1e87dc98c\") " pod="openshift-network-operator/iptables-alerter-cpnbc"
Jul 23 16:15:48.513177 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.513155    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/791c2ce5-f0c6-40c9-a70d-eed11f5a1044-agent-certs\") pod \"konnectivity-agent-ftmhx\" (UID: \"791c2ce5-f0c6-40c9-a70d-eed11f5a1044\") " pod="kube-system/konnectivity-agent-ftmhx"
Jul 23 16:15:48.518944 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.518922    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn4k4\" (UniqueName: \"kubernetes.io/projected/34f8f9c6-0adc-4341-a33c-fac1e87dc98c-kube-api-access-hn4k4\") pod \"iptables-alerter-cpnbc\" (UID: \"34f8f9c6-0adc-4341-a33c-fac1e87dc98c\") " pod="openshift-network-operator/iptables-alerter-cpnbc"
Jul 23 16:15:48.593199 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.593105    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kl24z"
Jul 23 16:15:48.599631 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.599598    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hbbf4"
Jul 23 16:15:48.603810 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:48.603762    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf0f0b6_bffc_4f05_9e7a_796cbe1a35b8.slice/crio-10cceb1c4e2e8306e517dc6f637bb4b846aa56031404b10ed9d51d083323e5f8 WatchSource:0}: Error finding container 10cceb1c4e2e8306e517dc6f637bb4b846aa56031404b10ed9d51d083323e5f8: Status 404 returned error can't find the container with id 10cceb1c4e2e8306e517dc6f637bb4b846aa56031404b10ed9d51d083323e5f8
Jul 23 16:15:48.610318 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.610043    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2pv8b"
Jul 23 16:15:48.612485 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:48.612455    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5760df7_1880_4919_b43c_47398f52a1f7.slice/crio-5178d780b26a61e4b831ff78ff2bd99b9ff76810176b6bfb43589b60c43bd250 WatchSource:0}: Error finding container 5178d780b26a61e4b831ff78ff2bd99b9ff76810176b6bfb43589b60c43bd250: Status 404 returned error can't find the container with id 5178d780b26a61e4b831ff78ff2bd99b9ff76810176b6bfb43589b60c43bd250
Jul 23 16:15:48.614877 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.614856    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bgmjs"
Jul 23 16:15:48.621504 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.621483    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:15:48.628011 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.627790    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x"
Jul 23 16:15:48.628769 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:48.628727    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1d0917_834d_4557_8fa0_96f4b4e5021a.slice/crio-c47560b39925beb033a810dd789a1d57ba920e482e1be5dfbd1a3fcab7154bff WatchSource:0}: Error finding container c47560b39925beb033a810dd789a1d57ba920e482e1be5dfbd1a3fcab7154bff: Status 404 returned error can't find the container with id c47560b39925beb033a810dd789a1d57ba920e482e1be5dfbd1a3fcab7154bff
Jul 23 16:15:48.633164 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.632989    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cnhfg"
Jul 23 16:15:48.639676 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.639349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ftmhx"
Jul 23 16:15:48.646118 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.646075    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cpnbc"
Jul 23 16:15:48.647217 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:48.647183    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef77fd7_fb93_4940_b1f6_03591148fb4f.slice/crio-35875da51d05f2eadf3717f70f528725968214efd7146575f2a639a6799646bb WatchSource:0}: Error finding container 35875da51d05f2eadf3717f70f528725968214efd7146575f2a639a6799646bb: Status 404 returned error can't find the container with id 35875da51d05f2eadf3717f70f528725968214efd7146575f2a639a6799646bb
Jul 23 16:15:48.650859 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:48.650616    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449ec165_45d2_4c9e_a3dc_7d07b7768882.slice/crio-7ec87308d28250853c87a9641a3e12150ec01be7a7e3bc2d5a310c52384fc819 WatchSource:0}: Error finding container 7ec87308d28250853c87a9641a3e12150ec01be7a7e3bc2d5a310c52384fc819: Status 404 returned error can't find the container with id 7ec87308d28250853c87a9641a3e12150ec01be7a7e3bc2d5a310c52384fc819
Jul 23 16:15:48.655589 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:48.655545    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791c2ce5_f0c6_40c9_a70d_eed11f5a1044.slice/crio-de1c6a9c587fd31d0bcd819d16acbf14101c37cd6e3843f3cfffb927449c5769 WatchSource:0}: Error finding container de1c6a9c587fd31d0bcd819d16acbf14101c37cd6e3843f3cfffb927449c5769: Status 404 returned error can't find the container with id de1c6a9c587fd31d0bcd819d16acbf14101c37cd6e3843f3cfffb927449c5769
Jul 23 16:15:48.666981 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:15:48.666156    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f8f9c6_0adc_4341_a33c_fac1e87dc98c.slice/crio-80e39429b05186e4c691c4188a9b698f42f0d763f10bc44ef864e5dd6261df1a WatchSource:0}: Error finding container 80e39429b05186e4c691c4188a9b698f42f0d763f10bc44ef864e5dd6261df1a: Status 404 returned error can't find the container with id 80e39429b05186e4c691c4188a9b698f42f0d763f10bc44ef864e5dd6261df1a
Jul 23 16:15:48.914492 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.914380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:48.914492 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:48.914482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs\") pod \"network-metrics-daemon-5nt52\" (UID: \"e3d8907c-035c-46a6-83b3-7ad53449bc36\") " pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:48.914726 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.914632    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:48.914726 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.914699    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs podName:e3d8907c-035c-46a6-83b3-7ad53449bc36 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:49.914678696 +0000 UTC m=+3.993106582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs") pod "network-metrics-daemon-5nt52" (UID: "e3d8907c-035c-46a6-83b3-7ad53449bc36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:48.914855 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.914769    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:48.914855 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:48.914815    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret podName:3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:49.914802374 +0000 UTC m=+3.993230248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret") pod "global-pull-secret-syncer-lrbgb" (UID: "3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:49.015867 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.015825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djmgn\" (UniqueName: \"kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn\") pod \"network-check-target-l4cw7\" (UID: \"f4e3834e-afc5-440d-bc07-f2f6a20c03fe\") " pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:15:49.016126 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:49.015987    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:49.016126 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:49.016011    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:49.016126 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:49.016024    2576 projected.go:196] Error preparing data for projected volume kube-api-access-djmgn for pod openshift-network-diagnostics/network-check-target-l4cw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:49.016126 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:49.016089    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn podName:f4e3834e-afc5-440d-bc07-f2f6a20c03fe nodeName:}" failed. No retries permitted until 2026-07-23 16:15:50.016073966 +0000 UTC m=+4.094501863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-djmgn" (UniqueName: "kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn") pod "network-check-target-l4cw7" (UID: "f4e3834e-afc5-440d-bc07-f2f6a20c03fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:49.200463 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.200371    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:49.341457 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.341384    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 16:10:48 +0000 UTC" deadline="2027-12-31 11:02:32.910237938 +0000 UTC"
Jul 23 16:15:49.341457 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.341452    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12618h46m43.568790093s"
Jul 23 16:15:49.496206 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.496113    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cpnbc" event={"ID":"34f8f9c6-0adc-4341-a33c-fac1e87dc98c","Type":"ContainerStarted","Data":"80e39429b05186e4c691c4188a9b698f42f0d763f10bc44ef864e5dd6261df1a"}
Jul 23 16:15:49.497481 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.497436    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnhfg" event={"ID":"8ef77fd7-fb93-4940-b1f6-03591148fb4f","Type":"ContainerStarted","Data":"35875da51d05f2eadf3717f70f528725968214efd7146575f2a639a6799646bb"}
Jul 23 16:15:49.498906 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.498869    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9" event={"ID":"649ecfc2-c40a-42c7-8265-d7222b74a67b","Type":"ContainerStarted","Data":"ffb9f84ce869a688c3e47726d19ed8f0e5a9136280d496ed06e06fbe015ee63a"}
Jul 23 16:15:49.500480 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.500451    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hbbf4" event={"ID":"c5760df7-1880-4919-b43c-47398f52a1f7","Type":"ContainerStarted","Data":"5178d780b26a61e4b831ff78ff2bd99b9ff76810176b6bfb43589b60c43bd250"}
Jul 23 16:15:49.502831 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.502798    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kl24z" event={"ID":"2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8","Type":"ContainerStarted","Data":"10cceb1c4e2e8306e517dc6f637bb4b846aa56031404b10ed9d51d083323e5f8"}
Jul 23 16:15:49.507091 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.507060    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ftmhx" event={"ID":"791c2ce5-f0c6-40c9-a70d-eed11f5a1044","Type":"ContainerStarted","Data":"de1c6a9c587fd31d0bcd819d16acbf14101c37cd6e3843f3cfffb927449c5769"}
Jul 23 16:15:49.508853 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.508572    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x" event={"ID":"449ec165-45d2-4c9e-a3dc-7d07b7768882","Type":"ContainerStarted","Data":"7ec87308d28250853c87a9641a3e12150ec01be7a7e3bc2d5a310c52384fc819"}
Jul 23 16:15:49.510205 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.510176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bgmjs" event={"ID":"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c","Type":"ContainerStarted","Data":"7fe5c9c3ecaa7b3d5f7557d73620a9e40742ebbb699c83d8ed8a270527befb1e"}
Jul 23 16:15:49.511502 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.511468    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2pv8b" event={"ID":"ad1d0917-834d-4557-8fa0-96f4b4e5021a","Type":"ContainerStarted","Data":"c47560b39925beb033a810dd789a1d57ba920e482e1be5dfbd1a3fcab7154bff"}
Jul 23 16:15:49.924812 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.924699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs\") pod \"network-metrics-daemon-5nt52\" (UID: \"e3d8907c-035c-46a6-83b3-7ad53449bc36\") " pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:49.924812 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:49.924769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:49.925045 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:49.924916    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:49.925045 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:49.924989    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret podName:3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:51.924968941 +0000 UTC m=+6.003396833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret") pod "global-pull-secret-syncer-lrbgb" (UID: "3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:49.925467 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:49.925440    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:49.925598 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:49.925530    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs podName:e3d8907c-035c-46a6-83b3-7ad53449bc36 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:51.925496946 +0000 UTC m=+6.003924826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs") pod "network-metrics-daemon-5nt52" (UID: "e3d8907c-035c-46a6-83b3-7ad53449bc36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:50.025694 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:50.025657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djmgn\" (UniqueName: \"kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn\") pod \"network-check-target-l4cw7\" (UID: \"f4e3834e-afc5-440d-bc07-f2f6a20c03fe\") " pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:15:50.025874 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:50.025810    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:50.025874 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:50.025831    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:50.025874 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:50.025843    2576 projected.go:196] Error preparing data for projected volume kube-api-access-djmgn for pod openshift-network-diagnostics/network-check-target-l4cw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:50.026029 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:50.025890    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn podName:f4e3834e-afc5-440d-bc07-f2f6a20c03fe nodeName:}" failed. No retries permitted until 2026-07-23 16:15:52.025876573 +0000 UTC m=+6.104304442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-djmgn" (UniqueName: "kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn") pod "network-check-target-l4cw7" (UID: "f4e3834e-afc5-440d-bc07-f2f6a20c03fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:50.342033 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:50.341934    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 16:10:48 +0000 UTC" deadline="2027-12-21 20:33:49.7494532 +0000 UTC"
Jul 23 16:15:50.342033 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:50.341981    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12388h17m59.407477221s"
Jul 23 16:15:50.486662 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:50.486626    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:15:50.486843 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:50.486767    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:15:50.487192 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:50.487174    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:50.487334 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:50.487314    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:15:50.487431 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:50.487417    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:50.487529 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:50.487496    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:15:51.942649 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:51.942608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:51.943108 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:51.942780    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:51.943108 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:51.942796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs\") pod \"network-metrics-daemon-5nt52\" (UID: \"e3d8907c-035c-46a6-83b3-7ad53449bc36\") " pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:51.943108 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:51.942857    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret podName:3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:55.942835638 +0000 UTC m=+10.021263509 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret") pod "global-pull-secret-syncer-lrbgb" (UID: "3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:51.943108 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:51.942906    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:51.943108 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:51.942958    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs podName:e3d8907c-035c-46a6-83b3-7ad53449bc36 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:55.942941083 +0000 UTC m=+10.021368966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs") pod "network-metrics-daemon-5nt52" (UID: "e3d8907c-035c-46a6-83b3-7ad53449bc36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:52.043829 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:52.043746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djmgn\" (UniqueName: \"kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn\") pod \"network-check-target-l4cw7\" (UID: \"f4e3834e-afc5-440d-bc07-f2f6a20c03fe\") " pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:15:52.044013 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:52.043994    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:52.044013 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:52.044013    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:52.044118 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:52.044026    2576 projected.go:196] Error preparing data for projected volume kube-api-access-djmgn for pod openshift-network-diagnostics/network-check-target-l4cw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:52.044118 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:52.044082    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn podName:f4e3834e-afc5-440d-bc07-f2f6a20c03fe nodeName:}" failed. No retries permitted until 2026-07-23 16:15:56.044064971 +0000 UTC m=+10.122492841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-djmgn" (UniqueName: "kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn") pod "network-check-target-l4cw7" (UID: "f4e3834e-afc5-440d-bc07-f2f6a20c03fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:52.486756 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:52.486722    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:15:52.486949 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:52.486853    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:15:52.487135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:52.487112    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:52.487292 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:52.487241    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:15:52.487454 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:52.487419    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:52.487561 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:52.487539    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:15:54.486653 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:54.486615    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:54.487129 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:54.486759    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:15:54.487129 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:54.486782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:15:54.487129 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:54.486852    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:15:54.487129 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:54.487021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:54.487129 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:54.487120    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:15:55.980421 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:55.980379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs\") pod \"network-metrics-daemon-5nt52\" (UID: \"e3d8907c-035c-46a6-83b3-7ad53449bc36\") " pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:55.980421 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:55.980425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:55.980961 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:55.980547    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:55.980961 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:55.980547    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:55.980961 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:55.980644    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret podName:3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:03.980625025 +0000 UTC m=+18.059052917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret") pod "global-pull-secret-syncer-lrbgb" (UID: "3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:55.980961 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:55.980669    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs podName:e3d8907c-035c-46a6-83b3-7ad53449bc36 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:03.980657113 +0000 UTC m=+18.059084993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs") pod "network-metrics-daemon-5nt52" (UID: "e3d8907c-035c-46a6-83b3-7ad53449bc36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:56.082365 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:56.081743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djmgn\" (UniqueName: \"kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn\") pod \"network-check-target-l4cw7\" (UID: \"f4e3834e-afc5-440d-bc07-f2f6a20c03fe\") " pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:15:56.082365 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:56.081903    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:56.082365 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:56.081922    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:56.082365 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:56.081937    2576 projected.go:196] Error preparing data for projected volume kube-api-access-djmgn for pod openshift-network-diagnostics/network-check-target-l4cw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:56.082365 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:56.081996    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn podName:f4e3834e-afc5-440d-bc07-f2f6a20c03fe nodeName:}" failed. No retries permitted until 2026-07-23 16:16:04.081977114 +0000 UTC m=+18.160404996 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-djmgn" (UniqueName: "kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn") pod "network-check-target-l4cw7" (UID: "f4e3834e-afc5-440d-bc07-f2f6a20c03fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:56.487376 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:56.487340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:15:56.487376 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:56.487367    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:56.487622 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:56.487340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:56.487622 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:56.487457    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:15:56.487622 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:56.487583    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:15:56.487787 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:56.487676    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:15:58.486482 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:58.486445    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:15:58.486941 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:58.486451    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:15:58.486941 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:15:58.486619    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:15:58.486941 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:58.486633    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:15:58.486941 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:58.486711    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:15:58.486941 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:15:58.486799    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:00.486385 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:00.486344    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:00.486867 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:00.486344    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:00.486867 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:00.486488    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:00.486867 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:00.486573    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:00.486867 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:00.486349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:00.486867 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:00.486661    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:02.486327 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:02.486288    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:02.486807 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:02.486288    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:02.486807 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:02.486455    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:02.486807 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:02.486477    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:02.486807 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:02.486561    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:02.487372 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:02.487314    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:04.040300 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:04.040071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:04.040812 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:04.040366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs\") pod \"network-metrics-daemon-5nt52\" (UID: \"e3d8907c-035c-46a6-83b3-7ad53449bc36\") " pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:04.040812 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:04.040247    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:16:04.040812 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:04.040430    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:16:04.040812 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:04.040449    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret podName:3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:20.040435822 +0000 UTC m=+34.118863691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret") pod "global-pull-secret-syncer-lrbgb" (UID: "3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:16:04.040812 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:04.040496    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs podName:e3d8907c-035c-46a6-83b3-7ad53449bc36 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:20.040475881 +0000 UTC m=+34.118903773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs") pod "network-metrics-daemon-5nt52" (UID: "e3d8907c-035c-46a6-83b3-7ad53449bc36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:16:04.141338 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:04.141295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djmgn\" (UniqueName: \"kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn\") pod \"network-check-target-l4cw7\" (UID: \"f4e3834e-afc5-440d-bc07-f2f6a20c03fe\") " pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:04.141541 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:04.141485    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:16:04.141541 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:04.141528    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:16:04.141541 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:04.141542    2576 projected.go:196] Error preparing data for projected volume kube-api-access-djmgn for pod openshift-network-diagnostics/network-check-target-l4cw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:16:04.141684 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:04.141602    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn podName:f4e3834e-afc5-440d-bc07-f2f6a20c03fe nodeName:}" failed. No retries permitted until 2026-07-23 16:16:20.14158733 +0000 UTC m=+34.220015199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-djmgn" (UniqueName: "kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn") pod "network-check-target-l4cw7" (UID: "f4e3834e-afc5-440d-bc07-f2f6a20c03fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:16:04.486501 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:04.486415    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:04.486671 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:04.486415    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:04.486671 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:04.486559    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:04.486671 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:04.486622    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:04.486671 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:04.486420    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:04.486842 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:04.486712    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:06.487699 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:06.487661    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:06.488160 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:06.487773    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:06.488160 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:06.487787    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:06.488160 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:06.487934    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:06.488160 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:06.487969    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:06.488160 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:06.488050    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:08.487418 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:08.486864    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:08.487418 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:08.486864    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:08.487418 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:08.487151    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:08.487418 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:08.487011    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:08.487418 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:08.487342    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:08.488006 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:08.487437    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:08.557202 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:08.557099    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-199.ec2.internal" event={"ID":"f14cf1c9a8c48460a0bf4348398408ba","Type":"ContainerStarted","Data":"60cb71c4398b1a4d22153457d6575b39dbee31e96c66e7132bdabf48d4e40f21"}
Jul 23 16:16:08.558656 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:08.558625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bgmjs" event={"ID":"3279d09f-1c4f-4bc5-8ba9-40382edbbc5c","Type":"ContainerStarted","Data":"d0c72ffc3f8910d9730e5394dcea9080748d1dfd9bfe5ec251abe29b6fe71748"}
Jul 23 16:16:08.561093 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:08.560997    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2pv8b" event={"ID":"ad1d0917-834d-4557-8fa0-96f4b4e5021a","Type":"ContainerStarted","Data":"184179d8f36b7d288f4a8825cdab1c68cb6fae7b17d8d3effec07b9052c76bfe"}
Jul 23 16:16:08.570600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:08.570551    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-199.ec2.internal" podStartSLOduration=20.570535805 podStartE2EDuration="20.570535805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:08.570011255 +0000 UTC m=+22.648439145" watchObservedRunningTime="2026-07-23 16:16:08.570535805 +0000 UTC m=+22.648963696"
Jul 23 16:16:08.586925 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:08.586882    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2pv8b" podStartSLOduration=3.4299417500000002 podStartE2EDuration="22.586864466s" totalImagesPullingTime="19.156922716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:08.586341233 +0000 UTC m=+22.664769124" watchObservedRunningTime="2026-07-23 16:16:08.586864466 +0000 UTC m=+22.665292356"
Jul 23 16:16:09.564429 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.564022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hbbf4" event={"ID":"c5760df7-1880-4919-b43c-47398f52a1f7","Type":"ContainerStarted","Data":"12e03926832a4798deb147be779767a5d99f9536dc758f65c6f1fdb25f8d0784"}
Jul 23 16:16:09.565462 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.565442    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kl24z" event={"ID":"2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8","Type":"ContainerStarted","Data":"786e6179e9d949ea1c225b2de22b54702577fd6afd8f8e0ded8dca1ae7ad5dfd"}
Jul 23 16:16:09.566771 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.566751    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ftmhx" event={"ID":"791c2ce5-f0c6-40c9-a70d-eed11f5a1044","Type":"ContainerStarted","Data":"84e965237533357a33ec5e18973481d10878c158511566b53252692117dcee97"}
Jul 23 16:16:09.568209 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.568185    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x" event={"ID":"449ec165-45d2-4c9e-a3dc-7d07b7768882","Type":"ContainerStarted","Data":"d6f239444bd7f4b305b3560b35bda19026bec925915cd0ce7594ecf189a6f91c"}
Jul 23 16:16:09.569657 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.569636    2576 generic.go:356] "Generic (PLEG): container finished" podID="d945213242aadc6d4443305d1366e62a" containerID="977221cb877e68c8b1a51ed5a24112c75443e180610c6de181c7cf2737cd68c7" exitCode=0
Jul 23 16:16:09.569790 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.569698    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal" event={"ID":"d945213242aadc6d4443305d1366e62a","Type":"ContainerDied","Data":"977221cb877e68c8b1a51ed5a24112c75443e180610c6de181c7cf2737cd68c7"}
Jul 23 16:16:09.571009 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.570986    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cpnbc" event={"ID":"34f8f9c6-0adc-4341-a33c-fac1e87dc98c","Type":"ContainerStarted","Data":"9eb89da8b4a91ca9e9b9a96f08b9ab4af0107cc481774a27e082d53e128eba6c"}
Jul 23 16:16:09.572358 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.572339    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ef77fd7-fb93-4940-b1f6-03591148fb4f" containerID="854516514b0093c9347d75cf74175bf6406ff50d1fea645bc5ee432494a6f93a" exitCode=0
Jul 23 16:16:09.572441 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.572424    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnhfg" event={"ID":"8ef77fd7-fb93-4940-b1f6-03591148fb4f","Type":"ContainerDied","Data":"854516514b0093c9347d75cf74175bf6406ff50d1fea645bc5ee432494a6f93a"}
Jul 23 16:16:09.575225 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.575208    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:16:09.575622 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.575598    2576 generic.go:356] "Generic (PLEG): container finished" podID="649ecfc2-c40a-42c7-8265-d7222b74a67b" containerID="d5b1564c96442961d34c6d0f756d7d8c4c8a6ae3a15916f8ef01cab263d80b8d" exitCode=1
Jul 23 16:16:09.575713 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.575688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9" event={"ID":"649ecfc2-c40a-42c7-8265-d7222b74a67b","Type":"ContainerStarted","Data":"d48b3cf9bf559d7fa267871a562bbcc95a0ae2f1ef618aa350f5929b58768a1f"}
Jul 23 16:16:09.575806 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.575748    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9" event={"ID":"649ecfc2-c40a-42c7-8265-d7222b74a67b","Type":"ContainerStarted","Data":"d3e037f016524561862d3323082ce1e67bb5166a0efca34da44ca71c1fb902d1"}
Jul 23 16:16:09.575806 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.575796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9" event={"ID":"649ecfc2-c40a-42c7-8265-d7222b74a67b","Type":"ContainerStarted","Data":"dc05fa15497074e2ab15557199e7a7905c35ffabe603fa37f51428fe6e201e3f"}
Jul 23 16:16:09.575906 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.575826    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9" event={"ID":"649ecfc2-c40a-42c7-8265-d7222b74a67b","Type":"ContainerStarted","Data":"9baa5d84a316a1d0674aa812e64521873acbb71b4d1f2009dfbdf9e8bf414ab3"}
Jul 23 16:16:09.575906 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.575856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9" event={"ID":"649ecfc2-c40a-42c7-8265-d7222b74a67b","Type":"ContainerDied","Data":"d5b1564c96442961d34c6d0f756d7d8c4c8a6ae3a15916f8ef01cab263d80b8d"}
Jul 23 16:16:09.575906 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.575889    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9" event={"ID":"649ecfc2-c40a-42c7-8265-d7222b74a67b","Type":"ContainerStarted","Data":"9da7da5ce34ab9124143a5b4704accf7900b8d5f4558464ab1171a7497a860b6"}
Jul 23 16:16:09.580154 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.580114    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bgmjs" podStartSLOduration=4.446837298 podStartE2EDuration="23.580100817s" totalImagesPullingTime="19.133263519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:08.606244925 +0000 UTC m=+22.684672815" watchObservedRunningTime="2026-07-23 16:16:09.580100817 +0000 UTC m=+23.658528708"
Jul 23 16:16:09.594853 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.594798    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hbbf4" podStartSLOduration=16.990499406 podStartE2EDuration="23.594777522s" totalImagesPullingTime="6.604278116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:09.579928731 +0000 UTC m=+23.658356623" watchObservedRunningTime="2026-07-23 16:16:09.594777522 +0000 UTC m=+23.673205413"
Jul 23 16:16:09.637085 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.637016    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ftmhx" podStartSLOduration=4.531246305 podStartE2EDuration="23.636988996s" totalImagesPullingTime="19.105742691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:09.636929999 +0000 UTC m=+23.715357927" watchObservedRunningTime="2026-07-23 16:16:09.636988996 +0000 UTC m=+23.715416887"
Jul 23 16:16:09.654205 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.654156    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cpnbc" podStartSLOduration=4.54729083 podStartE2EDuration="23.654139732s" totalImagesPullingTime="19.106848902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:09.653844736 +0000 UTC m=+23.732272648" watchObservedRunningTime="2026-07-23 16:16:09.654139732 +0000 UTC m=+23.732567623"
Jul 23 16:16:09.669697 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.669648    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kl24z" podStartSLOduration=4.509667875 podStartE2EDuration="23.669632062s" totalImagesPullingTime="19.159964187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:09.669531694 +0000 UTC m=+23.747959605" watchObservedRunningTime="2026-07-23 16:16:09.669632062 +0000 UTC m=+23.748059953"
Jul 23 16:16:09.706306 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.706267    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:09.836675 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.836567    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:09.910217 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.910177    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:09.982378 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:09.982340    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:10.084065 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:10.084037    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:10.184484 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:10.184405    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:10.336384 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:10.336349    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:10.486269 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:10.486183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:10.486269 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:10.486210    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:10.486495 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:10.486183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:10.486495 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:10.486316    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:10.486495 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:10.486387    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:10.486495 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:10.486441    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:10.507323 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:10.507293    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kl24z_2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8/dns-node-resolver/0.log"
Jul 23 16:16:10.579898 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:10.579857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal" event={"ID":"d945213242aadc6d4443305d1366e62a","Type":"ContainerStarted","Data":"82b639cba963fefa50829e7f6e4f0d1240d258e505532eef3f45bee06821aa65"}
Jul 23 16:16:10.597656 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:10.597601    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-199.ec2.internal" podStartSLOduration=22.597580732 podStartE2EDuration="22.597580732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:10.597268004 +0000 UTC m=+24.675695893" watchObservedRunningTime="2026-07-23 16:16:10.597580732 +0000 UTC m=+24.676008629"
Jul 23 16:16:11.416432 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:11.416395    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:11.508183 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:11.508154    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hbbf4_c5760df7-1880-4919-b43c-47398f52a1f7/node-ca/0.log"
Jul 23 16:16:11.519768 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:11.519733    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:11.585281 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:11.585264    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:16:11.585741 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:11.585718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9" event={"ID":"649ecfc2-c40a-42c7-8265-d7222b74a67b","Type":"ContainerStarted","Data":"691bcc501ea5593d1a4dfcdceea0c4be41694eabb4bec206a959a7aa8dfdb011"}
Jul 23 16:16:11.600447 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:11.600265    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 16:16:11.618275 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:11.618241    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:11.680874 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:11.680825    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:11.981792 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:11.981702    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:12.093304 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:12.093267    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:12.379118 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:12.378962    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T16:16:11.60044005Z","UUID":"6c7082b0-744a-42ec-acca-eb34634952af","Handler":null,"Name":"","Endpoint":""}
Jul 23 16:16:12.381005 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:12.380979    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 16:16:12.381005 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:12.381022    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 16:16:12.486201 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:12.486169    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:12.486371 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:12.486311    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:12.486752 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:12.486727    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:12.486874 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:12.486831    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:12.486946 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:12.486931    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:12.487039 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:12.487011    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:12.590129 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:12.590089    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x" event={"ID":"449ec165-45d2-4c9e-a3dc-7d07b7768882","Type":"ContainerStarted","Data":"25321048bcc87417545079719d238d9e77e3c8db38de39c3cb5f2bb9d48e5cbc"}
Jul 23 16:16:12.798417 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:12.798339    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:13.306125 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:13.306088    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ftmhx"
Jul 23 16:16:13.306831 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:13.306804    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ftmhx"
Jul 23 16:16:13.675136 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:13.675030    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:13.771187 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:13.771143    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:14.013878 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.013788    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:14.122668 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.122631    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:14.213386 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.213355    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:14.331603 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.331569    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ftmhx"
Jul 23 16:16:14.332945 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.332742    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ftmhx"
Jul 23 16:16:14.359271 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.359173    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:14.486233 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.486062    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:14.486399 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.486075    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:14.486399 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:14.486322    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:14.486529 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:14.486428    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:14.486529 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.486134    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:14.486634 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:14.486571    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:14.596581 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.596453    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ef77fd7-fb93-4940-b1f6-03591148fb4f" containerID="86c96674ba63e25a7e7f2220dbb0884a93d7042bc2132694983487eb4b40baf9" exitCode=0
Jul 23 16:16:14.596581 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.596548    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnhfg" event={"ID":"8ef77fd7-fb93-4940-b1f6-03591148fb4f","Type":"ContainerDied","Data":"86c96674ba63e25a7e7f2220dbb0884a93d7042bc2132694983487eb4b40baf9"}
Jul 23 16:16:14.600110 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.600085    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:16:14.600500 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.600479    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9" event={"ID":"649ecfc2-c40a-42c7-8265-d7222b74a67b","Type":"ContainerStarted","Data":"37f9fffeb733367f8adfa0efbbefbca814173cc95c38c926f655b1d68eeabd58"}
Jul 23 16:16:14.600751 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.600734    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:16:14.600937 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.600922    2576 scope.go:117] "RemoveContainer" containerID="d5b1564c96442961d34c6d0f756d7d8c4c8a6ae3a15916f8ef01cab263d80b8d"
Jul 23 16:16:14.603425 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.603397    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x" event={"ID":"449ec165-45d2-4c9e-a3dc-7d07b7768882","Type":"ContainerStarted","Data":"09bbf5749abfa463d8e1416a5956055f7b48eff1dfdb7381a360961f155a725d"}
Jul 23 16:16:14.617209 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.617187    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:16:14.658119 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:14.658063    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7l5x" podStartSLOduration=4.11603605 podStartE2EDuration="28.658043685s" totalImagesPullingTime="24.542007635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:14.657935127 +0000 UTC m=+28.736363046" watchObservedRunningTime="2026-07-23 16:16:14.658043685 +0000 UTC m=+28.736471577"
Jul 23 16:16:15.337715 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:15.337680    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:15.553901 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:15.553821    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:15.609376 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:15.609355    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:16:15.609780 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:15.609750    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9" event={"ID":"649ecfc2-c40a-42c7-8265-d7222b74a67b","Type":"ContainerStarted","Data":"2a99cbc18e431c01e01f1340e680ddf25ebde8d6cc6be69bf81315ad03b2c481"}
Jul 23 16:16:15.610265 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:15.610244    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:16:15.610380 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:15.610330    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:16:15.630995 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:15.630973    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:16:15.640259 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:15.640136    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9" podStartSLOduration=9.671323319 podStartE2EDuration="29.640111939s" totalImagesPullingTime="19.96878862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:15.639361013 +0000 UTC m=+29.717788910" watchObservedRunningTime="2026-07-23 16:16:15.640111939 +0000 UTC m=+29.718539831"
Jul 23 16:16:15.753109 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:15.753081    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:15.949927 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:15.949840    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:16.151751 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:16.151723    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:16.357472 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:16.357386    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:16.487321 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:16.487281    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:16.487575 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:16.487376    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:16.487575 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:16.487385    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:16.487575 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:16.487412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:16.487575 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:16.487458    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:16.487575 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:16.487553    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:16.614581 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:16.614480    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ef77fd7-fb93-4940-b1f6-03591148fb4f" containerID="0b758de2bd69da4d381ffe803945aaf1d6cfaf0447a9550076e394eea45504f5" exitCode=0
Jul 23 16:16:16.614581 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:16.614548    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnhfg" event={"ID":"8ef77fd7-fb93-4940-b1f6-03591148fb4f","Type":"ContainerDied","Data":"0b758de2bd69da4d381ffe803945aaf1d6cfaf0447a9550076e394eea45504f5"}
Jul 23 16:16:16.964107 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:16.964013    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:17.068421 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:17.068386    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:17.371113 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:17.371035    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:17.697902 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:17.697826    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:17.955702 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:17.955617    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:18.486703 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:18.486672    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:18.487064 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:18.486674    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:18.487064 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:18.486783    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:18.487064 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:18.486683    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:18.487064 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:18.486863    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:18.487064 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:18.486950    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:18.553650 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:18.553616    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:18.621791 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:18.621752    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ef77fd7-fb93-4940-b1f6-03591148fb4f" containerID="a06737f69d6445f572db8ca5fee1f326110a4f2cff3e8cff6ef8a61b179f07a3" exitCode=0
Jul 23 16:16:18.621955 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:18.621816    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnhfg" event={"ID":"8ef77fd7-fb93-4940-b1f6-03591148fb4f","Type":"ContainerDied","Data":"a06737f69d6445f572db8ca5fee1f326110a4f2cff3e8cff6ef8a61b179f07a3"}
Jul 23 16:16:18.646085 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:18.646052    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:18.755727 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:18.755624    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:18.986067 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:18.986038    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:19.209841 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:19.209765    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:19.976769 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:19.976723    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:20.066886 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:20.066841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:20.067062 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:20.066927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs\") pod \"network-metrics-daemon-5nt52\" (UID: \"e3d8907c-035c-46a6-83b3-7ad53449bc36\") " pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:20.067062 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:20.067011    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:16:20.067062 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:20.067028    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:16:20.067210 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:20.067093    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret podName:3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:52.067070867 +0000 UTC m=+66.145498739 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret") pod "global-pull-secret-syncer-lrbgb" (UID: "3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:16:20.067210 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:20.067115    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs podName:e3d8907c-035c-46a6-83b3-7ad53449bc36 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:52.067104473 +0000 UTC m=+66.145532347 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs") pod "network-metrics-daemon-5nt52" (UID: "e3d8907c-035c-46a6-83b3-7ad53449bc36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:16:20.167588 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:20.167545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djmgn\" (UniqueName: \"kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn\") pod \"network-check-target-l4cw7\" (UID: \"f4e3834e-afc5-440d-bc07-f2f6a20c03fe\") " pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:20.167771 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:20.167691    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:16:20.167771 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:20.167714    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:16:20.167771 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:20.167727    2576 projected.go:196] Error preparing data for projected volume kube-api-access-djmgn for pod openshift-network-diagnostics/network-check-target-l4cw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:16:20.167933 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:20.167795    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn podName:f4e3834e-afc5-440d-bc07-f2f6a20c03fe nodeName:}" failed. No retries permitted until 2026-07-23 16:16:52.167774725 +0000 UTC m=+66.246202609 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-djmgn" (UniqueName: "kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn") pod "network-check-target-l4cw7" (UID: "f4e3834e-afc5-440d-bc07-f2f6a20c03fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:16:20.423654 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:20.423366    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:20.486502 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:20.486469    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:20.486502 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:20.486469    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:20.486502 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:20.486522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:20.486764 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:20.486651    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:20.486764 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:20.486720    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:20.486854 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:20.486801    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:20.552195 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:20.552160    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:21.305918 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:21.305880    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:21.409841 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:21.409796    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:21.752615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:21.752537    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:21.951966 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:21.951935    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:22.154402 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:22.154320    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:22.486566 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:22.486481    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:22.486566 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:22.486481    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:22.487192 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:22.486647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:22.487192 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:22.486654    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:22.487192 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:22.486782    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:22.487192 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:22.486847    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:22.569220 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:22.569186    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:22.670496 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:22.670459    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:22.770521 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:22.770427    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:22.871148 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:22.871112    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:23.158672 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:23.158649    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:23.260573 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:23.260538    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:23.367721 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:23.367687    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:23.630944 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:23.630858    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:23.636871 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:23.636843    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ef77fd7-fb93-4940-b1f6-03591148fb4f" containerID="79274896ad6f7b8aefeecdb5874719a33ea4f7ed696abcc5b3324853228ce9a6" exitCode=0
Jul 23 16:16:23.637030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:23.636901    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnhfg" event={"ID":"8ef77fd7-fb93-4940-b1f6-03591148fb4f","Type":"ContainerDied","Data":"79274896ad6f7b8aefeecdb5874719a33ea4f7ed696abcc5b3324853228ce9a6"}
Jul 23 16:16:23.732593 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:23.732502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:23.833744 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:23.833714    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:24.486818 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:24.486780    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:24.487018 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:24.486780    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:24.487018 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:24.486905    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:24.487095 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:24.487012    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:24.487095 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:24.487047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:24.487156 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:24.487119    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:24.641810 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:24.641774    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ef77fd7-fb93-4940-b1f6-03591148fb4f" containerID="2c69809b4236aca00833317be62f8c3d92a63ec8138da6aa9417d7f161439f32" exitCode=0
Jul 23 16:16:24.642245 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:24.641860    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnhfg" event={"ID":"8ef77fd7-fb93-4940-b1f6-03591148fb4f","Type":"ContainerDied","Data":"2c69809b4236aca00833317be62f8c3d92a63ec8138da6aa9417d7f161439f32"}
Jul 23 16:16:24.814709 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:24.814662    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:24.917310 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:24.917279    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:25.647418 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:25.647384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnhfg" event={"ID":"8ef77fd7-fb93-4940-b1f6-03591148fb4f","Type":"ContainerStarted","Data":"0c34166697e4b67f3c59117be13b25936eabf407cc1573fa3a0a1ca18d5d486b"}
Jul 23 16:16:25.656688 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:25.656651    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:25.669331 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:25.669291    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cnhfg" podStartSLOduration=9.212718831 podStartE2EDuration="39.669274335s" totalImagesPullingTime="30.456555504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:25.668787596 +0000 UTC m=+39.747215486" watchObservedRunningTime="2026-07-23 16:16:25.669274335 +0000 UTC m=+39.747702226"
Jul 23 16:16:25.715889 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:25.715857    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:26.487124 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:26.487085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:26.487293 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:26.487162    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:26.487293 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:26.487172    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:26.487293 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:26.487276    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:26.487394 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:26.487320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:26.487394 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:26.487370    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:27.055744 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:27.055709    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:27.149153 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:27.149094    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:28.486373 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:28.486336    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:28.486373 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:28.486371    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:28.486908 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:28.486344    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:28.486908 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:28.486467    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:28.486908 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:28.486554    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:28.486908 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:28.486629    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:30.477782 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:30.477750    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:30.486811 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:30.486785    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:30.486928 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:30.486820    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:30.486928 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:30.486790    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:30.486928 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:30.486906    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:30.487089 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:30.487014    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:30.487145 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:30.487108    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:30.705304 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:30.705266    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:30.864791 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:30.864695    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:31.703762 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:31.703711    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lrbgb"]
Jul 23 16:16:31.704774 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:31.704754    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l4cw7"]
Jul 23 16:16:31.704891 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:31.704867    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:31.705030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:31.705006    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5nt52"]
Jul 23 16:16:31.705124 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:31.704943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:31.705124 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:31.705078    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:31.705237 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:31.705176    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:31.705288 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:31.705169    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:31.705345 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:31.705287    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:33.487169 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:33.486989    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:33.487654 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:33.487014    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:33.487654 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:33.487253    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:33.487654 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:33.487032    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:33.487654 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:33.487311    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:33.487654 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:33.487388    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:35.486389 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.486354    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:35.486389 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.486377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:35.486824 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.486354    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:35.486824 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:35.486473    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5nt52" podUID="e3d8907c-035c-46a6-83b3-7ad53449bc36"
Jul 23 16:16:35.486824 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:35.486539    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4cw7" podUID="f4e3834e-afc5-440d-bc07-f2f6a20c03fe"
Jul 23 16:16:35.486824 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:35.486597    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrbgb" podUID="3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7"
Jul 23 16:16:35.762001 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.761920    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-199.ec2.internal" event="NodeReady"
Jul 23 16:16:35.762169 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.762054    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 16:16:35.799501 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.799464    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6996878896-wlsfx"]
Jul 23 16:16:35.812458 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.812428    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:35.815604 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.815581    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 16:16:35.815760 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.815608    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cvkcr\""
Jul 23 16:16:35.815760 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.815672    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 16:16:35.815760 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.815720    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 16:16:35.822344 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.822311    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6996878896-wlsfx"]
Jul 23 16:16:35.824967 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.824947    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 16:16:35.826135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.826116    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fxvqj"]
Jul 23 16:16:35.838342 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.838320    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h9nrn"]
Jul 23 16:16:35.838447 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.838435    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fxvqj"
Jul 23 16:16:35.841266 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.840646    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pldcw\""
Jul 23 16:16:35.841266 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.840668    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 16:16:35.841266 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.841025    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 16:16:35.841266 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.841145    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 16:16:35.849260 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.849240    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fxvqj"]
Jul 23 16:16:35.849354 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.849275    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h9nrn"]
Jul 23 16:16:35.849354 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.849340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:35.851131 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.851107    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 16:16:35.851131 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.851130    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 16:16:35.851297 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.851167    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 16:16:35.851297 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.851201    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 16:16:35.851448 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.851425    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tj2lp\""
Jul 23 16:16:35.914579 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.914549    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m7lrs"]
Jul 23 16:16:35.930862 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.930825    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m7lrs"]
Jul 23 16:16:35.931018 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.930959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:35.933007 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.932987    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-khnm5\""
Jul 23 16:16:35.933145 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.933053    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 16:16:35.933145 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.933107    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 16:16:35.973295 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.973265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c-cert\") pod \"ingress-canary-fxvqj\" (UID: \"3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c\") " pod="openshift-ingress-canary/ingress-canary-fxvqj"
Jul 23 16:16:35.973295 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.973304    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce2b5089-9751-4142-b70c-729502337dd6-trusted-ca\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:35.973573 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.973335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2170c531-389a-47f3-ad79-7a1ae1c90a7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:35.976423 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.973762    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4djk\" (UniqueName: \"kubernetes.io/projected/2170c531-389a-47f3-ad79-7a1ae1c90a7b-kube-api-access-r4djk\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:35.976423 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.973894    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce2b5089-9751-4142-b70c-729502337dd6-bound-sa-token\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:35.976423 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.973950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2170c531-389a-47f3-ad79-7a1ae1c90a7b-crio-socket\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:35.976423 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.973987    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce2b5089-9751-4142-b70c-729502337dd6-registry-certificates\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:35.976423 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.974073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6llt\" (UniqueName: \"kubernetes.io/projected/3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c-kube-api-access-x6llt\") pod \"ingress-canary-fxvqj\" (UID: \"3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c\") " pod="openshift-ingress-canary/ingress-canary-fxvqj"
Jul 23 16:16:35.976423 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.974105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce2b5089-9751-4142-b70c-729502337dd6-registry-tls\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:35.976423 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.974136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce2b5089-9751-4142-b70c-729502337dd6-image-registry-private-configuration\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:35.976423 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.974198    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2170c531-389a-47f3-ad79-7a1ae1c90a7b-data-volume\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:35.976423 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.974233    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce2b5089-9751-4142-b70c-729502337dd6-installation-pull-secrets\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:35.976423 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.974265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2170c531-389a-47f3-ad79-7a1ae1c90a7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:35.976423 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.974301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce2b5089-9751-4142-b70c-729502337dd6-ca-trust-extracted\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:35.976423 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:35.974327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hvft\" (UniqueName: \"kubernetes.io/projected/ce2b5089-9751-4142-b70c-729502337dd6-kube-api-access-4hvft\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.055103 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.054992    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:36.075329 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c-cert\") pod \"ingress-canary-fxvqj\" (UID: \"3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c\") " pod="openshift-ingress-canary/ingress-canary-fxvqj"
Jul 23 16:16:36.075464 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075334    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/673eeaec-efbd-4189-a3e5-b64a585f39c8-metrics-tls\") pod \"dns-default-m7lrs\" (UID: \"673eeaec-efbd-4189-a3e5-b64a585f39c8\") " pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:36.075464 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl56c\" (UniqueName: \"kubernetes.io/projected/673eeaec-efbd-4189-a3e5-b64a585f39c8-kube-api-access-sl56c\") pod \"dns-default-m7lrs\" (UID: \"673eeaec-efbd-4189-a3e5-b64a585f39c8\") " pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:36.075464 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075454    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce2b5089-9751-4142-b70c-729502337dd6-trusted-ca\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.075611 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2170c531-389a-47f3-ad79-7a1ae1c90a7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:36.075611 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4djk\" (UniqueName: \"kubernetes.io/projected/2170c531-389a-47f3-ad79-7a1ae1c90a7b-kube-api-access-r4djk\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:36.075611 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075580    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce2b5089-9751-4142-b70c-729502337dd6-bound-sa-token\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.075611 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2170c531-389a-47f3-ad79-7a1ae1c90a7b-crio-socket\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:36.075787 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce2b5089-9751-4142-b70c-729502337dd6-registry-certificates\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.075787 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/673eeaec-efbd-4189-a3e5-b64a585f39c8-config-volume\") pod \"dns-default-m7lrs\" (UID: \"673eeaec-efbd-4189-a3e5-b64a585f39c8\") " pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:36.075787 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/673eeaec-efbd-4189-a3e5-b64a585f39c8-tmp-dir\") pod \"dns-default-m7lrs\" (UID: \"673eeaec-efbd-4189-a3e5-b64a585f39c8\") " pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:36.075787 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075712    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6llt\" (UniqueName: \"kubernetes.io/projected/3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c-kube-api-access-x6llt\") pod \"ingress-canary-fxvqj\" (UID: \"3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c\") " pod="openshift-ingress-canary/ingress-canary-fxvqj"
Jul 23 16:16:36.075949 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075809    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2170c531-389a-47f3-ad79-7a1ae1c90a7b-crio-socket\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:36.075949 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce2b5089-9751-4142-b70c-729502337dd6-registry-tls\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.076052 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.075991    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce2b5089-9751-4142-b70c-729502337dd6-image-registry-private-configuration\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.076052 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.076033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2170c531-389a-47f3-ad79-7a1ae1c90a7b-data-volume\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:36.076155 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.076063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce2b5089-9751-4142-b70c-729502337dd6-installation-pull-secrets\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.076251 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.076224    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2170c531-389a-47f3-ad79-7a1ae1c90a7b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:36.076441 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.076388    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2170c531-389a-47f3-ad79-7a1ae1c90a7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:36.076594 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.076572    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce2b5089-9751-4142-b70c-729502337dd6-registry-certificates\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.076671 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.076533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2170c531-389a-47f3-ad79-7a1ae1c90a7b-data-volume\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:36.076753 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.076735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce2b5089-9751-4142-b70c-729502337dd6-ca-trust-extracted\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.076841 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.076820    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce2b5089-9751-4142-b70c-729502337dd6-trusted-ca\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.076905 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.076835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hvft\" (UniqueName: \"kubernetes.io/projected/ce2b5089-9751-4142-b70c-729502337dd6-kube-api-access-4hvft\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.077019 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.076987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce2b5089-9751-4142-b70c-729502337dd6-ca-trust-extracted\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.080127 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.080103    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce2b5089-9751-4142-b70c-729502337dd6-image-registry-private-configuration\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.080228 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.080139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce2b5089-9751-4142-b70c-729502337dd6-installation-pull-secrets\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.080228 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.080203    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c-cert\") pod \"ingress-canary-fxvqj\" (UID: \"3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c\") " pod="openshift-ingress-canary/ingress-canary-fxvqj"
Jul 23 16:16:36.080301 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.080229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce2b5089-9751-4142-b70c-729502337dd6-registry-tls\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.080424 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.080408    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2170c531-389a-47f3-ad79-7a1ae1c90a7b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:36.083144 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.083123    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4djk\" (UniqueName: \"kubernetes.io/projected/2170c531-389a-47f3-ad79-7a1ae1c90a7b-kube-api-access-r4djk\") pod \"insights-runtime-extractor-h9nrn\" (UID: \"2170c531-389a-47f3-ad79-7a1ae1c90a7b\") " pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:36.083532 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.083493    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6llt\" (UniqueName: \"kubernetes.io/projected/3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c-kube-api-access-x6llt\") pod \"ingress-canary-fxvqj\" (UID: \"3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c\") " pod="openshift-ingress-canary/ingress-canary-fxvqj"
Jul 23 16:16:36.092968 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.092940    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce2b5089-9751-4142-b70c-729502337dd6-bound-sa-token\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.093118 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.093094    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hvft\" (UniqueName: \"kubernetes.io/projected/ce2b5089-9751-4142-b70c-729502337dd6-kube-api-access-4hvft\") pod \"image-registry-6996878896-wlsfx\" (UID: \"ce2b5089-9751-4142-b70c-729502337dd6\") " pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.117526 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.117485    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:36.122334 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.122317    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.149207 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.149183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fxvqj"
Jul 23 16:16:36.157378 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.157347    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h9nrn"
Jul 23 16:16:36.178220 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.178185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/673eeaec-efbd-4189-a3e5-b64a585f39c8-config-volume\") pod \"dns-default-m7lrs\" (UID: \"673eeaec-efbd-4189-a3e5-b64a585f39c8\") " pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:36.178367 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.178232    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/673eeaec-efbd-4189-a3e5-b64a585f39c8-tmp-dir\") pod \"dns-default-m7lrs\" (UID: \"673eeaec-efbd-4189-a3e5-b64a585f39c8\") " pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:36.178367 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.178301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/673eeaec-efbd-4189-a3e5-b64a585f39c8-metrics-tls\") pod \"dns-default-m7lrs\" (UID: \"673eeaec-efbd-4189-a3e5-b64a585f39c8\") " pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:36.178367 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.178326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl56c\" (UniqueName: \"kubernetes.io/projected/673eeaec-efbd-4189-a3e5-b64a585f39c8-kube-api-access-sl56c\") pod \"dns-default-m7lrs\" (UID: \"673eeaec-efbd-4189-a3e5-b64a585f39c8\") " pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:36.178662 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.178638    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/673eeaec-efbd-4189-a3e5-b64a585f39c8-tmp-dir\") pod \"dns-default-m7lrs\" (UID: \"673eeaec-efbd-4189-a3e5-b64a585f39c8\") " pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:36.178776 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.178745    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/673eeaec-efbd-4189-a3e5-b64a585f39c8-config-volume\") pod \"dns-default-m7lrs\" (UID: \"673eeaec-efbd-4189-a3e5-b64a585f39c8\") " pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:36.181362 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.181343    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/673eeaec-efbd-4189-a3e5-b64a585f39c8-metrics-tls\") pod \"dns-default-m7lrs\" (UID: \"673eeaec-efbd-4189-a3e5-b64a585f39c8\") " pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:36.192988 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.192961    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl56c\" (UniqueName: \"kubernetes.io/projected/673eeaec-efbd-4189-a3e5-b64a585f39c8-kube-api-access-sl56c\") pod \"dns-default-m7lrs\" (UID: \"673eeaec-efbd-4189-a3e5-b64a585f39c8\") " pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:36.240716 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.240383    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:36.328096 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.328059    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6996878896-wlsfx"]
Jul 23 16:16:36.329030 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.328972    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fxvqj"]
Jul 23 16:16:36.333744 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:16:36.333709    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5980c4_c5f1_40a9_a0ee_9cadabb68d0c.slice/crio-98f112634b9a5b5852c106dd69242eaf5130ea2442d2e01c01ba61c0efb07516 WatchSource:0}: Error finding container 98f112634b9a5b5852c106dd69242eaf5130ea2442d2e01c01ba61c0efb07516: Status 404 returned error can't find the container with id 98f112634b9a5b5852c106dd69242eaf5130ea2442d2e01c01ba61c0efb07516
Jul 23 16:16:36.334612 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:16:36.334582    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce2b5089_9751_4142_b70c_729502337dd6.slice/crio-08d3c7a39f270b3d1922c4f1f8b18924072d72abb82365dcd309dfccc6842233 WatchSource:0}: Error finding container 08d3c7a39f270b3d1922c4f1f8b18924072d72abb82365dcd309dfccc6842233: Status 404 returned error can't find the container with id 08d3c7a39f270b3d1922c4f1f8b18924072d72abb82365dcd309dfccc6842233
Jul 23 16:16:36.336843 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.336757    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h9nrn"]
Jul 23 16:16:36.342809 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:16:36.342785    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2170c531_389a_47f3_ad79_7a1ae1c90a7b.slice/crio-366aec9722f5dc383b034477eb62fb0f6fcd95b96cd656d0c9533c5f41766518 WatchSource:0}: Error finding container 366aec9722f5dc383b034477eb62fb0f6fcd95b96cd656d0c9533c5f41766518: Status 404 returned error can't find the container with id 366aec9722f5dc383b034477eb62fb0f6fcd95b96cd656d0c9533c5f41766518
Jul 23 16:16:36.413489 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.413321    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m7lrs"]
Jul 23 16:16:36.416402 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:16:36.416368    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod673eeaec_efbd_4189_a3e5_b64a585f39c8.slice/crio-f89752db102fe452e86ce7abdf9d3bfc8c5c8ff7fafa961051d505c717392dd2 WatchSource:0}: Error finding container f89752db102fe452e86ce7abdf9d3bfc8c5c8ff7fafa961051d505c717392dd2: Status 404 returned error can't find the container with id f89752db102fe452e86ce7abdf9d3bfc8c5c8ff7fafa961051d505c717392dd2
Jul 23 16:16:36.673241 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.673209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h9nrn" event={"ID":"2170c531-389a-47f3-ad79-7a1ae1c90a7b","Type":"ContainerStarted","Data":"366aec9722f5dc383b034477eb62fb0f6fcd95b96cd656d0c9533c5f41766518"}
Jul 23 16:16:36.674419 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.674393    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fxvqj" event={"ID":"3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c","Type":"ContainerStarted","Data":"98f112634b9a5b5852c106dd69242eaf5130ea2442d2e01c01ba61c0efb07516"}
Jul 23 16:16:36.675854 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.675830    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6996878896-wlsfx" event={"ID":"ce2b5089-9751-4142-b70c-729502337dd6","Type":"ContainerStarted","Data":"63e93c477551bf32bde145f31152fa80a749fe764d097d193b4a9c0acb7f2c92"}
Jul 23 16:16:36.675962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.675874    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6996878896-wlsfx" event={"ID":"ce2b5089-9751-4142-b70c-729502337dd6","Type":"ContainerStarted","Data":"08d3c7a39f270b3d1922c4f1f8b18924072d72abb82365dcd309dfccc6842233"}
Jul 23 16:16:36.675962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.675943    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:36.677001 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.676982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7lrs" event={"ID":"673eeaec-efbd-4189-a3e5-b64a585f39c8","Type":"ContainerStarted","Data":"f89752db102fe452e86ce7abdf9d3bfc8c5c8ff7fafa961051d505c717392dd2"}
Jul 23 16:16:36.693625 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:36.693580    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6996878896-wlsfx" podStartSLOduration=6.693565026 podStartE2EDuration="6.693565026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:36.692940195 +0000 UTC m=+50.771368086" watchObservedRunningTime="2026-07-23 16:16:36.693565026 +0000 UTC m=+50.771992927"
Jul 23 16:16:37.486586 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:37.486548    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:37.486586 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:37.486582    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:37.487010 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:37.486989    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:37.489662 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:37.489405    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 16:16:37.489662 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:37.489425    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 16:16:37.489662 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:37.489463    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 16:16:37.489662 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:37.489543    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cwhlx\""
Jul 23 16:16:37.489662 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:37.489425    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4khjt\""
Jul 23 16:16:37.489962 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:37.489711    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 16:16:38.685583 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:38.685460    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7lrs" event={"ID":"673eeaec-efbd-4189-a3e5-b64a585f39c8","Type":"ContainerStarted","Data":"293734d6a80fbbced808682a9252da67671849c648a3458ce9b3870524427847"}
Jul 23 16:16:38.685583 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:38.685545    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7lrs" event={"ID":"673eeaec-efbd-4189-a3e5-b64a585f39c8","Type":"ContainerStarted","Data":"dc690e821762c9cc23be2ff422c7a5037fada42ca12bf97cb2b701e0928e81bd"}
Jul 23 16:16:38.686560 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:38.685766    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:38.702361 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:38.702082    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m7lrs" podStartSLOduration=1.873562911 podStartE2EDuration="3.702059206s" totalImagesPullingTime="1.828496295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:38.700708684 +0000 UTC m=+52.779136579" watchObservedRunningTime="2026-07-23 16:16:38.702059206 +0000 UTC m=+52.780487098"
Jul 23 16:16:39.561611 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:39.561573    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:39.749076 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:39.749037    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:39.849952 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:39.849854    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:39.967586 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:39.967368    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:40.224033 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:40.223997    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:40.283621 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:40.283586    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:41.211281 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:41.211240    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:41.277786 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:41.277758    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:42.703451 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:42.703417    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h9nrn" event={"ID":"2170c531-389a-47f3-ad79-7a1ae1c90a7b","Type":"ContainerStarted","Data":"d8ad1455178eeeaf20f02c2d81a96a59738c0e758936df5219eca779c09129e2"}
Jul 23 16:16:42.704953 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:42.704902    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fxvqj" event={"ID":"3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c","Type":"ContainerStarted","Data":"d78d68eb7b4da81b23c056fd5aa1ed48dc250baf4b8f1b685a04e6c784467d17"}
Jul 23 16:16:42.721227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:42.721173    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fxvqj" podStartSLOduration=1.690965322 podStartE2EDuration="7.721155768s" totalImagesPullingTime="6.030190446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:42.720222938 +0000 UTC m=+56.798650829" watchObservedRunningTime="2026-07-23 16:16:42.721155768 +0000 UTC m=+56.799583636"
Jul 23 16:16:44.240559 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:44.240517    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:44.300019 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:44.299979    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:46.081754 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.081668    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:46.721613 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.721570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h9nrn" event={"ID":"2170c531-389a-47f3-ad79-7a1ae1c90a7b","Type":"ContainerStarted","Data":"5ad6e86d3aaf3901584ebe7a4b2e5f1a3a19c68c0786d961016abb55d7aabc1f"}
Jul 23 16:16:46.772499 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.772270    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"]
Jul 23 16:16:46.774841 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.774814    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:46.776880 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.776854    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 23 16:16:46.777651 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.777623    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 16:16:46.777651 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.777623    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 16:16:46.777847 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.777652    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xlqdc\""
Jul 23 16:16:46.777847 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.777694    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 16:16:46.777847 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.777624    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 23 16:16:46.785174 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.785149    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"]
Jul 23 16:16:46.875236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.875193    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/556dfb4f-2f1b-4664-82bf-079b609d103a-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-s8hcj\" (UID: \"556dfb4f-2f1b-4664-82bf-079b609d103a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:46.875236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.875241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/556dfb4f-2f1b-4664-82bf-079b609d103a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-s8hcj\" (UID: \"556dfb4f-2f1b-4664-82bf-079b609d103a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:46.875478 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.875261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/556dfb4f-2f1b-4664-82bf-079b609d103a-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-s8hcj\" (UID: \"556dfb4f-2f1b-4664-82bf-079b609d103a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:46.875478 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.875281    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9w9l\" (UniqueName: \"kubernetes.io/projected/556dfb4f-2f1b-4664-82bf-079b609d103a-kube-api-access-v9w9l\") pod \"prometheus-operator-5945b5cfd-s8hcj\" (UID: \"556dfb4f-2f1b-4664-82bf-079b609d103a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:46.921444 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.921397    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:46.976674 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.976592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/556dfb4f-2f1b-4664-82bf-079b609d103a-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-s8hcj\" (UID: \"556dfb4f-2f1b-4664-82bf-079b609d103a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:46.976674 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.976638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/556dfb4f-2f1b-4664-82bf-079b609d103a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-s8hcj\" (UID: \"556dfb4f-2f1b-4664-82bf-079b609d103a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:46.976674 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.976662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/556dfb4f-2f1b-4664-82bf-079b609d103a-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-s8hcj\" (UID: \"556dfb4f-2f1b-4664-82bf-079b609d103a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:46.976959 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.976686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9w9l\" (UniqueName: \"kubernetes.io/projected/556dfb4f-2f1b-4664-82bf-079b609d103a-kube-api-access-v9w9l\") pod \"prometheus-operator-5945b5cfd-s8hcj\" (UID: \"556dfb4f-2f1b-4664-82bf-079b609d103a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:46.976959 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:46.976769    2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 23 16:16:46.976959 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:46.976845    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/556dfb4f-2f1b-4664-82bf-079b609d103a-prometheus-operator-tls podName:556dfb4f-2f1b-4664-82bf-079b609d103a nodeName:}" failed. No retries permitted until 2026-07-23 16:16:47.476822135 +0000 UTC m=+61.555250024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/556dfb4f-2f1b-4664-82bf-079b609d103a-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-s8hcj" (UID: "556dfb4f-2f1b-4664-82bf-079b609d103a") : secret "prometheus-operator-tls" not found
Jul 23 16:16:46.977435 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.977413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/556dfb4f-2f1b-4664-82bf-079b609d103a-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-s8hcj\" (UID: \"556dfb4f-2f1b-4664-82bf-079b609d103a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:46.980910 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.980854    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/556dfb4f-2f1b-4664-82bf-079b609d103a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-s8hcj\" (UID: \"556dfb4f-2f1b-4664-82bf-079b609d103a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:46.984935 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:46.984911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9w9l\" (UniqueName: \"kubernetes.io/projected/556dfb4f-2f1b-4664-82bf-079b609d103a-kube-api-access-v9w9l\") pod \"prometheus-operator-5945b5cfd-s8hcj\" (UID: \"556dfb4f-2f1b-4664-82bf-079b609d103a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:47.136444 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:47.136408    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:47.286139 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:47.286047    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:47.347855 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:47.347816    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:47.411892 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:47.411857    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:47.481601 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:47.481560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/556dfb4f-2f1b-4664-82bf-079b609d103a-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-s8hcj\" (UID: \"556dfb4f-2f1b-4664-82bf-079b609d103a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:47.484290 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:47.484243    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/556dfb4f-2f1b-4664-82bf-079b609d103a-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-s8hcj\" (UID: \"556dfb4f-2f1b-4664-82bf-079b609d103a\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:47.637975 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:47.637902    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ffs9"
Jul 23 16:16:47.685783 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:47.685756    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"
Jul 23 16:16:47.787359 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:47.787304    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:47.839882 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:47.839830    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj"]
Jul 23 16:16:47.843389 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:47.843357    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:48.690481 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:48.690448    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m7lrs"
Jul 23 16:16:48.848096 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:48.848045    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:48.930271 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:48.930229    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:49.547697 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:16:49.547665    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556dfb4f_2f1b_4664_82bf_079b609d103a.slice/crio-96ad7c00f4cd75a2b6526ffb5ce6f63036bfea92e9fd2b874c454c152241a51a WatchSource:0}: Error finding container 96ad7c00f4cd75a2b6526ffb5ce6f63036bfea92e9fd2b874c454c152241a51a: Status 404 returned error can't find the container with id 96ad7c00f4cd75a2b6526ffb5ce6f63036bfea92e9fd2b874c454c152241a51a
Jul 23 16:16:49.734539 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:49.734322    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h9nrn" event={"ID":"2170c531-389a-47f3-ad79-7a1ae1c90a7b","Type":"ContainerStarted","Data":"1c4505cf6f53291b0726199da6d3a249d354c8972d004ac0252c108a5350fe1f"}
Jul 23 16:16:49.738081 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:49.738048    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj" event={"ID":"556dfb4f-2f1b-4664-82bf-079b609d103a","Type":"ContainerStarted","Data":"96ad7c00f4cd75a2b6526ffb5ce6f63036bfea92e9fd2b874c454c152241a51a"}
Jul 23 16:16:49.751872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:49.751813    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h9nrn" podStartSLOduration=1.61890452 podStartE2EDuration="14.751794285s" totalImagesPullingTime="13.132889765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:16:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:49.751003858 +0000 UTC m=+63.829431749" watchObservedRunningTime="2026-07-23 16:16:49.751794285 +0000 UTC m=+63.830222178"
Jul 23 16:16:51.245743 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:51.245649    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:51.746407 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:51.746363    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj" event={"ID":"556dfb4f-2f1b-4664-82bf-079b609d103a","Type":"ContainerStarted","Data":"4f78cdfd1d13602b7ce6bc7da1a78203d99ba347216cfb19297267264976979e"}
Jul 23 16:16:51.746593 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:51.746418    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj" event={"ID":"556dfb4f-2f1b-4664-82bf-079b609d103a","Type":"ContainerStarted","Data":"25e555d7bd3eec5bef86a7a843ba96ce3dd6b5493d966d8035fdb50febe55b7f"}
Jul 23 16:16:51.763654 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:51.763591    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-s8hcj" podStartSLOduration=4.349340178 podStartE2EDuration="5.763574709s" totalImagesPullingTime="1.414234531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:51.762249795 +0000 UTC m=+65.840677685" watchObservedRunningTime="2026-07-23 16:16:51.763574709 +0000 UTC m=+65.842002597"
Jul 23 16:16:52.118914 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.118823    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs\") pod \"network-metrics-daemon-5nt52\" (UID: \"e3d8907c-035c-46a6-83b3-7ad53449bc36\") " pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:52.118914 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.118869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:52.121219 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.121200    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 16:16:52.121219 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.121214    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 16:16:52.132046 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.132013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7-original-pull-secret\") pod \"global-pull-secret-syncer-lrbgb\" (UID: \"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7\") " pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:52.132183 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.132075    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d8907c-035c-46a6-83b3-7ad53449bc36-metrics-certs\") pod \"network-metrics-daemon-5nt52\" (UID: \"e3d8907c-035c-46a6-83b3-7ad53449bc36\") " pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:52.216465 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.216428    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cwhlx\""
Jul 23 16:16:52.219532 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.219495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djmgn\" (UniqueName: \"kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn\") pod \"network-check-target-l4cw7\" (UID: \"f4e3834e-afc5-440d-bc07-f2f6a20c03fe\") " pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:52.220426 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.220408    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrbgb"
Jul 23 16:16:52.221282 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.221266    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 16:16:52.224698 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.224683    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5nt52"
Jul 23 16:16:52.232845 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.232819    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 16:16:52.244938 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.244906    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djmgn\" (UniqueName: \"kubernetes.io/projected/f4e3834e-afc5-440d-bc07-f2f6a20c03fe-kube-api-access-djmgn\") pod \"network-check-target-l4cw7\" (UID: \"f4e3834e-afc5-440d-bc07-f2f6a20c03fe\") " pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:52.359398 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.359365    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lrbgb"]
Jul 23 16:16:52.362838 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:16:52.362801    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e56bbd1_51ad_4f56_b2cf_a9b7e5256fc7.slice/crio-0e76d77a92af7d5164624dc743650ad291af313eeba742a235e5cc218389034d WatchSource:0}: Error finding container 0e76d77a92af7d5164624dc743650ad291af313eeba742a235e5cc218389034d: Status 404 returned error can't find the container with id 0e76d77a92af7d5164624dc743650ad291af313eeba742a235e5cc218389034d
Jul 23 16:16:52.374079 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.374016    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5nt52"]
Jul 23 16:16:52.377957 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:16:52.377930    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d8907c_035c_46a6_83b3_7ad53449bc36.slice/crio-787c729e46ebe1f39f2ed2c9c823883a837bb0324370b252ecb8e021a98a8487 WatchSource:0}: Error finding container 787c729e46ebe1f39f2ed2c9c823883a837bb0324370b252ecb8e021a98a8487: Status 404 returned error can't find the container with id 787c729e46ebe1f39f2ed2c9c823883a837bb0324370b252ecb8e021a98a8487
Jul 23 16:16:52.472963 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.472929    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:52.505928 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.505893    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4khjt\""
Jul 23 16:16:52.514551 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.514499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:52.573433 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.573402    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:52.644559 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.644470    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l4cw7"]
Jul 23 16:16:52.647618 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:16:52.647594    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e3834e_afc5_440d_bc07_f2f6a20c03fe.slice/crio-c99de06757c21a747eea8183708ab7fc557c587c9710730d104e2cdc6fd8b9f9 WatchSource:0}: Error finding container c99de06757c21a747eea8183708ab7fc557c587c9710730d104e2cdc6fd8b9f9: Status 404 returned error can't find the container with id c99de06757c21a747eea8183708ab7fc557c587c9710730d104e2cdc6fd8b9f9
Jul 23 16:16:52.750636 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.750597    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l4cw7" event={"ID":"f4e3834e-afc5-440d-bc07-f2f6a20c03fe","Type":"ContainerStarted","Data":"c99de06757c21a747eea8183708ab7fc557c587c9710730d104e2cdc6fd8b9f9"}
Jul 23 16:16:52.751725 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.751697    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5nt52" event={"ID":"e3d8907c-035c-46a6-83b3-7ad53449bc36","Type":"ContainerStarted","Data":"787c729e46ebe1f39f2ed2c9c823883a837bb0324370b252ecb8e021a98a8487"}
Jul 23 16:16:52.752755 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:52.752734    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lrbgb" event={"ID":"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7","Type":"ContainerStarted","Data":"0e76d77a92af7d5164624dc743650ad291af313eeba742a235e5cc218389034d"}
Jul 23 16:16:53.208620 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:53.208580    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:53.310249 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:53.310213    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:53.367354 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:53.367315    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:53.525604 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:53.525522    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:53.584716 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:53.584680    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:53.886743 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:53.886650    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:54.103407 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.103268    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:54.177842 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.177807    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z6pqj"]
Jul 23 16:16:54.180545 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.180517    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.184152 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.184123    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hdrgq\""
Jul 23 16:16:54.184729 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.184391    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 16:16:54.184729 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.184541    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 16:16:54.184729 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.184628    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 16:16:54.197835 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.197759    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:54.234992 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.234917    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62b70892-9f62-4d0c-a897-78c6ee811c67-sys\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.235178 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.235096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-wtmp\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.235257 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.235204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-textfile\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.235309 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.235254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62b70892-9f62-4d0c-a897-78c6ee811c67-metrics-client-ca\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.235309 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.235297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62b70892-9f62-4d0c-a897-78c6ee811c67-root\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.235389 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.235362    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-accelerators-collector-config\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.235426 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.235398    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnspx\" (UniqueName: \"kubernetes.io/projected/62b70892-9f62-4d0c-a897-78c6ee811c67-kube-api-access-jnspx\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.235464 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.235431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.235499 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.235474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-tls\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.336169 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.336126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62b70892-9f62-4d0c-a897-78c6ee811c67-root\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.336371 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.336195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-accelerators-collector-config\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.336371 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.336233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnspx\" (UniqueName: \"kubernetes.io/projected/62b70892-9f62-4d0c-a897-78c6ee811c67-kube-api-access-jnspx\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.336371 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.336266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.336371 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.336295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-tls\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.336371 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.336321    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62b70892-9f62-4d0c-a897-78c6ee811c67-sys\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.336371 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.336359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-wtmp\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.336749 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.336397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-textfile\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.336749 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.336425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62b70892-9f62-4d0c-a897-78c6ee811c67-metrics-client-ca\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.336959 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.336931    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-accelerators-collector-config\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.337085 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.337055    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62b70892-9f62-4d0c-a897-78c6ee811c67-metrics-client-ca\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.337206 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:54.337060    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 16:16:54.337206 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:16:54.337173    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-tls podName:62b70892-9f62-4d0c-a897-78c6ee811c67 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:54.837151651 +0000 UTC m=+68.915579526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-tls") pod "node-exporter-z6pqj" (UID: "62b70892-9f62-4d0c-a897-78c6ee811c67") : secret "node-exporter-tls" not found
Jul 23 16:16:54.337349 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.337332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62b70892-9f62-4d0c-a897-78c6ee811c67-sys\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.337489 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.337470    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-wtmp\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.337589 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.337480    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62b70892-9f62-4d0c-a897-78c6ee811c67-root\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.337707 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.337692    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-textfile\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.340277 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.340249    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.351135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.351098    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:54.352068 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.352008    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnspx\" (UniqueName: \"kubernetes.io/projected/62b70892-9f62-4d0c-a897-78c6ee811c67-kube-api-access-jnspx\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.443258 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.443168    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:54.546052 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.546016    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:54.642772 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.642691    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:54.746449 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.746407    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:54.763284 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.763240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5nt52" event={"ID":"e3d8907c-035c-46a6-83b3-7ad53449bc36","Type":"ContainerStarted","Data":"0ddbf5f8d59c09b709d49233f511f80dc07936ee82e725d185c981d239fa9b1b"}
Jul 23 16:16:54.841058 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.841017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-tls\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:54.845048 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:54.845013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62b70892-9f62-4d0c-a897-78c6ee811c67-node-exporter-tls\") pod \"node-exporter-z6pqj\" (UID: \"62b70892-9f62-4d0c-a897-78c6ee811c67\") " pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:55.000094 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:55.000008    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:55.097046 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:55.097007    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z6pqj"
Jul 23 16:16:55.100143 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:55.100109    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:55.223048 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:55.223010    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:55.295097 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:55.294997    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:55.769532 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:55.769481    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5nt52" event={"ID":"e3d8907c-035c-46a6-83b3-7ad53449bc36","Type":"ContainerStarted","Data":"d45f0853da5b7778763f522687869eabb43faedaed31e727d9b11fba3804fa94"}
Jul 23 16:16:55.787360 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:55.787301    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5nt52" podStartSLOduration=67.606890849 podStartE2EDuration="1m9.78728169s" totalImagesPullingTime="2.180390841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:55.78532874 +0000 UTC m=+69.863756650" watchObservedRunningTime="2026-07-23 16:16:55.78728169 +0000 UTC m=+69.865709669"
Jul 23 16:16:56.362625 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:56.362586    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:56.420923 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:56.420890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:57.018483 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.018449    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:57.120136 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.120089    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:57.334181 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.334104    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:57.352026 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:16:57.351994    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b70892_9f62_4d0c_a897_78c6ee811c67.slice/crio-2503b944c8367c4f61c9cbd711c018c7bfb9ea7dd4c1c852ba6f881dcac8553d WatchSource:0}: Error finding container 2503b944c8367c4f61c9cbd711c018c7bfb9ea7dd4c1c852ba6f881dcac8553d: Status 404 returned error can't find the container with id 2503b944c8367c4f61c9cbd711c018c7bfb9ea7dd4c1c852ba6f881dcac8553d
Jul 23 16:16:57.434396 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.434364    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:57.684497 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.684472    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6996878896-wlsfx"
Jul 23 16:16:57.741888 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.741845    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:57.778413 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.778378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z6pqj" event={"ID":"62b70892-9f62-4d0c-a897-78c6ee811c67","Type":"ContainerStarted","Data":"2503b944c8367c4f61c9cbd711c018c7bfb9ea7dd4c1c852ba6f881dcac8553d"}
Jul 23 16:16:57.780148 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.780114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l4cw7" event={"ID":"f4e3834e-afc5-440d-bc07-f2f6a20c03fe","Type":"ContainerStarted","Data":"2761815c56c9d2d9ea24a46be1fd9c943d142c92dd461767dfb1ee12f059048d"}
Jul 23 16:16:57.780295 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.780270    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:16:57.781747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.781719    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lrbgb" event={"ID":"3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7","Type":"ContainerStarted","Data":"85133daed923d70e51d7356a74992fb4b04a0c55699578047d852f0cd3572ab2"}
Jul 23 16:16:57.795204 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.795134    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l4cw7" podStartSLOduration=67.093742706 podStartE2EDuration="1m11.795112437s" totalImagesPullingTime="4.701369731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:57.794526262 +0000 UTC m=+71.872954177" watchObservedRunningTime="2026-07-23 16:16:57.795112437 +0000 UTC m=+71.873540327"
Jul 23 16:16:57.811270 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.810750    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lrbgb" podStartSLOduration=66.81222505 podStartE2EDuration="1m11.810727707s" totalImagesPullingTime="4.998502657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:57.81016957 +0000 UTC m=+71.888597473" watchObservedRunningTime="2026-07-23 16:16:57.810727707 +0000 UTC m=+71.889155599"
Jul 23 16:16:57.815893 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.815857    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:57.881191 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.881153    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:57.980455 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:57.980372    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:58.082809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.082774    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:58.101549 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.101487    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"]
Jul 23 16:16:58.104811 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.104773    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.106860 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.106837    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 23 16:16:58.107118 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.107104    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 23 16:16:58.107327 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.107221    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 23 16:16:58.107327 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.107236    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-j6sds\""
Jul 23 16:16:58.107327 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.107308    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-uj8deljrn9nu\""
Jul 23 16:16:58.107551 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.107336    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 23 16:16:58.107620 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.107574    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 23 16:16:58.117361 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.117335    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"]
Jul 23 16:16:58.171644 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.171612    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/733fbc83-a390-4758-a26c-313fa008f89b-metrics-client-ca\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.171644 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.171647    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxwxj\" (UniqueName: \"kubernetes.io/projected/733fbc83-a390-4758-a26c-313fa008f89b-kube-api-access-pxwxj\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.171898 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.171683    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-tls\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.171898 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.171706    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.171898 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.171734    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.171898 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.171792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-grpc-tls\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.171898 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.171831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.171898 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.171865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.273169 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.273134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-grpc-tls\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.273342 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.273179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.273342 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.273216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.273342 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.273242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/733fbc83-a390-4758-a26c-313fa008f89b-metrics-client-ca\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.273342 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.273265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxwxj\" (UniqueName: \"kubernetes.io/projected/733fbc83-a390-4758-a26c-313fa008f89b-kube-api-access-pxwxj\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.273342 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.273304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-tls\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.273342 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.273336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.273658 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.273376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.274145 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.274068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/733fbc83-a390-4758-a26c-313fa008f89b-metrics-client-ca\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.276206 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.276181    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-grpc-tls\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.276206 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.276194    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.276359 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.276245    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.276399 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.276366    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.276431 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.276413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-tls\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.276970 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.276948    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/733fbc83-a390-4758-a26c-313fa008f89b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.281145 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.281121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxwxj\" (UniqueName: \"kubernetes.io/projected/733fbc83-a390-4758-a26c-313fa008f89b-kube-api-access-pxwxj\") pod \"thanos-querier-5679c9c79f-cfg9v\" (UID: \"733fbc83-a390-4758-a26c-313fa008f89b\") " pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.416622 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.416576    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:16:58.551327 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.551290    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"]
Jul 23 16:16:58.556172 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:16:58.556140    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733fbc83_a390_4758_a26c_313fa008f89b.slice/crio-130ec83762337615d97cb5e074967b9d5314b10f6ea67d2d9269ad91b1cb8477 WatchSource:0}: Error finding container 130ec83762337615d97cb5e074967b9d5314b10f6ea67d2d9269ad91b1cb8477: Status 404 returned error can't find the container with id 130ec83762337615d97cb5e074967b9d5314b10f6ea67d2d9269ad91b1cb8477
Jul 23 16:16:58.786844 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.786753    2576 generic.go:356] "Generic (PLEG): container finished" podID="62b70892-9f62-4d0c-a897-78c6ee811c67" containerID="60a3bc983cffb1919681b3ea643be05896a568eb5f5fc888a7f26460fa652338" exitCode=0
Jul 23 16:16:58.786844 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.786833    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z6pqj" event={"ID":"62b70892-9f62-4d0c-a897-78c6ee811c67","Type":"ContainerDied","Data":"60a3bc983cffb1919681b3ea643be05896a568eb5f5fc888a7f26460fa652338"}
Jul 23 16:16:58.788027 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.788007    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v" event={"ID":"733fbc83-a390-4758-a26c-313fa008f89b","Type":"ContainerStarted","Data":"130ec83762337615d97cb5e074967b9d5314b10f6ea67d2d9269ad91b1cb8477"}
Jul 23 16:16:58.919300 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.919269    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:58.921792 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.921766    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l"]
Jul 23 16:16:58.923809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.923789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l"
Jul 23 16:16:58.925861 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.925843    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 23 16:16:58.925977 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.925939    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-57flw\""
Jul 23 16:16:58.935425 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:58.935400    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l"]
Jul 23 16:16:59.019214 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.019181    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:59.080196 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.080106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5h4m\" (UniqueName: \"kubernetes.io/projected/26eee933-e958-4c56-accb-e2a8a96311f2-kube-api-access-r5h4m\") pod \"monitoring-plugin-7b7b7bc8bf-h4f7l\" (UID: \"26eee933-e958-4c56-accb-e2a8a96311f2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l"
Jul 23 16:16:59.080350 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.080209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26eee933-e958-4c56-accb-e2a8a96311f2-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-h4f7l\" (UID: \"26eee933-e958-4c56-accb-e2a8a96311f2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l"
Jul 23 16:16:59.118226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.118192    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:59.181498 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.181458    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26eee933-e958-4c56-accb-e2a8a96311f2-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-h4f7l\" (UID: \"26eee933-e958-4c56-accb-e2a8a96311f2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l"
Jul 23 16:16:59.181498 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.181529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5h4m\" (UniqueName: \"kubernetes.io/projected/26eee933-e958-4c56-accb-e2a8a96311f2-kube-api-access-r5h4m\") pod \"monitoring-plugin-7b7b7bc8bf-h4f7l\" (UID: \"26eee933-e958-4c56-accb-e2a8a96311f2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l"
Jul 23 16:16:59.183903 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.183872    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26eee933-e958-4c56-accb-e2a8a96311f2-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-h4f7l\" (UID: \"26eee933-e958-4c56-accb-e2a8a96311f2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l"
Jul 23 16:16:59.189552 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.189497    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5h4m\" (UniqueName: \"kubernetes.io/projected/26eee933-e958-4c56-accb-e2a8a96311f2-kube-api-access-r5h4m\") pod \"monitoring-plugin-7b7b7bc8bf-h4f7l\" (UID: \"26eee933-e958-4c56-accb-e2a8a96311f2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l"
Jul 23 16:16:59.233593 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.233543    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l"
Jul 23 16:16:59.358606 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.358525    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l"]
Jul 23 16:16:59.361352 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:16:59.361318    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26eee933_e958_4c56_accb_e2a8a96311f2.slice/crio-7c987334d87d455dae31a9cabfbb62041cba1fd7d6eb7955a93d9dd8a67d10b5 WatchSource:0}: Error finding container 7c987334d87d455dae31a9cabfbb62041cba1fd7d6eb7955a93d9dd8a67d10b5: Status 404 returned error can't find the container with id 7c987334d87d455dae31a9cabfbb62041cba1fd7d6eb7955a93d9dd8a67d10b5
Jul 23 16:16:59.696606 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.696550    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:59.793273 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.793233    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l" event={"ID":"26eee933-e958-4c56-accb-e2a8a96311f2","Type":"ContainerStarted","Data":"7c987334d87d455dae31a9cabfbb62041cba1fd7d6eb7955a93d9dd8a67d10b5"}
Jul 23 16:16:59.795788 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.795754    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z6pqj" event={"ID":"62b70892-9f62-4d0c-a897-78c6ee811c67","Type":"ContainerStarted","Data":"aaf8f28a67c5f1ab45e3ed8c86af8fdfbbef2a8f7ff360fbf4e948bc5245a7c4"}
Jul 23 16:16:59.795942 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.795811    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z6pqj" event={"ID":"62b70892-9f62-4d0c-a897-78c6ee811c67","Type":"ContainerStarted","Data":"960ddb64d9626750a224d515151f497fb2b7ca6791d987d221cb6e7c697a33ba"}
Jul 23 16:16:59.811100 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.811063    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:59.817100 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:16:59.817050    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z6pqj" podStartSLOduration=4.901568422 podStartE2EDuration="5.81703248s" totalImagesPullingTime="849.104289ms" totalInitContainerRuntime="66.359769ms" isStatefulPod=true podCreationTimestamp="2026-07-23 16:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:59.815720704 +0000 UTC m=+73.894148600" watchObservedRunningTime="2026-07-23 16:16:59.81703248 +0000 UTC m=+73.895460370"
Jul 23 16:17:00.324306 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:00.324131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:00.415499 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:00.415460    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:00.503065 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:00.503027    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:01.809480 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:01.809444    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v" event={"ID":"733fbc83-a390-4758-a26c-313fa008f89b","Type":"ContainerStarted","Data":"24e45317606d5f00825b05e47f326d406588b75d95a2b50ec09d3d8c79074195"}
Jul 23 16:17:01.809932 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:01.809577    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v" event={"ID":"733fbc83-a390-4758-a26c-313fa008f89b","Type":"ContainerStarted","Data":"e03ec09e3ef1b73e32fcd6b2ef233c1d890cf9444b59e438f6347ec4a3f0fe02"}
Jul 23 16:17:01.809932 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:01.809621    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v" event={"ID":"733fbc83-a390-4758-a26c-313fa008f89b","Type":"ContainerStarted","Data":"3884f849783b5a233f268ca970471fa4639ff5f6a2efee8d0b47c78f4ce219df"}
Jul 23 16:17:01.810884 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:01.810861    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l" event={"ID":"26eee933-e958-4c56-accb-e2a8a96311f2","Type":"ContainerStarted","Data":"73f754fbd2d3e968c29a293c6a9d93a11be9deae631792ba92f922b5a3cc5e72"}
Jul 23 16:17:01.811099 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:01.811073    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l"
Jul 23 16:17:01.816120 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:01.816098    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l"
Jul 23 16:17:01.828685 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:01.828620    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-h4f7l" podStartSLOduration=1.809840956 podStartE2EDuration="3.828602864s" totalImagesPullingTime="2.018761908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:17:01.827420084 +0000 UTC m=+75.905847975" watchObservedRunningTime="2026-07-23 16:17:01.828602864 +0000 UTC m=+75.907030755"
Jul 23 16:17:02.223916 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:02.223884    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:02.281128 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:02.281083    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:02.794875 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:02.794841    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:02.818772 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:02.818736    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v" event={"ID":"733fbc83-a390-4758-a26c-313fa008f89b","Type":"ContainerStarted","Data":"dfd6f9fd1b4261899b14881a5629466cdc06d235e80538c65ed640acdb32f058"}
Jul 23 16:17:02.819248 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:02.818817    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v" event={"ID":"733fbc83-a390-4758-a26c-313fa008f89b","Type":"ContainerStarted","Data":"f0a978007d87011705b2c50ac028e1f9dea8c1a9ed9d7bbecee2c89958cc5fea"}
Jul 23 16:17:02.819248 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:02.818858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v" event={"ID":"733fbc83-a390-4758-a26c-313fa008f89b","Type":"ContainerStarted","Data":"bdaf605e26c06cf699c33ff98cd25f549d304b1843807dabc7d79945f584bfee"}
Jul 23 16:17:02.845154 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:02.845091    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v" podStartSLOduration=1.01406625 podStartE2EDuration="4.845073088s" totalImagesPullingTime="3.831006838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:17:02.842767213 +0000 UTC m=+76.921195104" watchObservedRunningTime="2026-07-23 16:17:02.845073088 +0000 UTC m=+76.923500979"
Jul 23 16:17:02.901906 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:02.901817    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:03.031952 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:03.031913    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:03.822596 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:03.822560    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:17:05.225365 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:05.225285    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:05.325862 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:05.325827    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:09.832055 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:09.831940    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5679c9c79f-cfg9v"
Jul 23 16:17:10.189090 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:10.189046    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:10.324345 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:10.324300    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:10.735810 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:10.735770    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:11.896165 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:11.896099    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:11.955154 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:11.955115    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:26.052630 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:26.052556    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:26.111182 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:26.111149    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:28.790618 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:28.790586    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l4cw7"
Jul 23 16:17:33.925730 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:33.925691    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:34.030985 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:34.030957    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:34.166363 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:34.166317    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:41.055564 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:41.055499    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:17:41.142250 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:17:41.142209    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:05.918151 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:05.918066    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:13.306241 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:13.306190    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:14.467205 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:14.467171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:18.382718 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.382671    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"]
Jul 23 16:18:18.385593 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.385568    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.387639 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.387610    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 23 16:18:18.387639 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.387610    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 23 16:18:18.387830 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.387657    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 23 16:18:18.387830 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.387613    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 23 16:18:18.387988 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.387971    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 23 16:18:18.388088 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.388072    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-h9lcv\""
Jul 23 16:18:18.393919 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.393888    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 23 16:18:18.399298 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.399270    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"]
Jul 23 16:18:18.475078 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.475042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4efb0ade-fcdb-4038-acd1-8bcc230d720a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.475274 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.475090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4efb0ade-fcdb-4038-acd1-8bcc230d720a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.475274 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.475113    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4efb0ade-fcdb-4038-acd1-8bcc230d720a-telemeter-client-tls\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.475274 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.475180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4efb0ade-fcdb-4038-acd1-8bcc230d720a-metrics-client-ca\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.475274 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.475261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdwk9\" (UniqueName: \"kubernetes.io/projected/4efb0ade-fcdb-4038-acd1-8bcc230d720a-kube-api-access-vdwk9\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.475445 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.475293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4efb0ade-fcdb-4038-acd1-8bcc230d720a-federate-client-tls\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.475445 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.475311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4efb0ade-fcdb-4038-acd1-8bcc230d720a-serving-certs-ca-bundle\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.475445 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.475343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4efb0ade-fcdb-4038-acd1-8bcc230d720a-secret-telemeter-client\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.576714 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.576674    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4efb0ade-fcdb-4038-acd1-8bcc230d720a-secret-telemeter-client\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.576911 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.576723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4efb0ade-fcdb-4038-acd1-8bcc230d720a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.576911 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.576751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4efb0ade-fcdb-4038-acd1-8bcc230d720a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.576911 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.576771    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4efb0ade-fcdb-4038-acd1-8bcc230d720a-telemeter-client-tls\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.576911 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.576790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4efb0ade-fcdb-4038-acd1-8bcc230d720a-metrics-client-ca\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.576911 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.576825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdwk9\" (UniqueName: \"kubernetes.io/projected/4efb0ade-fcdb-4038-acd1-8bcc230d720a-kube-api-access-vdwk9\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.576911 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.576854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4efb0ade-fcdb-4038-acd1-8bcc230d720a-federate-client-tls\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.578365 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.578073    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4efb0ade-fcdb-4038-acd1-8bcc230d720a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.578365 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.578306    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4efb0ade-fcdb-4038-acd1-8bcc230d720a-metrics-client-ca\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.579306 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.579282    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4efb0ade-fcdb-4038-acd1-8bcc230d720a-serving-certs-ca-bundle\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.579453 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.576972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4efb0ade-fcdb-4038-acd1-8bcc230d720a-serving-certs-ca-bundle\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.583560 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.580234    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4efb0ade-fcdb-4038-acd1-8bcc230d720a-secret-telemeter-client\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.583560 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.581047    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4efb0ade-fcdb-4038-acd1-8bcc230d720a-federate-client-tls\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.584314 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.584262    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4efb0ade-fcdb-4038-acd1-8bcc230d720a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.587669 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.587644    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4efb0ade-fcdb-4038-acd1-8bcc230d720a-telemeter-client-tls\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.588797 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.588771    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdwk9\" (UniqueName: \"kubernetes.io/projected/4efb0ade-fcdb-4038-acd1-8bcc230d720a-kube-api-access-vdwk9\") pod \"telemeter-client-c8f58b6dd-rmqct\" (UID: \"4efb0ade-fcdb-4038-acd1-8bcc230d720a\") " pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.698602 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.698564    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"
Jul 23 16:18:18.855175 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:18.855022    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c8f58b6dd-rmqct"]
Jul 23 16:18:18.857915 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:18:18.857882    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4efb0ade_fcdb_4038_acd1_8bcc230d720a.slice/crio-b0b28504b865848d71e29e988d5b8937ec5dcaec091a28dc86396d1cb10600f3 WatchSource:0}: Error finding container b0b28504b865848d71e29e988d5b8937ec5dcaec091a28dc86396d1cb10600f3: Status 404 returned error can't find the container with id b0b28504b865848d71e29e988d5b8937ec5dcaec091a28dc86396d1cb10600f3
Jul 23 16:18:19.078671 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:19.078581    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct" event={"ID":"4efb0ade-fcdb-4038-acd1-8bcc230d720a","Type":"ContainerStarted","Data":"b0b28504b865848d71e29e988d5b8937ec5dcaec091a28dc86396d1cb10600f3"}
Jul 23 16:18:21.087270 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:21.087232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct" event={"ID":"4efb0ade-fcdb-4038-acd1-8bcc230d720a","Type":"ContainerStarted","Data":"dd7b9d8081f63c9c7ca18f8a9673b59027ed6ad12a4458faaaa10ff2a5211434"}
Jul 23 16:18:22.092850 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:22.092727    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct" event={"ID":"4efb0ade-fcdb-4038-acd1-8bcc230d720a","Type":"ContainerStarted","Data":"091cacf86990a0cb17a1684dd84c0ab2ec706c63a88bb40d3d173a3e894d9309"}
Jul 23 16:18:22.092850 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:22.092788    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct" event={"ID":"4efb0ade-fcdb-4038-acd1-8bcc230d720a","Type":"ContainerStarted","Data":"bf93aad9476eab380270c8edb30eddaed59c6d759a718279a3d77aaafd266c21"}
Jul 23 16:18:22.116835 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:22.116777    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-c8f58b6dd-rmqct" podStartSLOduration=1.287143978 podStartE2EDuration="4.116760445s" totalImagesPullingTime="2.829616467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:18:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:18:22.115960124 +0000 UTC m=+156.194388015" watchObservedRunningTime="2026-07-23 16:18:22.116760445 +0000 UTC m=+156.195188357"
Jul 23 16:18:22.286761 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:22.286728    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:22.361322 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:22.361237    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:22.848047 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:22.848001    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:22.907721 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:22.907691    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:22.969843 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:22.969805    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:23.906885 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:23.906852    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:23.974856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:23.974825    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:33.486405 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:33.486371    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:33.588399 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:33.588363    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:33.646926 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:18:33.646888    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:19.937004 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:19.936951    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:28.653800 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:28.653768    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:28.827203 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:28.827131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:32.874122 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:32.874083    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:33.382616 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:33.382584    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:33.483813 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:33.483774    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:33.629692 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:33.629652    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:33.688003 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:33.687957    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:40.483527 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:40.483464    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:40.544222 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:40.544187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:43.760391 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:43.760359    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:43.861233 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:43.861204    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:43.920174 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:43.920145    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:56.060294 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:56.060257    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:56.159583 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:56.159527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:59.140996 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:59.140961    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:59.238382 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:19:59.238346    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:40.604365 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.604326    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:40.647789 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.647753    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p"]
Jul 23 16:20:40.650808 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.650782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p"
Jul 23 16:20:40.653236 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.653211    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 23 16:20:40.653382 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.653322    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 16:20:40.653439 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.653380    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 16:20:40.653492 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.653444    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 16:20:40.653574 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.653487    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-shqw4\""
Jul 23 16:20:40.662092 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.662066    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p"]
Jul 23 16:20:40.701240 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.701210    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"]
Jul 23 16:20:40.704489 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.704471    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"
Jul 23 16:20:40.706629 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.706610    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 23 16:20:40.714471 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.714450    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"]
Jul 23 16:20:40.804272 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.804229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltfqv\" (UniqueName: \"kubernetes.io/projected/e9e428d6-2f57-454e-a477-d4307f263d04-kube-api-access-ltfqv\") pod \"klusterlet-addon-workmgr-cf994d9b7-qq75l\" (UID: \"e9e428d6-2f57-454e-a477-d4307f263d04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"
Jul 23 16:20:40.804495 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.804286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxz4j\" (UniqueName: \"kubernetes.io/projected/505cdf12-1b71-4c85-a866-18e036452b40-kube-api-access-wxz4j\") pod \"managed-serviceaccount-addon-agent-5bc84f664-ph85p\" (UID: \"505cdf12-1b71-4c85-a866-18e036452b40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p"
Jul 23 16:20:40.804495 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.804379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9e428d6-2f57-454e-a477-d4307f263d04-tmp\") pod \"klusterlet-addon-workmgr-cf994d9b7-qq75l\" (UID: \"e9e428d6-2f57-454e-a477-d4307f263d04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"
Jul 23 16:20:40.804495 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.804438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/505cdf12-1b71-4c85-a866-18e036452b40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bc84f664-ph85p\" (UID: \"505cdf12-1b71-4c85-a866-18e036452b40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p"
Jul 23 16:20:40.804495 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.804488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e9e428d6-2f57-454e-a477-d4307f263d04-klusterlet-config\") pod \"klusterlet-addon-workmgr-cf994d9b7-qq75l\" (UID: \"e9e428d6-2f57-454e-a477-d4307f263d04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"
Jul 23 16:20:40.905364 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.905262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltfqv\" (UniqueName: \"kubernetes.io/projected/e9e428d6-2f57-454e-a477-d4307f263d04-kube-api-access-ltfqv\") pod \"klusterlet-addon-workmgr-cf994d9b7-qq75l\" (UID: \"e9e428d6-2f57-454e-a477-d4307f263d04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"
Jul 23 16:20:40.905364 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.905320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxz4j\" (UniqueName: \"kubernetes.io/projected/505cdf12-1b71-4c85-a866-18e036452b40-kube-api-access-wxz4j\") pod \"managed-serviceaccount-addon-agent-5bc84f664-ph85p\" (UID: \"505cdf12-1b71-4c85-a866-18e036452b40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p"
Jul 23 16:20:40.905628 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.905488    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9e428d6-2f57-454e-a477-d4307f263d04-tmp\") pod \"klusterlet-addon-workmgr-cf994d9b7-qq75l\" (UID: \"e9e428d6-2f57-454e-a477-d4307f263d04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"
Jul 23 16:20:40.905628 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.905558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/505cdf12-1b71-4c85-a866-18e036452b40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bc84f664-ph85p\" (UID: \"505cdf12-1b71-4c85-a866-18e036452b40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p"
Jul 23 16:20:40.905628 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.905591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e9e428d6-2f57-454e-a477-d4307f263d04-klusterlet-config\") pod \"klusterlet-addon-workmgr-cf994d9b7-qq75l\" (UID: \"e9e428d6-2f57-454e-a477-d4307f263d04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"
Jul 23 16:20:40.905901 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.905882    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9e428d6-2f57-454e-a477-d4307f263d04-tmp\") pod \"klusterlet-addon-workmgr-cf994d9b7-qq75l\" (UID: \"e9e428d6-2f57-454e-a477-d4307f263d04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"
Jul 23 16:20:40.908624 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.908599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/505cdf12-1b71-4c85-a866-18e036452b40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bc84f664-ph85p\" (UID: \"505cdf12-1b71-4c85-a866-18e036452b40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p"
Jul 23 16:20:40.908752 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.908731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e9e428d6-2f57-454e-a477-d4307f263d04-klusterlet-config\") pod \"klusterlet-addon-workmgr-cf994d9b7-qq75l\" (UID: \"e9e428d6-2f57-454e-a477-d4307f263d04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"
Jul 23 16:20:40.913406 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.913378    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxz4j\" (UniqueName: \"kubernetes.io/projected/505cdf12-1b71-4c85-a866-18e036452b40-kube-api-access-wxz4j\") pod \"managed-serviceaccount-addon-agent-5bc84f664-ph85p\" (UID: \"505cdf12-1b71-4c85-a866-18e036452b40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p"
Jul 23 16:20:40.913613 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.913592    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltfqv\" (UniqueName: \"kubernetes.io/projected/e9e428d6-2f57-454e-a477-d4307f263d04-kube-api-access-ltfqv\") pod \"klusterlet-addon-workmgr-cf994d9b7-qq75l\" (UID: \"e9e428d6-2f57-454e-a477-d4307f263d04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"
Jul 23 16:20:40.975529 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:40.975457    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p"
Jul 23 16:20:41.013782 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:41.013733    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"
Jul 23 16:20:41.114322 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:41.114288    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p"]
Jul 23 16:20:41.117028 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:20:41.116995    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod505cdf12_1b71_4c85_a866_18e036452b40.slice/crio-6039756bd15981178c2189a2d92487ec5efbed937728d9e893b97da7e4ed4d81 WatchSource:0}: Error finding container 6039756bd15981178c2189a2d92487ec5efbed937728d9e893b97da7e4ed4d81: Status 404 returned error can't find the container with id 6039756bd15981178c2189a2d92487ec5efbed937728d9e893b97da7e4ed4d81
Jul 23 16:20:41.164016 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:41.163941    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"]
Jul 23 16:20:41.166837 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:20:41.166809    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e428d6_2f57_454e_a477_d4307f263d04.slice/crio-3fab589240c0b47d6a591122367f93504970822bc0701521e14fdbbaa76dafc5 WatchSource:0}: Error finding container 3fab589240c0b47d6a591122367f93504970822bc0701521e14fdbbaa76dafc5: Status 404 returned error can't find the container with id 3fab589240c0b47d6a591122367f93504970822bc0701521e14fdbbaa76dafc5
Jul 23 16:20:41.569044 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:41.569009    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p" event={"ID":"505cdf12-1b71-4c85-a866-18e036452b40","Type":"ContainerStarted","Data":"6039756bd15981178c2189a2d92487ec5efbed937728d9e893b97da7e4ed4d81"}
Jul 23 16:20:41.570137 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:41.570112    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l" event={"ID":"e9e428d6-2f57-454e-a477-d4307f263d04","Type":"ContainerStarted","Data":"3fab589240c0b47d6a591122367f93504970822bc0701521e14fdbbaa76dafc5"}
Jul 23 16:20:42.126454 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:42.126424    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:44.584382 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:44.584344    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p" event={"ID":"505cdf12-1b71-4c85-a866-18e036452b40","Type":"ContainerStarted","Data":"4a3bb7d8b7ef7c78fe3ecd1ffc8e8b161cee5fb272907e294410cec222116e6b"}
Jul 23 16:20:44.598102 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:44.598053    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc84f664-ph85p" podStartSLOduration=1.7889883 podStartE2EDuration="4.59803542s" totalImagesPullingTime="2.80904712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:20:44.5977393 +0000 UTC m=+298.676167192" watchObservedRunningTime="2026-07-23 16:20:44.59803542 +0000 UTC m=+298.676463304"
Jul 23 16:20:46.312358 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:46.312330    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:20:46.315044 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:46.315015    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:20:46.316295 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:46.316274    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 16:20:48.016168 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:48.016130    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:48.249441 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:48.249390    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:48.600555 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:48.600502    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l" event={"ID":"e9e428d6-2f57-454e-a477-d4307f263d04","Type":"ContainerStarted","Data":"80a8f295d798739da3150000cc5be55c6d9e255c094719492ac1de28ec4ce653"}
Jul 23 16:20:48.600795 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:48.600777    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"
Jul 23 16:20:48.603294 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:48.603262    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l"
Jul 23 16:20:48.621933 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:20:48.621876    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cf994d9b7-qq75l" podStartSLOduration=1.370288578 podStartE2EDuration="8.621859289s" totalImagesPullingTime="7.251570711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:20:48.620999759 +0000 UTC m=+302.699427650" watchObservedRunningTime="2026-07-23 16:20:48.621859289 +0000 UTC m=+302.700287180"
Jul 23 16:21:08.138105 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:08.138064    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:08.238585 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:08.238543    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:15.309311 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:15.309271    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:16.608270 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:16.608233    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:17.249306 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.249266    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp"]
Jul 23 16:21:17.251642 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.251611    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp"
Jul 23 16:21:17.253595 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.253566    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dkxbw\""
Jul 23 16:21:17.253725 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.253700    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 23 16:21:17.253995 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.253979    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:21:17.273098 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.273062    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp"]
Jul 23 16:21:17.387502 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.387466    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj4bh\" (UniqueName: \"kubernetes.io/projected/45571ae7-44fc-4958-9f96-b688d90ba6b2-kube-api-access-fj4bh\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjmmp\" (UID: \"45571ae7-44fc-4958-9f96-b688d90ba6b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp"
Jul 23 16:21:17.387707 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.387530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45571ae7-44fc-4958-9f96-b688d90ba6b2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjmmp\" (UID: \"45571ae7-44fc-4958-9f96-b688d90ba6b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp"
Jul 23 16:21:17.488291 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.488258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj4bh\" (UniqueName: \"kubernetes.io/projected/45571ae7-44fc-4958-9f96-b688d90ba6b2-kube-api-access-fj4bh\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjmmp\" (UID: \"45571ae7-44fc-4958-9f96-b688d90ba6b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp"
Jul 23 16:21:17.488291 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.488295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45571ae7-44fc-4958-9f96-b688d90ba6b2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjmmp\" (UID: \"45571ae7-44fc-4958-9f96-b688d90ba6b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp"
Jul 23 16:21:17.488723 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.488705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45571ae7-44fc-4958-9f96-b688d90ba6b2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjmmp\" (UID: \"45571ae7-44fc-4958-9f96-b688d90ba6b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp"
Jul 23 16:21:17.506079 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.506003    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj4bh\" (UniqueName: \"kubernetes.io/projected/45571ae7-44fc-4958-9f96-b688d90ba6b2-kube-api-access-fj4bh\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjmmp\" (UID: \"45571ae7-44fc-4958-9f96-b688d90ba6b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp"
Jul 23 16:21:17.561151 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.561105    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp"
Jul 23 16:21:17.700235 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.700203    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp"]
Jul 23 16:21:17.703449 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:21:17.703420    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45571ae7_44fc_4958_9f96_b688d90ba6b2.slice/crio-d9386c244744b71796b5fab4ad69b560af0287fc064ec957f101e5e80ba1983a WatchSource:0}: Error finding container d9386c244744b71796b5fab4ad69b560af0287fc064ec957f101e5e80ba1983a: Status 404 returned error can't find the container with id d9386c244744b71796b5fab4ad69b560af0287fc064ec957f101e5e80ba1983a
Jul 23 16:21:17.706363 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:17.706349    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:21:18.709240 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:18.709203    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp" event={"ID":"45571ae7-44fc-4958-9f96-b688d90ba6b2","Type":"ContainerStarted","Data":"d9386c244744b71796b5fab4ad69b560af0287fc064ec957f101e5e80ba1983a"}
Jul 23 16:21:18.983428 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:18.983326    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:19.086414 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:19.086347    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:21.280089 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:21.280047    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:21.373587 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:21.373555    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:21.723392 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:21.723355    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp" event={"ID":"45571ae7-44fc-4958-9f96-b688d90ba6b2","Type":"ContainerStarted","Data":"cfa77a42c04a20d9999f98c397bcdf3c06402e25c554d8c78581b7e9fe3b6d2f"}
Jul 23 16:21:21.742707 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:21.742659    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjmmp" podStartSLOduration=1.691312175 podStartE2EDuration="4.742640157s" totalImagesPullingTime="3.051327982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:21:21.742006543 +0000 UTC m=+335.820434435" watchObservedRunningTime="2026-07-23 16:21:21.742640157 +0000 UTC m=+335.821068039"
Jul 23 16:21:22.176955 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:22.176921    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:22.339021 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:22.338989    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:23.489819 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:23.489783    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:23.685254 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:23.685218    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:24.833054 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:24.833012    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:24.933825 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:24.933793    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:29.447633 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.447592    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt"]
Jul 23 16:21:29.450320 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.450301    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt"
Jul 23 16:21:29.453080 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.453054    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 16:21:29.453189 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.453170    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-kzhhh\""
Jul 23 16:21:29.453751 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.453734    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 16:21:29.460273 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.460249    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt"]
Jul 23 16:21:29.590494 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.590454    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qfzz\" (UniqueName: \"kubernetes.io/projected/9ab91bec-5e5a-4820-8bb5-87c58a649bfc-kube-api-access-2qfzz\") pod \"cert-manager-cainjector-559cdd8c87-lr4gt\" (UID: \"9ab91bec-5e5a-4820-8bb5-87c58a649bfc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt"
Jul 23 16:21:29.590713 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.590590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ab91bec-5e5a-4820-8bb5-87c58a649bfc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lr4gt\" (UID: \"9ab91bec-5e5a-4820-8bb5-87c58a649bfc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt"
Jul 23 16:21:29.691336 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.691286    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ab91bec-5e5a-4820-8bb5-87c58a649bfc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lr4gt\" (UID: \"9ab91bec-5e5a-4820-8bb5-87c58a649bfc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt"
Jul 23 16:21:29.691555 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.691360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qfzz\" (UniqueName: \"kubernetes.io/projected/9ab91bec-5e5a-4820-8bb5-87c58a649bfc-kube-api-access-2qfzz\") pod \"cert-manager-cainjector-559cdd8c87-lr4gt\" (UID: \"9ab91bec-5e5a-4820-8bb5-87c58a649bfc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt"
Jul 23 16:21:29.699154 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.699088    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ab91bec-5e5a-4820-8bb5-87c58a649bfc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lr4gt\" (UID: \"9ab91bec-5e5a-4820-8bb5-87c58a649bfc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt"
Jul 23 16:21:29.699403 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.699384    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qfzz\" (UniqueName: \"kubernetes.io/projected/9ab91bec-5e5a-4820-8bb5-87c58a649bfc-kube-api-access-2qfzz\") pod \"cert-manager-cainjector-559cdd8c87-lr4gt\" (UID: \"9ab91bec-5e5a-4820-8bb5-87c58a649bfc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt"
Jul 23 16:21:29.759004 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.758971    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt"
Jul 23 16:21:29.891039 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:29.891008    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt"]
Jul 23 16:21:29.894235 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:21:29.894205    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab91bec_5e5a_4820_8bb5_87c58a649bfc.slice/crio-c6a12be11525ec519871683a73949c278dcf6292acdb8c847833931ecca26081 WatchSource:0}: Error finding container c6a12be11525ec519871683a73949c278dcf6292acdb8c847833931ecca26081: Status 404 returned error can't find the container with id c6a12be11525ec519871683a73949c278dcf6292acdb8c847833931ecca26081
Jul 23 16:21:30.757370 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:30.757336    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt" event={"ID":"9ab91bec-5e5a-4820-8bb5-87c58a649bfc","Type":"ContainerStarted","Data":"c6a12be11525ec519871683a73949c278dcf6292acdb8c847833931ecca26081"}
Jul 23 16:21:31.830023 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:31.829967    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:31.928917 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:31.928877    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:32.435091 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:32.435044    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:33.551568 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.551530    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l"]
Jul 23 16:21:33.554729 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.554711    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l"
Jul 23 16:21:33.556936 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.556916    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:21:33.557426 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.557405    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-m5p4r\""
Jul 23 16:21:33.557482 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.557457    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 16:21:33.563650 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.563623    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l"]
Jul 23 16:21:33.729072 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.729033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e04c6af-0c33-498d-b90d-707694237c28-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l6j6l\" (UID: \"0e04c6af-0c33-498d-b90d-707694237c28\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l"
Jul 23 16:21:33.729072 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.729079    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnd97\" (UniqueName: \"kubernetes.io/projected/0e04c6af-0c33-498d-b90d-707694237c28-kube-api-access-gnd97\") pod \"openshift-lws-operator-fd8ccff4c-l6j6l\" (UID: \"0e04c6af-0c33-498d-b90d-707694237c28\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l"
Jul 23 16:21:33.750449 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.750417    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:33.775164 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.775127    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt" event={"ID":"9ab91bec-5e5a-4820-8bb5-87c58a649bfc","Type":"ContainerStarted","Data":"29dad34f6c320fcb457482cfbe91bcc4e79960f8e40137c18514999c43609f1f"}
Jul 23 16:21:33.794872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.794822    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lr4gt" podStartSLOduration=1.7220141039999999 podStartE2EDuration="4.794803085s" totalImagesPullingTime="3.072788981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:21:33.793474949 +0000 UTC m=+347.871902839" watchObservedRunningTime="2026-07-23 16:21:33.794803085 +0000 UTC m=+347.873230976"
Jul 23 16:21:33.830221 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.830128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e04c6af-0c33-498d-b90d-707694237c28-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l6j6l\" (UID: \"0e04c6af-0c33-498d-b90d-707694237c28\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l"
Jul 23 16:21:33.830221 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.830171    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnd97\" (UniqueName: \"kubernetes.io/projected/0e04c6af-0c33-498d-b90d-707694237c28-kube-api-access-gnd97\") pod \"openshift-lws-operator-fd8ccff4c-l6j6l\" (UID: \"0e04c6af-0c33-498d-b90d-707694237c28\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l"
Jul 23 16:21:33.830612 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.830589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e04c6af-0c33-498d-b90d-707694237c28-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l6j6l\" (UID: \"0e04c6af-0c33-498d-b90d-707694237c28\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l"
Jul 23 16:21:33.838675 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.838636    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnd97\" (UniqueName: \"kubernetes.io/projected/0e04c6af-0c33-498d-b90d-707694237c28-kube-api-access-gnd97\") pod \"openshift-lws-operator-fd8ccff4c-l6j6l\" (UID: \"0e04c6af-0c33-498d-b90d-707694237c28\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l"
Jul 23 16:21:33.851623 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.851597    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:33.864378 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:33.864352    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l"
Jul 23 16:21:34.007312 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:34.007275    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l"]
Jul 23 16:21:34.010608 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:21:34.010576    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e04c6af_0c33_498d_b90d_707694237c28.slice/crio-08636c45035218b2bbb479dccd32584a93ecdea21b48189f72a217c7b3b0d3f3 WatchSource:0}: Error finding container 08636c45035218b2bbb479dccd32584a93ecdea21b48189f72a217c7b3b0d3f3: Status 404 returned error can't find the container with id 08636c45035218b2bbb479dccd32584a93ecdea21b48189f72a217c7b3b0d3f3
Jul 23 16:21:34.781966 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:34.781928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l" event={"ID":"0e04c6af-0c33-498d-b90d-707694237c28","Type":"ContainerStarted","Data":"08636c45035218b2bbb479dccd32584a93ecdea21b48189f72a217c7b3b0d3f3"}
Jul 23 16:21:36.793823 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:36.793788    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l" event={"ID":"0e04c6af-0c33-498d-b90d-707694237c28","Type":"ContainerStarted","Data":"d09b449f7d1204066936ce51df1db41861eee0fb832745173c6a2e1893197c5f"}
Jul 23 16:21:36.810858 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:36.810801    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l6j6l" podStartSLOduration=1.612565494 podStartE2EDuration="3.810784547s" totalImagesPullingTime="2.198219053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:21:36.809223766 +0000 UTC m=+350.887651656" watchObservedRunningTime="2026-07-23 16:21:36.810784547 +0000 UTC m=+350.889212438"
Jul 23 16:21:37.875354 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:37.875266    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:37.933857 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:37.933827    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:39.354023 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:39.353984    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:55.238849 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:55.238806    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:55.334442 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:55.334402    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:55.985525 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:55.985480    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:56.184620 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.184581    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:56.294242 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.294147    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:56.367681 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.367649    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"]
Jul 23 16:21:56.372253 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.372227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.374232 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.374209    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p2hj9\""
Jul 23 16:21:56.374381 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.374329    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 16:21:56.374641 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.374625    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 16:21:56.374956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.374941    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 16:21:56.376021 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.376002    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 16:21:56.400911 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.400881    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"]
Jul 23 16:21:56.411821 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.411786    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.411985 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.411898    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-manifests\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.411985 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.411924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-tmp\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.411985 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.411947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-webhook-cert\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.412113 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.411996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swf5x\" (UniqueName: \"kubernetes.io/projected/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-kube-api-access-swf5x\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.513336 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.513300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swf5x\" (UniqueName: \"kubernetes.io/projected/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-kube-api-access-swf5x\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.513336 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.513349    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.513668 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.513418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-manifests\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.513668 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.513439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-tmp\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.513668 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.513462    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-webhook-cert\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.513964 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.513933    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-manifests\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.515970 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.515942    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-tmp\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.516108 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.516089    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-webhook-cert\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.516220 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.516200    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.521776 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.521750    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swf5x\" (UniqueName: \"kubernetes.io/projected/8b73bb7d-8bae-4e24-a72f-c9d1332dea2c-kube-api-access-swf5x\") pod \"opendatahub-operator-controller-manager-678945769f-46pvj\" (UID: \"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.529874 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.529844    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:56.628017 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.627931    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:56.683456 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.683412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:21:56.733738 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.733696    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:56.833970 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.833932    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"]
Jul 23 16:21:56.838656 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:21:56.838627    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b73bb7d_8bae_4e24_a72f_c9d1332dea2c.slice/crio-7b01cd952698071a33ef29aa18c06b572f7e2d1ee2711fb070a6a245d85f3603 WatchSource:0}: Error finding container 7b01cd952698071a33ef29aa18c06b572f7e2d1ee2711fb070a6a245d85f3603: Status 404 returned error can't find the container with id 7b01cd952698071a33ef29aa18c06b572f7e2d1ee2711fb070a6a245d85f3603
Jul 23 16:21:56.842679 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.842655    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:56.877293 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.877260    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj" event={"ID":"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c","Type":"ContainerStarted","Data":"7b01cd952698071a33ef29aa18c06b572f7e2d1ee2711fb070a6a245d85f3603"}
Jul 23 16:21:56.910629 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:56.910541    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:57.009637 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:57.009584    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:57.110617 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:57.110577    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:59.892583 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:21:59.892545    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj" event={"ID":"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c","Type":"ContainerStarted","Data":"62b14d30f52ed35403b8f74c4be6d3f647bcb3efea11a9b5bbfaf84846f943fd"}
Jul 23 16:22:00.897813 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:00.897777    2576 generic.go:356] "Generic (PLEG): container finished" podID="8b73bb7d-8bae-4e24-a72f-c9d1332dea2c" containerID="62b14d30f52ed35403b8f74c4be6d3f647bcb3efea11a9b5bbfaf84846f943fd" exitCode=0
Jul 23 16:22:00.898172 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:00.897860    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj" event={"ID":"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c","Type":"ContainerDied","Data":"62b14d30f52ed35403b8f74c4be6d3f647bcb3efea11a9b5bbfaf84846f943fd"}
Jul 23 16:22:01.904425 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:01.904390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj" event={"ID":"8b73bb7d-8bae-4e24-a72f-c9d1332dea2c","Type":"ContainerStarted","Data":"224905da57a0de332471be3da75ceb0e9327541419503ae5e4ff58c21205e9b3"}
Jul 23 16:22:01.904823 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:01.904499    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:22:01.926838 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:01.926786    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj" podStartSLOduration=1.627627954 podStartE2EDuration="5.926751485s" totalImagesPullingTime="3.270469053s" totalInitContainerRuntime="1.028654478s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:21:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:22:01.926276983 +0000 UTC m=+376.004704875" watchObservedRunningTime="2026-07-23 16:22:01.926751485 +0000 UTC m=+376.005179375"
Jul 23 16:22:03.566724 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:03.566686    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:03.683659 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:03.683623    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:12.911352 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:12.911319    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-46pvj"
Jul 23 16:22:15.141213 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:15.141177    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:15.239416 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:15.239378    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:15.865653 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:15.865617    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:15.986234 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:15.986198    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:16.092351 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:16.092310    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:16.193271 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:16.193237    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:16.525420 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:16.525324    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:16.927480 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:16.927446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:21.021256 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.021213    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:21.057366 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.057332    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"]
Jul 23 16:22:21.061948 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.061921    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"
Jul 23 16:22:21.064100 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.064077    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 16:22:21.064242 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.064125    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 16:22:21.064563 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.064547    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 16:22:21.064801 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.064784    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 16:22:21.064879 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.064864    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gh92z\""
Jul 23 16:22:21.075950 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.075917    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"]
Jul 23 16:22:21.109814 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.109756    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:21.133921 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.133883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpk7g\" (UniqueName: \"kubernetes.io/projected/73169176-123c-4f27-9011-1c506f90c1f5-kube-api-access-bpk7g\") pod \"kube-auth-proxy-545d74bcdb-xhdg5\" (UID: \"73169176-123c-4f27-9011-1c506f90c1f5\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"
Jul 23 16:22:21.133921 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.133924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73169176-123c-4f27-9011-1c506f90c1f5-tmp\") pod \"kube-auth-proxy-545d74bcdb-xhdg5\" (UID: \"73169176-123c-4f27-9011-1c506f90c1f5\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"
Jul 23 16:22:21.134154 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.134054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73169176-123c-4f27-9011-1c506f90c1f5-tls-certs\") pod \"kube-auth-proxy-545d74bcdb-xhdg5\" (UID: \"73169176-123c-4f27-9011-1c506f90c1f5\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"
Jul 23 16:22:21.235163 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.235118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73169176-123c-4f27-9011-1c506f90c1f5-tls-certs\") pod \"kube-auth-proxy-545d74bcdb-xhdg5\" (UID: \"73169176-123c-4f27-9011-1c506f90c1f5\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"
Jul 23 16:22:21.235163 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.235170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpk7g\" (UniqueName: \"kubernetes.io/projected/73169176-123c-4f27-9011-1c506f90c1f5-kube-api-access-bpk7g\") pod \"kube-auth-proxy-545d74bcdb-xhdg5\" (UID: \"73169176-123c-4f27-9011-1c506f90c1f5\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"
Jul 23 16:22:21.235433 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.235274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73169176-123c-4f27-9011-1c506f90c1f5-tmp\") pod \"kube-auth-proxy-545d74bcdb-xhdg5\" (UID: \"73169176-123c-4f27-9011-1c506f90c1f5\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"
Jul 23 16:22:21.237683 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.237647    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73169176-123c-4f27-9011-1c506f90c1f5-tmp\") pod \"kube-auth-proxy-545d74bcdb-xhdg5\" (UID: \"73169176-123c-4f27-9011-1c506f90c1f5\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"
Jul 23 16:22:21.237841 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.237823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73169176-123c-4f27-9011-1c506f90c1f5-tls-certs\") pod \"kube-auth-proxy-545d74bcdb-xhdg5\" (UID: \"73169176-123c-4f27-9011-1c506f90c1f5\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"
Jul 23 16:22:21.244452 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.244428    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpk7g\" (UniqueName: \"kubernetes.io/projected/73169176-123c-4f27-9011-1c506f90c1f5-kube-api-access-bpk7g\") pod \"kube-auth-proxy-545d74bcdb-xhdg5\" (UID: \"73169176-123c-4f27-9011-1c506f90c1f5\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"
Jul 23 16:22:21.372926 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.372831    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"
Jul 23 16:22:21.518950 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.518923    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5"]
Jul 23 16:22:21.521577 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:22:21.521544    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73169176_123c_4f27_9011_1c506f90c1f5.slice/crio-758b88a183874f1c7e34e96060ffb0c8704505391185a0188a0799b956fc9ed2 WatchSource:0}: Error finding container 758b88a183874f1c7e34e96060ffb0c8704505391185a0188a0799b956fc9ed2: Status 404 returned error can't find the container with id 758b88a183874f1c7e34e96060ffb0c8704505391185a0188a0799b956fc9ed2
Jul 23 16:22:21.994372 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:21.994338    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5" event={"ID":"73169176-123c-4f27-9011-1c506f90c1f5","Type":"ContainerStarted","Data":"758b88a183874f1c7e34e96060ffb0c8704505391185a0188a0799b956fc9ed2"}
Jul 23 16:22:22.350153 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.350064    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:22.355668 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.355619    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"]
Jul 23 16:22:22.358355 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.358327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.361656 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.361619    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 16:22:22.361817 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.361770    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 23 16:22:22.361956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.361933    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 23 16:22:22.362029 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.361937    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 23 16:22:22.362029 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.362011    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mwlbv\""
Jul 23 16:22:22.375089 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.375059    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"]
Jul 23 16:22:22.446122 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.446088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/96fdd75b-015b-4927-9d69-a86a42d97771-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.446122 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.446128    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/96fdd75b-015b-4927-9d69-a86a42d97771-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.446373 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.446149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/96fdd75b-015b-4927-9d69-a86a42d97771-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.446373 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.446261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj4td\" (UniqueName: \"kubernetes.io/projected/96fdd75b-015b-4927-9d69-a86a42d97771-kube-api-access-gj4td\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.446373 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.446330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96fdd75b-015b-4927-9d69-a86a42d97771-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.446373 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.446355    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/96fdd75b-015b-4927-9d69-a86a42d97771-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.446587 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.446406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/96fdd75b-015b-4927-9d69-a86a42d97771-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.455257 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.455226    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:22.547389 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.547354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj4td\" (UniqueName: \"kubernetes.io/projected/96fdd75b-015b-4927-9d69-a86a42d97771-kube-api-access-gj4td\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.547609 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.547417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96fdd75b-015b-4927-9d69-a86a42d97771-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.547609 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.547442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/96fdd75b-015b-4927-9d69-a86a42d97771-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.547609 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.547476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/96fdd75b-015b-4927-9d69-a86a42d97771-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.547609 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.547528    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/96fdd75b-015b-4927-9d69-a86a42d97771-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.547609 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.547559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/96fdd75b-015b-4927-9d69-a86a42d97771-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.547609 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.547588    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/96fdd75b-015b-4927-9d69-a86a42d97771-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.548230 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.548201    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/96fdd75b-015b-4927-9d69-a86a42d97771-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.550378 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.550354    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/96fdd75b-015b-4927-9d69-a86a42d97771-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.550470 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.550352    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/96fdd75b-015b-4927-9d69-a86a42d97771-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.550470 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.550452    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/96fdd75b-015b-4927-9d69-a86a42d97771-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.550603 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.550500    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/96fdd75b-015b-4927-9d69-a86a42d97771-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.560549 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.560496    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj4td\" (UniqueName: \"kubernetes.io/projected/96fdd75b-015b-4927-9d69-a86a42d97771-kube-api-access-gj4td\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.560807 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.560658    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96fdd75b-015b-4927-9d69-a86a42d97771-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9ztk8\" (UID: \"96fdd75b-015b-4927-9d69-a86a42d97771\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.671039 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.670930    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:22.820584 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.820486    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"]
Jul 23 16:22:22.823609 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:22:22.823578    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96fdd75b_015b_4927_9d69_a86a42d97771.slice/crio-6f209650e0bd74c652603dadaddd68c076e1a2f2d47b0beb487b51555a2ee8e7 WatchSource:0}: Error finding container 6f209650e0bd74c652603dadaddd68c076e1a2f2d47b0beb487b51555a2ee8e7: Status 404 returned error can't find the container with id 6f209650e0bd74c652603dadaddd68c076e1a2f2d47b0beb487b51555a2ee8e7
Jul 23 16:22:22.999605 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:22.999569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8" event={"ID":"96fdd75b-015b-4927-9d69-a86a42d97771","Type":"ContainerStarted","Data":"6f209650e0bd74c652603dadaddd68c076e1a2f2d47b0beb487b51555a2ee8e7"}
Jul 23 16:22:24.139475 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:24.139284    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:25.607045 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:25.607011    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 16:22:25.607319 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:25.607077    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 16:22:25.779312 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:25.779277    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:26.017502 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:26.017463    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5" event={"ID":"73169176-123c-4f27-9011-1c506f90c1f5","Type":"ContainerStarted","Data":"783177a3f73978fbab58002230ed1b2d063e0e4fcb3ca46231c8c2819ed69b85"}
Jul 23 16:22:26.019120 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:26.019089    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8" event={"ID":"96fdd75b-015b-4927-9d69-a86a42d97771","Type":"ContainerStarted","Data":"5be404c01474531a4812012e6eda190fadda78fa0c0946df5c7a961c9138711d"}
Jul 23 16:22:26.019292 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:26.019276    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:26.021158 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:26.021129    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-9ztk8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 16:22:26.021284 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:26.021184    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8" podUID="96fdd75b-015b-4927-9d69-a86a42d97771" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 16:22:26.117869 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:26.117788    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8" podStartSLOduration=1.337295385 podStartE2EDuration="4.117770248s" totalImagesPullingTime="2.780474863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:22:26.116957032 +0000 UTC m=+400.195384935" watchObservedRunningTime="2026-07-23 16:22:26.117770248 +0000 UTC m=+400.196198140"
Jul 23 16:22:26.119352 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:26.119308    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-545d74bcdb-xhdg5" podStartSLOduration=1.041364113 podStartE2EDuration="5.119291409s" totalImagesPullingTime="4.077927296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:22:26.03700751 +0000 UTC m=+400.115435403" watchObservedRunningTime="2026-07-23 16:22:26.119291409 +0000 UTC m=+400.197719327"
Jul 23 16:22:26.241795 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:26.241760    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:26.333651 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:26.333553    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:26.682171 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:26.682135    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:26.820846 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:26.820811    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:27.024620 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:27.024540    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-9ztk8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 16:22:27.024620 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:27.024593    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8" podUID="96fdd75b-015b-4927-9d69-a86a42d97771" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 16:22:27.077140 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:27.077099    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:27.280286 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:27.280186    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:28.027987 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.027950    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"]
Jul 23 16:22:28.030391 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.030373    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.088893 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.088856    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-clpq2\""
Jul 23 16:22:28.129799 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.129768    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"]
Jul 23 16:22:28.150772 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.150733    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:28.201788 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.201751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66c78d79-8577-4d60-8657-fe5c6ab15b64-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.201976 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.201804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66c78d79-8577-4d60-8657-fe5c6ab15b64-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.201976 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.201831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdm4g\" (UniqueName: \"kubernetes.io/projected/66c78d79-8577-4d60-8657-fe5c6ab15b64-kube-api-access-vdm4g\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.201976 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.201863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.201976 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.201912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.201976 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.201964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66c78d79-8577-4d60-8657-fe5c6ab15b64-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.202158 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.201986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.202158 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.202012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.202158 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.202038    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.303262 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.303172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66c78d79-8577-4d60-8657-fe5c6ab15b64-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.303262 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.303209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdm4g\" (UniqueName: \"kubernetes.io/projected/66c78d79-8577-4d60-8657-fe5c6ab15b64-kube-api-access-vdm4g\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.303262 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.303233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.303638 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.303279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.303638 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.303331    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66c78d79-8577-4d60-8657-fe5c6ab15b64-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.303638 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.303363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.303638 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.303390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.303638 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.303425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.303638 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.303459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66c78d79-8577-4d60-8657-fe5c6ab15b64-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.303937 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.303800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.303937 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.303855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.304107 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.304084    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.304266 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.304186    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.304384 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.304373    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66c78d79-8577-4d60-8657-fe5c6ab15b64-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.305954 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.305935    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66c78d79-8577-4d60-8657-fe5c6ab15b64-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.306150 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.306130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66c78d79-8577-4d60-8657-fe5c6ab15b64-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.340805 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.340777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdm4g\" (UniqueName: \"kubernetes.io/projected/66c78d79-8577-4d60-8657-fe5c6ab15b64-kube-api-access-vdm4g\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.340956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.340894    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66c78d79-8577-4d60-8657-fe5c6ab15b64-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4phf7n\" (UID: \"66c78d79-8577-4d60-8657-fe5c6ab15b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.640725 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.640638    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:28.649330 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.649293    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:28.823527 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.823446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:28.825445 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:28.825365    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"]
Jul 23 16:22:28.828062 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:22:28.828038    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c78d79_8577_4d60_8657_fe5c6ab15b64.slice/crio-eddb85b1e9d01adc69abc382b2498ccd9b0af393d9490e21973951a04aa4e038 WatchSource:0}: Error finding container eddb85b1e9d01adc69abc382b2498ccd9b0af393d9490e21973951a04aa4e038: Status 404 returned error can't find the container with id eddb85b1e9d01adc69abc382b2498ccd9b0af393d9490e21973951a04aa4e038
Jul 23 16:22:29.035146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:29.035100    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n" event={"ID":"66c78d79-8577-4d60-8657-fe5c6ab15b64","Type":"ContainerStarted","Data":"eddb85b1e9d01adc69abc382b2498ccd9b0af393d9490e21973951a04aa4e038"}
Jul 23 16:22:30.025265 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:30.025227    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9ztk8"
Jul 23 16:22:31.497941 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:31.497904    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 16:22:31.498237 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:31.497977    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 16:22:31.498237 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:31.498025    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 16:22:32.052127 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:32.052086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n" event={"ID":"66c78d79-8577-4d60-8657-fe5c6ab15b64","Type":"ContainerStarted","Data":"fc89bea52a5cef48e1f010c571c3293988accf2f4538a3993e3a9b79be868047"}
Jul 23 16:22:32.073583 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:32.073520    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n" podStartSLOduration=2.405827276 podStartE2EDuration="5.0734879s" totalImagesPullingTime="2.667660624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:22:32.070774217 +0000 UTC m=+406.149202110" watchObservedRunningTime="2026-07-23 16:22:32.0734879 +0000 UTC m=+406.151915791"
Jul 23 16:22:32.641852 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:32.641806    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:32.646599 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:32.646573    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:33.056839 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:33.056803    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:22:33.058044 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:22:33.058018    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4phf7n"
Jul 23 16:23:02.489581 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:02.489533    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:03.189492 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:03.189440    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:16.696299 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:16.696200    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:16.797206 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:16.797174    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:16.823205 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:16.823168    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jcwh6"]
Jul 23 16:23:16.829070 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:16.829036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jcwh6"
Jul 23 16:23:16.831872 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:16.831842    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9dq4r\""
Jul 23 16:23:16.832037 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:16.831855    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 16:23:16.832037 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:16.831915    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 16:23:16.839583 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:16.839556    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jcwh6"]
Jul 23 16:23:16.871655 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:16.871613    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:16.931273 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:16.931235    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw6lx\" (UniqueName: \"kubernetes.io/projected/f8915077-0fb5-45a3-8552-ab4a72e9e20b-kube-api-access-pw6lx\") pod \"kuadrant-operator-catalog-jcwh6\" (UID: \"f8915077-0fb5-45a3-8552-ab4a72e9e20b\") " pod="kuadrant-system/kuadrant-operator-catalog-jcwh6"
Jul 23 16:23:17.032642 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:17.032539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw6lx\" (UniqueName: \"kubernetes.io/projected/f8915077-0fb5-45a3-8552-ab4a72e9e20b-kube-api-access-pw6lx\") pod \"kuadrant-operator-catalog-jcwh6\" (UID: \"f8915077-0fb5-45a3-8552-ab4a72e9e20b\") " pod="kuadrant-system/kuadrant-operator-catalog-jcwh6"
Jul 23 16:23:17.041433 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:17.041400    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw6lx\" (UniqueName: \"kubernetes.io/projected/f8915077-0fb5-45a3-8552-ab4a72e9e20b-kube-api-access-pw6lx\") pod \"kuadrant-operator-catalog-jcwh6\" (UID: \"f8915077-0fb5-45a3-8552-ab4a72e9e20b\") " pod="kuadrant-system/kuadrant-operator-catalog-jcwh6"
Jul 23 16:23:17.141352 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:17.141316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jcwh6"
Jul 23 16:23:17.195277 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:17.195245    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jcwh6"]
Jul 23 16:23:17.284227 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:17.284203    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jcwh6"]
Jul 23 16:23:17.287079 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:23:17.287048    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8915077_0fb5_45a3_8552_ab4a72e9e20b.slice/crio-ecc17801abb7738372a9ffd06bc2e3bce0648b1b17a5cca337b3bcaf50d7ab0d WatchSource:0}: Error finding container ecc17801abb7738372a9ffd06bc2e3bce0648b1b17a5cca337b3bcaf50d7ab0d: Status 404 returned error can't find the container with id ecc17801abb7738372a9ffd06bc2e3bce0648b1b17a5cca337b3bcaf50d7ab0d
Jul 23 16:23:18.250081 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:18.250043    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jcwh6" event={"ID":"f8915077-0fb5-45a3-8552-ab4a72e9e20b","Type":"ContainerStarted","Data":"ecc17801abb7738372a9ffd06bc2e3bce0648b1b17a5cca337b3bcaf50d7ab0d"}
Jul 23 16:23:20.260632 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:20.260595    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jcwh6" event={"ID":"f8915077-0fb5-45a3-8552-ab4a72e9e20b","Type":"ContainerStarted","Data":"c96b343ef159859515728b9c500ab9c3bcdef0ccf788e8f54389dc45f37e7442"}
Jul 23 16:23:20.260997 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:20.260679    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-jcwh6" podUID="f8915077-0fb5-45a3-8552-ab4a72e9e20b" containerName="registry-server" containerID="cri-o://c96b343ef159859515728b9c500ab9c3bcdef0ccf788e8f54389dc45f37e7442" gracePeriod=2
Jul 23 16:23:20.276906 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:20.276861    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jcwh6" podStartSLOduration=1.8641569329999998 podStartE2EDuration="4.276846588s" totalImagesPullingTime="2.412689655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:23:20.274701919 +0000 UTC m=+454.353129840" watchObservedRunningTime="2026-07-23 16:23:20.276846588 +0000 UTC m=+454.355274479"
Jul 23 16:23:20.519215 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:20.519146    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jcwh6"
Jul 23 16:23:20.664357 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:20.664314    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw6lx\" (UniqueName: \"kubernetes.io/projected/f8915077-0fb5-45a3-8552-ab4a72e9e20b-kube-api-access-pw6lx\") pod \"f8915077-0fb5-45a3-8552-ab4a72e9e20b\" (UID: \"f8915077-0fb5-45a3-8552-ab4a72e9e20b\") "
Jul 23 16:23:20.666613 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:20.666591    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8915077-0fb5-45a3-8552-ab4a72e9e20b-kube-api-access-pw6lx" (OuterVolumeSpecName: "kube-api-access-pw6lx") pod "f8915077-0fb5-45a3-8552-ab4a72e9e20b" (UID: "f8915077-0fb5-45a3-8552-ab4a72e9e20b"). InnerVolumeSpecName "kube-api-access-pw6lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:23:20.765018 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:20.764970    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw6lx\" (UniqueName: \"kubernetes.io/projected/f8915077-0fb5-45a3-8552-ab4a72e9e20b-kube-api-access-pw6lx\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:23:21.090728 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:21.090692    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:21.191266 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:21.191228    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:21.266061 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:21.266026    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8915077-0fb5-45a3-8552-ab4a72e9e20b" containerID="c96b343ef159859515728b9c500ab9c3bcdef0ccf788e8f54389dc45f37e7442" exitCode=0
Jul 23 16:23:21.266464 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:21.266069    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jcwh6"
Jul 23 16:23:21.266464 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:21.266081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jcwh6" event={"ID":"f8915077-0fb5-45a3-8552-ab4a72e9e20b","Type":"ContainerDied","Data":"c96b343ef159859515728b9c500ab9c3bcdef0ccf788e8f54389dc45f37e7442"}
Jul 23 16:23:21.266464 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:21.266120    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jcwh6" event={"ID":"f8915077-0fb5-45a3-8552-ab4a72e9e20b","Type":"ContainerDied","Data":"ecc17801abb7738372a9ffd06bc2e3bce0648b1b17a5cca337b3bcaf50d7ab0d"}
Jul 23 16:23:21.266464 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:21.266143    2576 scope.go:117] "RemoveContainer" containerID="c96b343ef159859515728b9c500ab9c3bcdef0ccf788e8f54389dc45f37e7442"
Jul 23 16:23:21.275291 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:21.275274    2576 scope.go:117] "RemoveContainer" containerID="c96b343ef159859515728b9c500ab9c3bcdef0ccf788e8f54389dc45f37e7442"
Jul 23 16:23:21.275582 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:23:21.275558    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c96b343ef159859515728b9c500ab9c3bcdef0ccf788e8f54389dc45f37e7442\": container with ID starting with c96b343ef159859515728b9c500ab9c3bcdef0ccf788e8f54389dc45f37e7442 not found: ID does not exist" containerID="c96b343ef159859515728b9c500ab9c3bcdef0ccf788e8f54389dc45f37e7442"
Jul 23 16:23:21.275676 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:21.275590    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c96b343ef159859515728b9c500ab9c3bcdef0ccf788e8f54389dc45f37e7442"} err="failed to get container status \"c96b343ef159859515728b9c500ab9c3bcdef0ccf788e8f54389dc45f37e7442\": rpc error: code = NotFound desc = could not find container \"c96b343ef159859515728b9c500ab9c3bcdef0ccf788e8f54389dc45f37e7442\": container with ID starting with c96b343ef159859515728b9c500ab9c3bcdef0ccf788e8f54389dc45f37e7442 not found: ID does not exist"
Jul 23 16:23:21.284803 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:21.284778    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jcwh6"]
Jul 23 16:23:21.288216 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:21.288188    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jcwh6"]
Jul 23 16:23:22.496274 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:22.496232    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8915077-0fb5-45a3-8552-ab4a72e9e20b" path="/var/lib/kubelet/pods/f8915077-0fb5-45a3-8552-ab4a72e9e20b/volumes"
Jul 23 16:23:23.422934 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:23.422896    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:23.482756 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:23.482727    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:23.584215 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:23.584179    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:23.642758 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:23.642704    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:24.167045 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:24.166984    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:24.267351 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:24.267321    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:26.220378 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:26.220340    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:26.291388 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:26.291340    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:28.160992 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:28.160944    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:28.262064 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:28.262029    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:34.709976 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:34.709932    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:34.811066 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:34.811019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:34.907677 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:34.907640    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:34.966280 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:34.966192    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:46.103122 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:46.103067    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:49.564485 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:49.564434    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:50.862797 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:50.862761    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"]
Jul 23 16:23:50.863155 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:50.863058    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8915077-0fb5-45a3-8552-ab4a72e9e20b" containerName="registry-server"
Jul 23 16:23:50.863155 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:50.863070    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8915077-0fb5-45a3-8552-ab4a72e9e20b" containerName="registry-server"
Jul 23 16:23:50.863155 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:50.863134    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8915077-0fb5-45a3-8552-ab4a72e9e20b" containerName="registry-server"
Jul 23 16:23:50.867206 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:50.867185    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:23:50.870312 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:50.870283    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7w4z4\""
Jul 23 16:23:50.870482 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:50.870464    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 16:23:50.870573 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:50.870464    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 16:23:50.885666 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:50.885634    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"]
Jul 23 16:23:50.939587 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:50.939550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a012b6c-917e-4216-8420-c93bc288d847-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9l7s4\" (UID: \"0a012b6c-917e-4216-8420-c93bc288d847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:23:50.939587 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:50.939591    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mb5m\" (UniqueName: \"kubernetes.io/projected/0a012b6c-917e-4216-8420-c93bc288d847-kube-api-access-5mb5m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9l7s4\" (UID: \"0a012b6c-917e-4216-8420-c93bc288d847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:23:51.040766 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:51.040728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a012b6c-917e-4216-8420-c93bc288d847-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9l7s4\" (UID: \"0a012b6c-917e-4216-8420-c93bc288d847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:23:51.040766 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:51.040766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mb5m\" (UniqueName: \"kubernetes.io/projected/0a012b6c-917e-4216-8420-c93bc288d847-kube-api-access-5mb5m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9l7s4\" (UID: \"0a012b6c-917e-4216-8420-c93bc288d847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:23:51.041105 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:51.041084    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a012b6c-917e-4216-8420-c93bc288d847-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9l7s4\" (UID: \"0a012b6c-917e-4216-8420-c93bc288d847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:23:51.050397 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:51.050367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mb5m\" (UniqueName: \"kubernetes.io/projected/0a012b6c-917e-4216-8420-c93bc288d847-kube-api-access-5mb5m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9l7s4\" (UID: \"0a012b6c-917e-4216-8420-c93bc288d847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:23:51.111695 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:51.111661    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:51.177718 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:51.177685    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:23:51.319894 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:51.319868    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"]
Jul 23 16:23:51.325803 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:23:51.325755    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a012b6c_917e_4216_8420_c93bc288d847.slice/crio-e3aef181ebaef873165927e81b9baf0b138e4d1a85e89f656af60214528b1847 WatchSource:0}: Error finding container e3aef181ebaef873165927e81b9baf0b138e4d1a85e89f656af60214528b1847: Status 404 returned error can't find the container with id e3aef181ebaef873165927e81b9baf0b138e4d1a85e89f656af60214528b1847
Jul 23 16:23:51.396561 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:51.396528    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4" event={"ID":"0a012b6c-917e-4216-8420-c93bc288d847","Type":"ContainerStarted","Data":"e3aef181ebaef873165927e81b9baf0b138e4d1a85e89f656af60214528b1847"}
Jul 23 16:23:51.512905 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:51.512823    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:52.551665 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:52.551624    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:52.653626 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:52.653595    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:54.135042 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:54.134981    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:54.235441 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:54.235409    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:55.786139 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:55.786103    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mc47"]
Jul 23 16:23:55.790435 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:55.790400    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mc47"
Jul 23 16:23:55.792701 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:55.792671    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 23 16:23:55.792835 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:55.792755    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2hd76\""
Jul 23 16:23:55.802084 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:55.802055    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mc47"]
Jul 23 16:23:55.884487 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:55.884452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmm22\" (UniqueName: \"kubernetes.io/projected/80f8a9f5-2452-4196-a6f4-1458461513b8-kube-api-access-vmm22\") pod \"dns-operator-controller-manager-864dd78c4c-5mc47\" (UID: \"80f8a9f5-2452-4196-a6f4-1458461513b8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mc47"
Jul 23 16:23:55.985284 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:55.985244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmm22\" (UniqueName: \"kubernetes.io/projected/80f8a9f5-2452-4196-a6f4-1458461513b8-kube-api-access-vmm22\") pod \"dns-operator-controller-manager-864dd78c4c-5mc47\" (UID: \"80f8a9f5-2452-4196-a6f4-1458461513b8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mc47"
Jul 23 16:23:56.000608 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:56.000575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmm22\" (UniqueName: \"kubernetes.io/projected/80f8a9f5-2452-4196-a6f4-1458461513b8-kube-api-access-vmm22\") pod \"dns-operator-controller-manager-864dd78c4c-5mc47\" (UID: \"80f8a9f5-2452-4196-a6f4-1458461513b8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mc47"
Jul 23 16:23:56.104710 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:56.104626    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mc47"
Jul 23 16:23:56.309446 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:56.309409    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:57.191257 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:57.191227    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mc47"]
Jul 23 16:23:57.194037 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:23:57.194009    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f8a9f5_2452_4196_a6f4_1458461513b8.slice/crio-951d55c7af7d2e80e4ec71bdc8861646cffac5cea65d593b52e0eefc9c45a7f3 WatchSource:0}: Error finding container 951d55c7af7d2e80e4ec71bdc8861646cffac5cea65d593b52e0eefc9c45a7f3: Status 404 returned error can't find the container with id 951d55c7af7d2e80e4ec71bdc8861646cffac5cea65d593b52e0eefc9c45a7f3
Jul 23 16:23:57.425051 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:57.425013    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mc47" event={"ID":"80f8a9f5-2452-4196-a6f4-1458461513b8","Type":"ContainerStarted","Data":"951d55c7af7d2e80e4ec71bdc8861646cffac5cea65d593b52e0eefc9c45a7f3"}
Jul 23 16:23:57.426518 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:57.426479    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4" event={"ID":"0a012b6c-917e-4216-8420-c93bc288d847","Type":"ContainerStarted","Data":"6e94b2095c85e2eb0b0187660464dfe20b4787197c669e61a7d4596c363f4bb0"}
Jul 23 16:23:57.426657 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:57.426639    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:23:57.448595 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:57.448545    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4" podStartSLOduration=1.684390591 podStartE2EDuration="7.448501478s" totalImagesPullingTime="5.764110887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:23:57.447825828 +0000 UTC m=+491.526253751" watchObservedRunningTime="2026-07-23 16:23:57.448501478 +0000 UTC m=+491.526929368"
Jul 23 16:23:57.776722 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:57.776630    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"]
Jul 23 16:23:57.779128 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:57.779108    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:23:57.781809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:57.781785    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6l9dg\""
Jul 23 16:23:57.793230 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:57.793204    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"]
Jul 23 16:23:57.902276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:57.902238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnnc4\" (UniqueName: \"kubernetes.io/projected/ed4f8168-5a47-481a-aadb-7fd9fe70acce-kube-api-access-jnnc4\") pod \"limitador-operator-controller-manager-859d7b78bd-8w4n2\" (UID: \"ed4f8168-5a47-481a-aadb-7fd9fe70acce\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:23:58.003571 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:58.003534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnnc4\" (UniqueName: \"kubernetes.io/projected/ed4f8168-5a47-481a-aadb-7fd9fe70acce-kube-api-access-jnnc4\") pod \"limitador-operator-controller-manager-859d7b78bd-8w4n2\" (UID: \"ed4f8168-5a47-481a-aadb-7fd9fe70acce\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:23:58.017087 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:58.017057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnnc4\" (UniqueName: \"kubernetes.io/projected/ed4f8168-5a47-481a-aadb-7fd9fe70acce-kube-api-access-jnnc4\") pod \"limitador-operator-controller-manager-859d7b78bd-8w4n2\" (UID: \"ed4f8168-5a47-481a-aadb-7fd9fe70acce\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:23:58.090567 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:58.090460    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:23:58.151036 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:58.150674    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:58.241345 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:58.241307    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"]
Jul 23 16:23:58.292353 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:23:58.292312    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4f8168_5a47_481a_aadb_7fd9fe70acce.slice/crio-345f8e5be91c69ccf06ed59ca763b431bc57bd391c1928c274c910b453ca7de4 WatchSource:0}: Error finding container 345f8e5be91c69ccf06ed59ca763b431bc57bd391c1928c274c910b453ca7de4: Status 404 returned error can't find the container with id 345f8e5be91c69ccf06ed59ca763b431bc57bd391c1928c274c910b453ca7de4
Jul 23 16:23:58.433933 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:58.433895    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2" event={"ID":"ed4f8168-5a47-481a-aadb-7fd9fe70acce","Type":"ContainerStarted","Data":"345f8e5be91c69ccf06ed59ca763b431bc57bd391c1928c274c910b453ca7de4"}
Jul 23 16:23:59.911574 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:23:59.911467    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:00.014001 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:00.013948    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:00.229328 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:00.229292    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:00.395359 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:00.395324    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:00.447304 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:00.447269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2" event={"ID":"ed4f8168-5a47-481a-aadb-7fd9fe70acce","Type":"ContainerStarted","Data":"095d9de0759cc016b0cb8945572ed24aad326a8bbac8c857647d9a891d40674e"}
Jul 23 16:24:00.447494 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:00.447362    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:24:00.448875 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:00.448849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mc47" event={"ID":"80f8a9f5-2452-4196-a6f4-1458461513b8","Type":"ContainerStarted","Data":"68a868a6348fa56f535b5647a2ecd4f971b11de5b0695fa3a9d2d42d4a84444c"}
Jul 23 16:24:00.448984 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:00.448939    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mc47"
Jul 23 16:24:00.481284 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:00.481173    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2" podStartSLOduration=1.511237792 podStartE2EDuration="3.481157191s" totalImagesPullingTime="1.969919399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:00.479824665 +0000 UTC m=+494.558252556" watchObservedRunningTime="2026-07-23 16:24:00.481157191 +0000 UTC m=+494.559585081"
Jul 23 16:24:00.498690 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:00.498635    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mc47" podStartSLOduration=3.123150301 podStartE2EDuration="5.498617159s" totalImagesPullingTime="2.375466858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:00.497261401 +0000 UTC m=+494.575689292" watchObservedRunningTime="2026-07-23 16:24:00.498617159 +0000 UTC m=+494.577045049"
Jul 23 16:24:08.436189 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:08.436159    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:24:09.587178 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:09.587135    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:09.689837 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:09.689803    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:09.922800 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:09.922759    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:10.025421 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.025379    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:10.424771 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.424730    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"]
Jul 23 16:24:10.424956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.424929    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4" podUID="0a012b6c-917e-4216-8420-c93bc288d847" containerName="manager" containerID="cri-o://6e94b2095c85e2eb0b0187660464dfe20b4787197c669e61a7d4596c363f4bb0" gracePeriod=2
Jul 23 16:24:10.432477 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.432444    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"]
Jul 23 16:24:10.433447 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:10.433404    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0a012b6c-917e-4216-8420-c93bc288d847\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-9l7s4\": pods \"kuadrant-operator-controller-manager-8684c9ff49-9l7s4\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:24:10.456241 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.456205    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"]
Jul 23 16:24:10.456499 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.456467    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2" podUID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" containerName="manager" containerID="cri-o://095d9de0759cc016b0cb8945572ed24aad326a8bbac8c857647d9a891d40674e" gracePeriod=2
Jul 23 16:24:10.458245 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.458218    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:24:10.458678 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:10.458647    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9l7s4\" is forbidden: User \"system:node:ip-10-0-138-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-199.ec2.internal' and this object" podUID="0a012b6c-917e-4216-8420-c93bc288d847" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:24:10.492768 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:10.492714    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ed4f8168-5a47-481a-aadb-7fd9fe70acce\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-8w4n2\": pods \"limitador-operator-controller-manager-859d7b78bd-8w4n2\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:24:10.494398 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.494373    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"]
Jul 23 16:24:10.495093 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.494758    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a012b6c-917e-4216-8420-c93bc288d847" containerName="manager"
Jul 23 16:24:10.495093 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.494777    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a012b6c-917e-4216-8420-c93bc288d847" containerName="manager"
Jul 23 16:24:10.495093 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.494857    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a012b6c-917e-4216-8420-c93bc288d847" containerName="manager"
Jul 23 16:24:10.495093 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:10.494914    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9l7s4\" is forbidden: User \"system:node:ip-10-0-138-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-199.ec2.internal' and this object" podUID="0a012b6c-917e-4216-8420-c93bc288d847" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:24:10.497190 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:10.497164    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8w4n2\" is forbidden: User \"system:node:ip-10-0-138-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-199.ec2.internal' and this object" podUID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:24:10.497808 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.497788    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"]
Jul 23 16:24:10.497953 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.497900    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"
Jul 23 16:24:10.511650 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.511619    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj9r9"]
Jul 23 16:24:10.511954 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.511943    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" containerName="manager"
Jul 23 16:24:10.512002 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.511956    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" containerName="manager"
Jul 23 16:24:10.512036 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.512012    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" containerName="manager"
Jul 23 16:24:10.514778 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.514760    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj9r9"
Jul 23 16:24:10.518934 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.518912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf5n7\" (UniqueName: \"kubernetes.io/projected/6b25186b-1af0-4db2-8be2-441c2cebf08b-kube-api-access-gf5n7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v5lmk\" (UID: \"6b25186b-1af0-4db2-8be2-441c2cebf08b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"
Jul 23 16:24:10.519011 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.518957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b25186b-1af0-4db2-8be2-441c2cebf08b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v5lmk\" (UID: \"6b25186b-1af0-4db2-8be2-441c2cebf08b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"
Jul 23 16:24:10.519047 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.519009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdlmx\" (UniqueName: \"kubernetes.io/projected/b9da788a-a7b9-4b74-91c4-b7db6c310253-kube-api-access-fdlmx\") pod \"limitador-operator-controller-manager-859d7b78bd-tj9r9\" (UID: \"b9da788a-a7b9-4b74-91c4-b7db6c310253\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj9r9"
Jul 23 16:24:10.530536 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.530464    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"]
Jul 23 16:24:10.552770 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:10.552732    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8w4n2\" is forbidden: User \"system:node:ip-10-0-138-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-199.ec2.internal' and this object" podUID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:24:10.560405 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.560367    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj9r9"]
Jul 23 16:24:10.588969 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:10.588906    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8w4n2\" is forbidden: User \"system:node:ip-10-0-138-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-199.ec2.internal' and this object" podUID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:24:10.619993 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.619952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf5n7\" (UniqueName: \"kubernetes.io/projected/6b25186b-1af0-4db2-8be2-441c2cebf08b-kube-api-access-gf5n7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v5lmk\" (UID: \"6b25186b-1af0-4db2-8be2-441c2cebf08b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"
Jul 23 16:24:10.620182 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.620029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b25186b-1af0-4db2-8be2-441c2cebf08b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v5lmk\" (UID: \"6b25186b-1af0-4db2-8be2-441c2cebf08b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"
Jul 23 16:24:10.620182 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.620069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdlmx\" (UniqueName: \"kubernetes.io/projected/b9da788a-a7b9-4b74-91c4-b7db6c310253-kube-api-access-fdlmx\") pod \"limitador-operator-controller-manager-859d7b78bd-tj9r9\" (UID: \"b9da788a-a7b9-4b74-91c4-b7db6c310253\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj9r9"
Jul 23 16:24:10.620562 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.620540    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b25186b-1af0-4db2-8be2-441c2cebf08b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v5lmk\" (UID: \"6b25186b-1af0-4db2-8be2-441c2cebf08b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"
Jul 23 16:24:10.637675 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.637640    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdlmx\" (UniqueName: \"kubernetes.io/projected/b9da788a-a7b9-4b74-91c4-b7db6c310253-kube-api-access-fdlmx\") pod \"limitador-operator-controller-manager-859d7b78bd-tj9r9\" (UID: \"b9da788a-a7b9-4b74-91c4-b7db6c310253\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj9r9"
Jul 23 16:24:10.638396 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.638371    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf5n7\" (UniqueName: \"kubernetes.io/projected/6b25186b-1af0-4db2-8be2-441c2cebf08b-kube-api-access-gf5n7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v5lmk\" (UID: \"6b25186b-1af0-4db2-8be2-441c2cebf08b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"
Jul 23 16:24:10.704716 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.704630    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:24:10.706648 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:10.706617    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8w4n2\" is forbidden: User \"system:node:ip-10-0-138-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-199.ec2.internal' and this object" podUID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:24:10.712097 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.712073    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:24:10.714010 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:10.713983    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8w4n2\" is forbidden: User \"system:node:ip-10-0-138-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-199.ec2.internal' and this object" podUID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:24:10.720392 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.720356    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a012b6c-917e-4216-8420-c93bc288d847-extensions-socket-volume\") pod \"0a012b6c-917e-4216-8420-c93bc288d847\" (UID: \"0a012b6c-917e-4216-8420-c93bc288d847\") "
Jul 23 16:24:10.720502 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.720411    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mb5m\" (UniqueName: \"kubernetes.io/projected/0a012b6c-917e-4216-8420-c93bc288d847-kube-api-access-5mb5m\") pod \"0a012b6c-917e-4216-8420-c93bc288d847\" (UID: \"0a012b6c-917e-4216-8420-c93bc288d847\") "
Jul 23 16:24:10.720502 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.720455    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnnc4\" (UniqueName: \"kubernetes.io/projected/ed4f8168-5a47-481a-aadb-7fd9fe70acce-kube-api-access-jnnc4\") pod \"ed4f8168-5a47-481a-aadb-7fd9fe70acce\" (UID: \"ed4f8168-5a47-481a-aadb-7fd9fe70acce\") "
Jul 23 16:24:10.720925 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.720901    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a012b6c-917e-4216-8420-c93bc288d847-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0a012b6c-917e-4216-8420-c93bc288d847" (UID: "0a012b6c-917e-4216-8420-c93bc288d847"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:24:10.722623 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.722596    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a012b6c-917e-4216-8420-c93bc288d847-kube-api-access-5mb5m" (OuterVolumeSpecName: "kube-api-access-5mb5m") pod "0a012b6c-917e-4216-8420-c93bc288d847" (UID: "0a012b6c-917e-4216-8420-c93bc288d847"). InnerVolumeSpecName "kube-api-access-5mb5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:24:10.722714 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.722641    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed4f8168-5a47-481a-aadb-7fd9fe70acce-kube-api-access-jnnc4" (OuterVolumeSpecName: "kube-api-access-jnnc4") pod "ed4f8168-5a47-481a-aadb-7fd9fe70acce" (UID: "ed4f8168-5a47-481a-aadb-7fd9fe70acce"). InnerVolumeSpecName "kube-api-access-jnnc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:24:10.821703 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.821665    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnnc4\" (UniqueName: \"kubernetes.io/projected/ed4f8168-5a47-481a-aadb-7fd9fe70acce-kube-api-access-jnnc4\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:24:10.821703 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.821695    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a012b6c-917e-4216-8420-c93bc288d847-extensions-socket-volume\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:24:10.821703 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.821705    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mb5m\" (UniqueName: \"kubernetes.io/projected/0a012b6c-917e-4216-8420-c93bc288d847-kube-api-access-5mb5m\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:24:10.849010 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.848986    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"
Jul 23 16:24:10.856088 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.856061    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj9r9"
Jul 23 16:24:10.996446 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:10.996416    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"]
Jul 23 16:24:10.999537 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:24:10.999494    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b25186b_1af0_4db2_8be2_441c2cebf08b.slice/crio-bb81740482c51332ed73b08c9e5fc294f9b99e6c51581fe4d4800e9db24bb754 WatchSource:0}: Error finding container bb81740482c51332ed73b08c9e5fc294f9b99e6c51581fe4d4800e9db24bb754: Status 404 returned error can't find the container with id bb81740482c51332ed73b08c9e5fc294f9b99e6c51581fe4d4800e9db24bb754
Jul 23 16:24:11.015944 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.015901    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj9r9"]
Jul 23 16:24:11.020239 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:24:11.020206    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9da788a_a7b9_4b74_91c4_b7db6c310253.slice/crio-e96a38cc7755e32e23ca494b676d344a6c9ee7990607df25808ad6fc4613015c WatchSource:0}: Error finding container e96a38cc7755e32e23ca494b676d344a6c9ee7990607df25808ad6fc4613015c: Status 404 returned error can't find the container with id e96a38cc7755e32e23ca494b676d344a6c9ee7990607df25808ad6fc4613015c
Jul 23 16:24:11.455865 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.455841    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mc47"
Jul 23 16:24:11.501796 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:11.501757    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8w4n2\" is forbidden: User \"system:node:ip-10-0-138-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-199.ec2.internal' and this object" podUID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:24:11.506738 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.506692    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj9r9" event={"ID":"b9da788a-a7b9-4b74-91c4-b7db6c310253","Type":"ContainerStarted","Data":"6bb071fed5607e94df10399355e1cf8ad74f9cc203a92263d323d0c7da651024"}
Jul 23 16:24:11.506927 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.506758    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj9r9" event={"ID":"b9da788a-a7b9-4b74-91c4-b7db6c310253","Type":"ContainerStarted","Data":"e96a38cc7755e32e23ca494b676d344a6c9ee7990607df25808ad6fc4613015c"}
Jul 23 16:24:11.506927 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.506894    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj9r9"
Jul 23 16:24:11.508358 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.508325    2576 generic.go:356] "Generic (PLEG): container finished" podID="0a012b6c-917e-4216-8420-c93bc288d847" containerID="6e94b2095c85e2eb0b0187660464dfe20b4787197c669e61a7d4596c363f4bb0" exitCode=0
Jul 23 16:24:11.508495 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.508365    2576 scope.go:117] "RemoveContainer" containerID="6e94b2095c85e2eb0b0187660464dfe20b4787197c669e61a7d4596c363f4bb0"
Jul 23 16:24:11.508495 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.508372    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9l7s4"
Jul 23 16:24:11.510279 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.510253    2576 generic.go:356] "Generic (PLEG): container finished" podID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" containerID="095d9de0759cc016b0cb8945572ed24aad326a8bbac8c857647d9a891d40674e" exitCode=0
Jul 23 16:24:11.510460 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.510429    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:24:11.513499 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.513459    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk" event={"ID":"6b25186b-1af0-4db2-8be2-441c2cebf08b","Type":"ContainerStarted","Data":"48f5e3f865addf195a39325a4d033f24a75900d968abdfb01cf2436012da15ec"}
Jul 23 16:24:11.513947 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.513537    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk" event={"ID":"6b25186b-1af0-4db2-8be2-441c2cebf08b","Type":"ContainerStarted","Data":"bb81740482c51332ed73b08c9e5fc294f9b99e6c51581fe4d4800e9db24bb754"}
Jul 23 16:24:11.524862 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.523706    2576 scope.go:117] "RemoveContainer" containerID="6e94b2095c85e2eb0b0187660464dfe20b4787197c669e61a7d4596c363f4bb0"
Jul 23 16:24:11.526096 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:11.526066    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e94b2095c85e2eb0b0187660464dfe20b4787197c669e61a7d4596c363f4bb0\": container with ID starting with 6e94b2095c85e2eb0b0187660464dfe20b4787197c669e61a7d4596c363f4bb0 not found: ID does not exist" containerID="6e94b2095c85e2eb0b0187660464dfe20b4787197c669e61a7d4596c363f4bb0"
Jul 23 16:24:11.526218 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.526109    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e94b2095c85e2eb0b0187660464dfe20b4787197c669e61a7d4596c363f4bb0"} err="failed to get container status \"6e94b2095c85e2eb0b0187660464dfe20b4787197c669e61a7d4596c363f4bb0\": rpc error: code = NotFound desc = could not find container \"6e94b2095c85e2eb0b0187660464dfe20b4787197c669e61a7d4596c363f4bb0\": container with ID starting with 6e94b2095c85e2eb0b0187660464dfe20b4787197c669e61a7d4596c363f4bb0 not found: ID does not exist"
Jul 23 16:24:11.526218 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.526137    2576 scope.go:117] "RemoveContainer" containerID="095d9de0759cc016b0cb8945572ed24aad326a8bbac8c857647d9a891d40674e"
Jul 23 16:24:11.530957 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.530899    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj9r9" podStartSLOduration=1.5308780419999999 podStartE2EDuration="1.530878042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:11.52924148 +0000 UTC m=+505.607669398" watchObservedRunningTime="2026-07-23 16:24:11.530878042 +0000 UTC m=+505.609305934"
Jul 23 16:24:11.532956 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:11.532918    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8w4n2\" is forbidden: User \"system:node:ip-10-0-138-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-199.ec2.internal' and this object" podUID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:24:11.538276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.538250    2576 scope.go:117] "RemoveContainer" containerID="095d9de0759cc016b0cb8945572ed24aad326a8bbac8c857647d9a891d40674e"
Jul 23 16:24:11.538853 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:11.538828    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"095d9de0759cc016b0cb8945572ed24aad326a8bbac8c857647d9a891d40674e\": container with ID starting with 095d9de0759cc016b0cb8945572ed24aad326a8bbac8c857647d9a891d40674e not found: ID does not exist" containerID="095d9de0759cc016b0cb8945572ed24aad326a8bbac8c857647d9a891d40674e"
Jul 23 16:24:11.539059 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.539034    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"095d9de0759cc016b0cb8945572ed24aad326a8bbac8c857647d9a891d40674e"} err="failed to get container status \"095d9de0759cc016b0cb8945572ed24aad326a8bbac8c857647d9a891d40674e\": rpc error: code = NotFound desc = could not find container \"095d9de0759cc016b0cb8945572ed24aad326a8bbac8c857647d9a891d40674e\": container with ID starting with 095d9de0759cc016b0cb8945572ed24aad326a8bbac8c857647d9a891d40674e not found: ID does not exist"
Jul 23 16:24:11.571756 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:24:11.571713    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8w4n2\" is forbidden: User \"system:node:ip-10-0-138-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-199.ec2.internal' and this object" podUID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8w4n2"
Jul 23 16:24:11.571982 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:11.571804    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk" podStartSLOduration=1.571788175 podStartE2EDuration="1.571788175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:11.569845859 +0000 UTC m=+505.648273795" watchObservedRunningTime="2026-07-23 16:24:11.571788175 +0000 UTC m=+505.650216066"
Jul 23 16:24:12.492903 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:12.492868    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a012b6c-917e-4216-8420-c93bc288d847" path="/var/lib/kubelet/pods/0a012b6c-917e-4216-8420-c93bc288d847/volumes"
Jul 23 16:24:12.493377 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:12.493358    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed4f8168-5a47-481a-aadb-7fd9fe70acce" path="/var/lib/kubelet/pods/ed4f8168-5a47-481a-aadb-7fd9fe70acce/volumes"
Jul 23 16:24:12.520645 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:12.520616    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"
Jul 23 16:24:13.324259 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:13.324220    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:13.421293 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:13.421258    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:15.339029 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:15.338990    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:16.898651 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:16.898587    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:16.989967 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:16.989925    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:20.555221 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:20.555184    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:20.655560 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:20.655484    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:21.788430 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:21.788387    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:21.866764 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:21.866730    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:22.522332 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:22.522296    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tj9r9"
Jul 23 16:24:22.626294 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:22.626260    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:22.759381 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:22.759349    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:23.527823 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:23.527795    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"
Jul 23 16:24:27.811760 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:27.811723    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"]
Jul 23 16:24:27.812239 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:27.811913    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk" podUID="6b25186b-1af0-4db2-8be2-441c2cebf08b" containerName="manager" containerID="cri-o://48f5e3f865addf195a39325a4d033f24a75900d968abdfb01cf2436012da15ec" gracePeriod=10
Jul 23 16:24:28.597549 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:28.597495    2576 generic.go:356] "Generic (PLEG): container finished" podID="6b25186b-1af0-4db2-8be2-441c2cebf08b" containerID="48f5e3f865addf195a39325a4d033f24a75900d968abdfb01cf2436012da15ec" exitCode=0
Jul 23 16:24:28.597695 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:28.597547    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk" event={"ID":"6b25186b-1af0-4db2-8be2-441c2cebf08b","Type":"ContainerDied","Data":"48f5e3f865addf195a39325a4d033f24a75900d968abdfb01cf2436012da15ec"}
Jul 23 16:24:28.656562 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:28.656533    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"
Jul 23 16:24:28.773004 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:28.772904    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf5n7\" (UniqueName: \"kubernetes.io/projected/6b25186b-1af0-4db2-8be2-441c2cebf08b-kube-api-access-gf5n7\") pod \"6b25186b-1af0-4db2-8be2-441c2cebf08b\" (UID: \"6b25186b-1af0-4db2-8be2-441c2cebf08b\") "
Jul 23 16:24:28.773004 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:28.772954    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b25186b-1af0-4db2-8be2-441c2cebf08b-extensions-socket-volume\") pod \"6b25186b-1af0-4db2-8be2-441c2cebf08b\" (UID: \"6b25186b-1af0-4db2-8be2-441c2cebf08b\") "
Jul 23 16:24:28.773353 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:28.773323    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b25186b-1af0-4db2-8be2-441c2cebf08b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6b25186b-1af0-4db2-8be2-441c2cebf08b" (UID: "6b25186b-1af0-4db2-8be2-441c2cebf08b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:24:28.775000 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:28.774975    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b25186b-1af0-4db2-8be2-441c2cebf08b-kube-api-access-gf5n7" (OuterVolumeSpecName: "kube-api-access-gf5n7") pod "6b25186b-1af0-4db2-8be2-441c2cebf08b" (UID: "6b25186b-1af0-4db2-8be2-441c2cebf08b"). InnerVolumeSpecName "kube-api-access-gf5n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:24:28.873446 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:28.873413    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf5n7\" (UniqueName: \"kubernetes.io/projected/6b25186b-1af0-4db2-8be2-441c2cebf08b-kube-api-access-gf5n7\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:24:28.873446 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:28.873441    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b25186b-1af0-4db2-8be2-441c2cebf08b-extensions-socket-volume\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:24:29.237380 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:29.237343    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:29.336711 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:29.336673    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:29.604373 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:29.604287    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"
Jul 23 16:24:29.604373 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:29.604295    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk" event={"ID":"6b25186b-1af0-4db2-8be2-441c2cebf08b","Type":"ContainerDied","Data":"bb81740482c51332ed73b08c9e5fc294f9b99e6c51581fe4d4800e9db24bb754"}
Jul 23 16:24:29.604637 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:29.604440    2576 scope.go:117] "RemoveContainer" containerID="48f5e3f865addf195a39325a4d033f24a75900d968abdfb01cf2436012da15ec"
Jul 23 16:24:29.639713 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:29.639663    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"]
Jul 23 16:24:29.641447 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:29.641420    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5lmk"]
Jul 23 16:24:30.492265 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:30.492227    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b25186b-1af0-4db2-8be2-441c2cebf08b" path="/var/lib/kubelet/pods/6b25186b-1af0-4db2-8be2-441c2cebf08b/volumes"
Jul 23 16:24:31.678014 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:31.677969    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:31.735123 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:31.735088    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:36.677120 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:36.677079    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:36.735869 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:36.735802    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:40.428200 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:40.428119    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:40.500275 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:40.500232    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:44.225488 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.225452    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"]
Jul 23 16:24:44.225889 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.225830    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b25186b-1af0-4db2-8be2-441c2cebf08b" containerName="manager"
Jul 23 16:24:44.225889 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.225846    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b25186b-1af0-4db2-8be2-441c2cebf08b" containerName="manager"
Jul 23 16:24:44.225976 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.225962    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b25186b-1af0-4db2-8be2-441c2cebf08b" containerName="manager"
Jul 23 16:24:44.228284 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.228261    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.234975 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.234875    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qtwh9\""
Jul 23 16:24:44.243445 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.243419    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"]
Jul 23 16:24:44.265963 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.265906    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:44.307858 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.307816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.307858 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.307858    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e919fea6-ce69-4f1a-b915-32952ac61bdb-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.308065 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.307879    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.308065 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.307947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e919fea6-ce69-4f1a-b915-32952ac61bdb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.308065 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.308033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf9bt\" (UniqueName: \"kubernetes.io/projected/e919fea6-ce69-4f1a-b915-32952ac61bdb-kube-api-access-cf9bt\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.308163 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.308065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e919fea6-ce69-4f1a-b915-32952ac61bdb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.308163 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.308104    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.308163 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.308119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.308163 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.308137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.408820 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.408776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf9bt\" (UniqueName: \"kubernetes.io/projected/e919fea6-ce69-4f1a-b915-32952ac61bdb-kube-api-access-cf9bt\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.408820 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.408818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e919fea6-ce69-4f1a-b915-32952ac61bdb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.409050 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.408941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.409050 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.408970    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.409050 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.409004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.409246 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.409094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.409246 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.409126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e919fea6-ce69-4f1a-b915-32952ac61bdb-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.409246 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.409173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.409246 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.409218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e919fea6-ce69-4f1a-b915-32952ac61bdb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.409452 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.409359    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.409555 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.409490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.409618 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.409563    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.409659 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.409646    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.409867 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.409841    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e919fea6-ce69-4f1a-b915-32952ac61bdb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.411725 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.411687    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e919fea6-ce69-4f1a-b915-32952ac61bdb-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.411917 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.411901    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e919fea6-ce69-4f1a-b915-32952ac61bdb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.416416 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.416380    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e919fea6-ce69-4f1a-b915-32952ac61bdb-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.416702 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.416680    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf9bt\" (UniqueName: \"kubernetes.io/projected/e919fea6-ce69-4f1a-b915-32952ac61bdb-kube-api-access-cf9bt\") pod \"maas-default-gateway-openshift-default-56654dcf7-8qpg2\" (UID: \"e919fea6-ce69-4f1a-b915-32952ac61bdb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.487020 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.486932    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:44.543276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.543235    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:44.683103 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.683020    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"]
Jul 23 16:24:44.685927 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:24:44.685898    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode919fea6_ce69_4f1a_b915_32952ac61bdb.slice/crio-3f727f26d7807cbe13fca2cd338d00a43cb8dd16d016716bd4efd1f043aa98b5 WatchSource:0}: Error finding container 3f727f26d7807cbe13fca2cd338d00a43cb8dd16d016716bd4efd1f043aa98b5: Status 404 returned error can't find the container with id 3f727f26d7807cbe13fca2cd338d00a43cb8dd16d016716bd4efd1f043aa98b5
Jul 23 16:24:44.687963 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.687927    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 16:24:44.688061 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.687997    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 16:24:44.688061 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:44.688026    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 16:24:45.680622 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:45.680584    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2" event={"ID":"e919fea6-ce69-4f1a-b915-32952ac61bdb","Type":"ContainerStarted","Data":"33e4d035d423d4a2b3cbc96614244ccda8e9d6e363e4b857f68a823079076eb4"}
Jul 23 16:24:45.681001 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:45.680641    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2" event={"ID":"e919fea6-ce69-4f1a-b915-32952ac61bdb","Type":"ContainerStarted","Data":"3f727f26d7807cbe13fca2cd338d00a43cb8dd16d016716bd4efd1f043aa98b5"}
Jul 23 16:24:45.701849 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:45.701797    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2" podStartSLOduration=1.7017793719999998 podStartE2EDuration="1.701779372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:45.69972188 +0000 UTC m=+539.778149770" watchObservedRunningTime="2026-07-23 16:24:45.701779372 +0000 UTC m=+539.780207263"
Jul 23 16:24:46.544098 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.544063    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:46.549613 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.549583    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:46.685758 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.685730    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:46.686805 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.686785    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:24:46.797954 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.797921    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"]
Jul 23 16:24:46.798946 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.798908    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:46.801147 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.801130    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"
Jul 23 16:24:46.803464 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.803447    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 16:24:46.803464 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.803458    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tgxk6\""
Jul 23 16:24:46.815854 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.815824    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"]
Jul 23 16:24:46.886121 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.886085    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"]
Jul 23 16:24:46.897453 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.897368    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:46.932452 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.932417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhms2\" (UniqueName: \"kubernetes.io/projected/cc5bd889-0c46-4565-8ff1-a61a096380bb-kube-api-access-bhms2\") pod \"limitador-limitador-64c94fd64f-l4r6c\" (UID: \"cc5bd889-0c46-4565-8ff1-a61a096380bb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"
Jul 23 16:24:46.932639 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.932553    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cc5bd889-0c46-4565-8ff1-a61a096380bb-config-file\") pod \"limitador-limitador-64c94fd64f-l4r6c\" (UID: \"cc5bd889-0c46-4565-8ff1-a61a096380bb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"
Jul 23 16:24:46.997820 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:46.997657    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:47.033700 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:47.033659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cc5bd889-0c46-4565-8ff1-a61a096380bb-config-file\") pod \"limitador-limitador-64c94fd64f-l4r6c\" (UID: \"cc5bd889-0c46-4565-8ff1-a61a096380bb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"
Jul 23 16:24:47.033897 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:47.033718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhms2\" (UniqueName: \"kubernetes.io/projected/cc5bd889-0c46-4565-8ff1-a61a096380bb-kube-api-access-bhms2\") pod \"limitador-limitador-64c94fd64f-l4r6c\" (UID: \"cc5bd889-0c46-4565-8ff1-a61a096380bb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"
Jul 23 16:24:47.034401 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:47.034382    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cc5bd889-0c46-4565-8ff1-a61a096380bb-config-file\") pod \"limitador-limitador-64c94fd64f-l4r6c\" (UID: \"cc5bd889-0c46-4565-8ff1-a61a096380bb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"
Jul 23 16:24:47.046007 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:47.045981    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhms2\" (UniqueName: \"kubernetes.io/projected/cc5bd889-0c46-4565-8ff1-a61a096380bb-kube-api-access-bhms2\") pod \"limitador-limitador-64c94fd64f-l4r6c\" (UID: \"cc5bd889-0c46-4565-8ff1-a61a096380bb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"
Jul 23 16:24:47.111789 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:47.111748    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"
Jul 23 16:24:47.248748 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:47.248717    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"]
Jul 23 16:24:47.251374 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:24:47.251344    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5bd889_0c46_4565_8ff1_a61a096380bb.slice/crio-8509748194a3f3a20e7531780669cff76e155cdd72d80827fa0d7409cc537051 WatchSource:0}: Error finding container 8509748194a3f3a20e7531780669cff76e155cdd72d80827fa0d7409cc537051: Status 404 returned error can't find the container with id 8509748194a3f3a20e7531780669cff76e155cdd72d80827fa0d7409cc537051
Jul 23 16:24:47.642757 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:47.642668    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:47.692605 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:47.692550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c" event={"ID":"cc5bd889-0c46-4565-8ff1-a61a096380bb","Type":"ContainerStarted","Data":"8509748194a3f3a20e7531780669cff76e155cdd72d80827fa0d7409cc537051"}
Jul 23 16:24:47.731687 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:47.731647    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:50.710016 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:50.709982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c" event={"ID":"cc5bd889-0c46-4565-8ff1-a61a096380bb","Type":"ContainerStarted","Data":"7910b101d083ec249dc779cc6f244703910d8c322f85311519dd10ad68da19bb"}
Jul 23 16:24:50.710398 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:50.710044    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"
Jul 23 16:24:50.724986 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:50.724932    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c" podStartSLOduration=2.004991096 podStartE2EDuration="4.724913983s" totalImagesPullingTime="2.719922887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:50.724247771 +0000 UTC m=+544.802675661" watchObservedRunningTime="2026-07-23 16:24:50.724913983 +0000 UTC m=+544.803341875"
Jul 23 16:24:50.828397 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:50.828355    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:50.933791 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:50.933756    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:51.225698 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:51.225658    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:51.326751 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:51.326698    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:54.228688 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:54.228650    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:54.328792 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:54.328755    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:57.857148 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:57.857117    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:57.955900 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:24:57.955858    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:01.721756 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:01.721726    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"
Jul 23 16:25:01.964270 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:01.964236    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"]
Jul 23 16:25:01.964468 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:01.964429    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c" podUID="cc5bd889-0c46-4565-8ff1-a61a096380bb" containerName="limitador" containerID="cri-o://7910b101d083ec249dc779cc6f244703910d8c322f85311519dd10ad68da19bb" gracePeriod=30
Jul 23 16:25:02.768035 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:02.768003    2576 generic.go:356] "Generic (PLEG): container finished" podID="cc5bd889-0c46-4565-8ff1-a61a096380bb" containerID="7910b101d083ec249dc779cc6f244703910d8c322f85311519dd10ad68da19bb" exitCode=0
Jul 23 16:25:02.768408 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:02.768080    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c" event={"ID":"cc5bd889-0c46-4565-8ff1-a61a096380bb","Type":"ContainerDied","Data":"7910b101d083ec249dc779cc6f244703910d8c322f85311519dd10ad68da19bb"}
Jul 23 16:25:02.916324 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:02.916297    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"
Jul 23 16:25:03.075853 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:03.075754    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cc5bd889-0c46-4565-8ff1-a61a096380bb-config-file\") pod \"cc5bd889-0c46-4565-8ff1-a61a096380bb\" (UID: \"cc5bd889-0c46-4565-8ff1-a61a096380bb\") "
Jul 23 16:25:03.075853 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:03.075838    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhms2\" (UniqueName: \"kubernetes.io/projected/cc5bd889-0c46-4565-8ff1-a61a096380bb-kube-api-access-bhms2\") pod \"cc5bd889-0c46-4565-8ff1-a61a096380bb\" (UID: \"cc5bd889-0c46-4565-8ff1-a61a096380bb\") "
Jul 23 16:25:03.076104 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:03.076082    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc5bd889-0c46-4565-8ff1-a61a096380bb-config-file" (OuterVolumeSpecName: "config-file") pod "cc5bd889-0c46-4565-8ff1-a61a096380bb" (UID: "cc5bd889-0c46-4565-8ff1-a61a096380bb"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:25:03.077932 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:03.077896    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc5bd889-0c46-4565-8ff1-a61a096380bb-kube-api-access-bhms2" (OuterVolumeSpecName: "kube-api-access-bhms2") pod "cc5bd889-0c46-4565-8ff1-a61a096380bb" (UID: "cc5bd889-0c46-4565-8ff1-a61a096380bb"). InnerVolumeSpecName "kube-api-access-bhms2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:25:03.176656 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:03.176616    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cc5bd889-0c46-4565-8ff1-a61a096380bb-config-file\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:25:03.176656 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:03.176646    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhms2\" (UniqueName: \"kubernetes.io/projected/cc5bd889-0c46-4565-8ff1-a61a096380bb-kube-api-access-bhms2\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:25:03.775121 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:03.775091    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"
Jul 23 16:25:03.775542 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:03.775089    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4r6c" event={"ID":"cc5bd889-0c46-4565-8ff1-a61a096380bb","Type":"ContainerDied","Data":"8509748194a3f3a20e7531780669cff76e155cdd72d80827fa0d7409cc537051"}
Jul 23 16:25:03.775542 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:03.775232    2576 scope.go:117] "RemoveContainer" containerID="7910b101d083ec249dc779cc6f244703910d8c322f85311519dd10ad68da19bb"
Jul 23 16:25:03.811617 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:03.811580    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"]
Jul 23 16:25:03.823562 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:03.823531    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4r6c"]
Jul 23 16:25:04.492816 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:04.492782    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc5bd889-0c46-4565-8ff1-a61a096380bb" path="/var/lib/kubelet/pods/cc5bd889-0c46-4565-8ff1-a61a096380bb/volumes"
Jul 23 16:25:08.176190 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.176158    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:08.301882 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.301843    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:08.589452 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.589378    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd"]
Jul 23 16:25:08.589782 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.589766    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc5bd889-0c46-4565-8ff1-a61a096380bb" containerName="limitador"
Jul 23 16:25:08.589826 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.589784    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc5bd889-0c46-4565-8ff1-a61a096380bb" containerName="limitador"
Jul 23 16:25:08.589871 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.589861    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc5bd889-0c46-4565-8ff1-a61a096380bb" containerName="limitador"
Jul 23 16:25:08.592825 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.592803    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd"
Jul 23 16:25:08.594907 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.594879    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 23 16:25:08.594907 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.594906    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 16:25:08.595102 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.594964    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 16:25:08.595384 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.595362    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qrwrv\""
Jul 23 16:25:08.602789 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.602763    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd"]
Jul 23 16:25:08.629204 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.629174    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:08.722116 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.722079    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/de5a045d-c56f-4f01-b8c3-8d293a205672-data\") pod \"postgres-69fb4594cf-r8hmd\" (UID: \"de5a045d-c56f-4f01-b8c3-8d293a205672\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd"
Jul 23 16:25:08.722288 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.722127    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxk4f\" (UniqueName: \"kubernetes.io/projected/de5a045d-c56f-4f01-b8c3-8d293a205672-kube-api-access-bxk4f\") pod \"postgres-69fb4594cf-r8hmd\" (UID: \"de5a045d-c56f-4f01-b8c3-8d293a205672\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd"
Jul 23 16:25:08.823301 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.823264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxk4f\" (UniqueName: \"kubernetes.io/projected/de5a045d-c56f-4f01-b8c3-8d293a205672-kube-api-access-bxk4f\") pod \"postgres-69fb4594cf-r8hmd\" (UID: \"de5a045d-c56f-4f01-b8c3-8d293a205672\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd"
Jul 23 16:25:08.823473 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.823389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/de5a045d-c56f-4f01-b8c3-8d293a205672-data\") pod \"postgres-69fb4594cf-r8hmd\" (UID: \"de5a045d-c56f-4f01-b8c3-8d293a205672\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd"
Jul 23 16:25:08.823804 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.823786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/de5a045d-c56f-4f01-b8c3-8d293a205672-data\") pod \"postgres-69fb4594cf-r8hmd\" (UID: \"de5a045d-c56f-4f01-b8c3-8d293a205672\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd"
Jul 23 16:25:08.831529 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.831490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxk4f\" (UniqueName: \"kubernetes.io/projected/de5a045d-c56f-4f01-b8c3-8d293a205672-kube-api-access-bxk4f\") pod \"postgres-69fb4594cf-r8hmd\" (UID: \"de5a045d-c56f-4f01-b8c3-8d293a205672\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd"
Jul 23 16:25:08.905474 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:08.905380    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd"
Jul 23 16:25:09.037418 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:09.037393    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd"]
Jul 23 16:25:09.040107 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:25:09.040081    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde5a045d_c56f_4f01_b8c3_8d293a205672.slice/crio-0e4feca03a4d14362013d1144d7dea700b61c9f22b30b61655f9e311b1b1688b WatchSource:0}: Error finding container 0e4feca03a4d14362013d1144d7dea700b61c9f22b30b61655f9e311b1b1688b: Status 404 returned error can't find the container with id 0e4feca03a4d14362013d1144d7dea700b61c9f22b30b61655f9e311b1b1688b
Jul 23 16:25:09.804764 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:09.804728    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd" event={"ID":"de5a045d-c56f-4f01-b8c3-8d293a205672","Type":"ContainerStarted","Data":"0e4feca03a4d14362013d1144d7dea700b61c9f22b30b61655f9e311b1b1688b"}
Jul 23 16:25:14.832012 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:14.831967    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd" event={"ID":"de5a045d-c56f-4f01-b8c3-8d293a205672","Type":"ContainerStarted","Data":"e9200260d2c0ab7d160e5fd60b9e8815d14cc55533a704b7e1e5cf2929be188c"}
Jul 23 16:25:14.832406 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:14.832028    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd"
Jul 23 16:25:14.846364 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:14.846309    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd" podStartSLOduration=1.8888986079999999 podStartE2EDuration="6.846288951s" totalImagesPullingTime="4.957390343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:25:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:25:14.845280332 +0000 UTC m=+568.923708223" watchObservedRunningTime="2026-07-23 16:25:14.846288951 +0000 UTC m=+568.924716843"
Jul 23 16:25:20.865801 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:20.865770    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r8hmd"
Jul 23 16:25:21.248372 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:21.248334    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:21.417049 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:21.417008    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:28.450278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.450242    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:28.458413 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.458383    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-698cb77965-9ktxm"]
Jul 23 16:25:28.461445 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.461423    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698cb77965-9ktxm"
Jul 23 16:25:28.467430 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.467407    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-l946g\""
Jul 23 16:25:28.467635 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.467410    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 16:25:28.467848 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.467835    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 16:25:28.474909 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.474885    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-698cb77965-9ktxm"]
Jul 23 16:25:28.555960 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.555918    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:28.605494 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.605461    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c4e3be9-58e1-4ef2-9194-2bca694430b7-webhook-cert\") pod \"maas-controller-698cb77965-9ktxm\" (UID: \"1c4e3be9-58e1-4ef2-9194-2bca694430b7\") " pod="opendatahub/maas-controller-698cb77965-9ktxm"
Jul 23 16:25:28.605494 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.605521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vjbb\" (UniqueName: \"kubernetes.io/projected/1c4e3be9-58e1-4ef2-9194-2bca694430b7-kube-api-access-4vjbb\") pod \"maas-controller-698cb77965-9ktxm\" (UID: \"1c4e3be9-58e1-4ef2-9194-2bca694430b7\") " pod="opendatahub/maas-controller-698cb77965-9ktxm"
Jul 23 16:25:28.659009 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.658968    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:28.668728 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.668698    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-857f74fb4d-jzzrs"]
Jul 23 16:25:28.670953 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.670937    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-857f74fb4d-jzzrs"
Jul 23 16:25:28.684968 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.684931    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-857f74fb4d-jzzrs"]
Jul 23 16:25:28.706182 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.706094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c4e3be9-58e1-4ef2-9194-2bca694430b7-webhook-cert\") pod \"maas-controller-698cb77965-9ktxm\" (UID: \"1c4e3be9-58e1-4ef2-9194-2bca694430b7\") " pod="opendatahub/maas-controller-698cb77965-9ktxm"
Jul 23 16:25:28.706182 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.706138    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vjbb\" (UniqueName: \"kubernetes.io/projected/1c4e3be9-58e1-4ef2-9194-2bca694430b7-kube-api-access-4vjbb\") pod \"maas-controller-698cb77965-9ktxm\" (UID: \"1c4e3be9-58e1-4ef2-9194-2bca694430b7\") " pod="opendatahub/maas-controller-698cb77965-9ktxm"
Jul 23 16:25:28.708496 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.708477    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c4e3be9-58e1-4ef2-9194-2bca694430b7-webhook-cert\") pod \"maas-controller-698cb77965-9ktxm\" (UID: \"1c4e3be9-58e1-4ef2-9194-2bca694430b7\") " pod="opendatahub/maas-controller-698cb77965-9ktxm"
Jul 23 16:25:28.713119 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.713098    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vjbb\" (UniqueName: \"kubernetes.io/projected/1c4e3be9-58e1-4ef2-9194-2bca694430b7-kube-api-access-4vjbb\") pod \"maas-controller-698cb77965-9ktxm\" (UID: \"1c4e3be9-58e1-4ef2-9194-2bca694430b7\") " pod="opendatahub/maas-controller-698cb77965-9ktxm"
Jul 23 16:25:28.772299 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.772263    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698cb77965-9ktxm"
Jul 23 16:25:28.806906 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.806870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpb9s\" (UniqueName: \"kubernetes.io/projected/8b6e9716-ca50-4813-b811-24fd0dbd56a2-kube-api-access-tpb9s\") pod \"maas-controller-857f74fb4d-jzzrs\" (UID: \"8b6e9716-ca50-4813-b811-24fd0dbd56a2\") " pod="opendatahub/maas-controller-857f74fb4d-jzzrs"
Jul 23 16:25:28.807085 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.806945    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b6e9716-ca50-4813-b811-24fd0dbd56a2-webhook-cert\") pod \"maas-controller-857f74fb4d-jzzrs\" (UID: \"8b6e9716-ca50-4813-b811-24fd0dbd56a2\") " pod="opendatahub/maas-controller-857f74fb4d-jzzrs"
Jul 23 16:25:28.905752 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.905726    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-698cb77965-9ktxm"]
Jul 23 16:25:28.907823 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.907797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b6e9716-ca50-4813-b811-24fd0dbd56a2-webhook-cert\") pod \"maas-controller-857f74fb4d-jzzrs\" (UID: \"8b6e9716-ca50-4813-b811-24fd0dbd56a2\") " pod="opendatahub/maas-controller-857f74fb4d-jzzrs"
Jul 23 16:25:28.907953 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:25:28.907877    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4e3be9_58e1_4ef2_9194_2bca694430b7.slice/crio-2fc1adc1b25f8f4797a5da3b0395426e4d98f6704fd4d7a5b2cefdf758c211f9 WatchSource:0}: Error finding container 2fc1adc1b25f8f4797a5da3b0395426e4d98f6704fd4d7a5b2cefdf758c211f9: Status 404 returned error can't find the container with id 2fc1adc1b25f8f4797a5da3b0395426e4d98f6704fd4d7a5b2cefdf758c211f9
Jul 23 16:25:28.907953 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.907885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpb9s\" (UniqueName: \"kubernetes.io/projected/8b6e9716-ca50-4813-b811-24fd0dbd56a2-kube-api-access-tpb9s\") pod \"maas-controller-857f74fb4d-jzzrs\" (UID: \"8b6e9716-ca50-4813-b811-24fd0dbd56a2\") " pod="opendatahub/maas-controller-857f74fb4d-jzzrs"
Jul 23 16:25:28.910592 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.910569    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b6e9716-ca50-4813-b811-24fd0dbd56a2-webhook-cert\") pod \"maas-controller-857f74fb4d-jzzrs\" (UID: \"8b6e9716-ca50-4813-b811-24fd0dbd56a2\") " pod="opendatahub/maas-controller-857f74fb4d-jzzrs"
Jul 23 16:25:28.915854 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.915819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpb9s\" (UniqueName: \"kubernetes.io/projected/8b6e9716-ca50-4813-b811-24fd0dbd56a2-kube-api-access-tpb9s\") pod \"maas-controller-857f74fb4d-jzzrs\" (UID: \"8b6e9716-ca50-4813-b811-24fd0dbd56a2\") " pod="opendatahub/maas-controller-857f74fb4d-jzzrs"
Jul 23 16:25:28.980964 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:28.980876    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-857f74fb4d-jzzrs"
Jul 23 16:25:29.132890 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:29.132860    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-857f74fb4d-jzzrs"]
Jul 23 16:25:29.135491 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:25:29.135466    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6e9716_ca50_4813_b811_24fd0dbd56a2.slice/crio-396e3bde312d288f924371c07a34703a06d6e3a3d473c1c61781cc81b2f60ff7 WatchSource:0}: Error finding container 396e3bde312d288f924371c07a34703a06d6e3a3d473c1c61781cc81b2f60ff7: Status 404 returned error can't find the container with id 396e3bde312d288f924371c07a34703a06d6e3a3d473c1c61781cc81b2f60ff7
Jul 23 16:25:29.906309 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:29.906184    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698cb77965-9ktxm" event={"ID":"1c4e3be9-58e1-4ef2-9194-2bca694430b7","Type":"ContainerStarted","Data":"2fc1adc1b25f8f4797a5da3b0395426e4d98f6704fd4d7a5b2cefdf758c211f9"}
Jul 23 16:25:29.908893 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:29.908840    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-857f74fb4d-jzzrs" event={"ID":"8b6e9716-ca50-4813-b811-24fd0dbd56a2","Type":"ContainerStarted","Data":"396e3bde312d288f924371c07a34703a06d6e3a3d473c1c61781cc81b2f60ff7"}
Jul 23 16:25:31.736789 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:31.736755    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:31.836726 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:31.836621    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:31.920921 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:31.920883    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-857f74fb4d-jzzrs" event={"ID":"8b6e9716-ca50-4813-b811-24fd0dbd56a2","Type":"ContainerStarted","Data":"0ba6c434516918b36b130b7493d67822c76a34af08352f0c2cc73d50974af260"}
Jul 23 16:25:31.921133 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:31.921040    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-857f74fb4d-jzzrs"
Jul 23 16:25:31.922335 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:31.922304    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698cb77965-9ktxm" event={"ID":"1c4e3be9-58e1-4ef2-9194-2bca694430b7","Type":"ContainerStarted","Data":"1b9b393765a1e66d4175db69e40523a3cc6c90f26eaae54ed1edd932d36af1d5"}
Jul 23 16:25:31.922473 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:31.922438    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-698cb77965-9ktxm"
Jul 23 16:25:31.939186 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:31.939132    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-857f74fb4d-jzzrs" podStartSLOduration=1.540030317 podStartE2EDuration="3.939113593s" totalImagesPullingTime="2.399083276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:25:31.937331706 +0000 UTC m=+586.015759619" watchObservedRunningTime="2026-07-23 16:25:31.939113593 +0000 UTC m=+586.017541486"
Jul 23 16:25:31.959898 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:31.959839    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-698cb77965-9ktxm" podStartSLOduration=1.339953095 podStartE2EDuration="3.959819235s" totalImagesPullingTime="2.61986614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:25:31.9574624 +0000 UTC m=+586.035890291" watchObservedRunningTime="2026-07-23 16:25:31.959819235 +0000 UTC m=+586.038247125"
Jul 23 16:25:42.929955 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:42.929918    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-698cb77965-9ktxm"
Jul 23 16:25:42.930378 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:42.929991    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-857f74fb4d-jzzrs"
Jul 23 16:25:42.995558 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:42.995520    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-698cb77965-9ktxm"]
Jul 23 16:25:42.995749 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:42.995720    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-698cb77965-9ktxm" podUID="1c4e3be9-58e1-4ef2-9194-2bca694430b7" containerName="manager" containerID="cri-o://1b9b393765a1e66d4175db69e40523a3cc6c90f26eaae54ed1edd932d36af1d5" gracePeriod=30
Jul 23 16:25:43.243634 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.243605    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698cb77965-9ktxm"
Jul 23 16:25:43.347638 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.347605    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vjbb\" (UniqueName: \"kubernetes.io/projected/1c4e3be9-58e1-4ef2-9194-2bca694430b7-kube-api-access-4vjbb\") pod \"1c4e3be9-58e1-4ef2-9194-2bca694430b7\" (UID: \"1c4e3be9-58e1-4ef2-9194-2bca694430b7\") "
Jul 23 16:25:43.347824 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.347658    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c4e3be9-58e1-4ef2-9194-2bca694430b7-webhook-cert\") pod \"1c4e3be9-58e1-4ef2-9194-2bca694430b7\" (UID: \"1c4e3be9-58e1-4ef2-9194-2bca694430b7\") "
Jul 23 16:25:43.349831 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.349800    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c4e3be9-58e1-4ef2-9194-2bca694430b7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1c4e3be9-58e1-4ef2-9194-2bca694430b7" (UID: "1c4e3be9-58e1-4ef2-9194-2bca694430b7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:25:43.349831 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.349825    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c4e3be9-58e1-4ef2-9194-2bca694430b7-kube-api-access-4vjbb" (OuterVolumeSpecName: "kube-api-access-4vjbb") pod "1c4e3be9-58e1-4ef2-9194-2bca694430b7" (UID: "1c4e3be9-58e1-4ef2-9194-2bca694430b7"). InnerVolumeSpecName "kube-api-access-4vjbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:25:43.449169 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.449128    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c4e3be9-58e1-4ef2-9194-2bca694430b7-webhook-cert\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:25:43.449169 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.449164    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vjbb\" (UniqueName: \"kubernetes.io/projected/1c4e3be9-58e1-4ef2-9194-2bca694430b7-kube-api-access-4vjbb\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:25:43.982441 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.982401    2576 generic.go:356] "Generic (PLEG): container finished" podID="1c4e3be9-58e1-4ef2-9194-2bca694430b7" containerID="1b9b393765a1e66d4175db69e40523a3cc6c90f26eaae54ed1edd932d36af1d5" exitCode=0
Jul 23 16:25:43.982868 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.982452    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698cb77965-9ktxm"
Jul 23 16:25:43.982868 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.982487    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698cb77965-9ktxm" event={"ID":"1c4e3be9-58e1-4ef2-9194-2bca694430b7","Type":"ContainerDied","Data":"1b9b393765a1e66d4175db69e40523a3cc6c90f26eaae54ed1edd932d36af1d5"}
Jul 23 16:25:43.982868 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.982553    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698cb77965-9ktxm" event={"ID":"1c4e3be9-58e1-4ef2-9194-2bca694430b7","Type":"ContainerDied","Data":"2fc1adc1b25f8f4797a5da3b0395426e4d98f6704fd4d7a5b2cefdf758c211f9"}
Jul 23 16:25:43.982868 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.982576    2576 scope.go:117] "RemoveContainer" containerID="1b9b393765a1e66d4175db69e40523a3cc6c90f26eaae54ed1edd932d36af1d5"
Jul 23 16:25:43.991974 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.991955    2576 scope.go:117] "RemoveContainer" containerID="1b9b393765a1e66d4175db69e40523a3cc6c90f26eaae54ed1edd932d36af1d5"
Jul 23 16:25:43.992254 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:25:43.992236    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b9b393765a1e66d4175db69e40523a3cc6c90f26eaae54ed1edd932d36af1d5\": container with ID starting with 1b9b393765a1e66d4175db69e40523a3cc6c90f26eaae54ed1edd932d36af1d5 not found: ID does not exist" containerID="1b9b393765a1e66d4175db69e40523a3cc6c90f26eaae54ed1edd932d36af1d5"
Jul 23 16:25:43.992300 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:43.992264    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9b393765a1e66d4175db69e40523a3cc6c90f26eaae54ed1edd932d36af1d5"} err="failed to get container status \"1b9b393765a1e66d4175db69e40523a3cc6c90f26eaae54ed1edd932d36af1d5\": rpc error: code = NotFound desc = could not find container \"1b9b393765a1e66d4175db69e40523a3cc6c90f26eaae54ed1edd932d36af1d5\": container with ID starting with 1b9b393765a1e66d4175db69e40523a3cc6c90f26eaae54ed1edd932d36af1d5 not found: ID does not exist"
Jul 23 16:25:44.003368 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:44.003335    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-698cb77965-9ktxm"]
Jul 23 16:25:44.006820 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:44.006793    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-698cb77965-9ktxm"]
Jul 23 16:25:44.492085 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:44.492051    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c4e3be9-58e1-4ef2-9194-2bca694430b7" path="/var/lib/kubelet/pods/1c4e3be9-58e1-4ef2-9194-2bca694430b7/volumes"
Jul 23 16:25:46.343281 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:46.343254    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:25:46.343750 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:25:46.343736    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:26:04.474633 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:04.474588    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:05.258965 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.258930    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"]
Jul 23 16:26:05.259301 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.259288    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4e3be9-58e1-4ef2-9194-2bca694430b7" containerName="manager"
Jul 23 16:26:05.259342 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.259302    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4e3be9-58e1-4ef2-9194-2bca694430b7" containerName="manager"
Jul 23 16:26:05.259380 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.259357    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c4e3be9-58e1-4ef2-9194-2bca694430b7" containerName="manager"
Jul 23 16:26:05.261249 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.261231    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"
Jul 23 16:26:05.263097 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.263072    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 16:26:05.263334 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.263320    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nlccs\""
Jul 23 16:26:05.272014 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.271986    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"]
Jul 23 16:26:05.337689 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.337649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf5k7\" (UniqueName: \"kubernetes.io/projected/8772159d-04ee-44cd-9ac6-18b8e8e5f0cd-kube-api-access-bf5k7\") pod \"maas-api-57f7d5bf49-tr76n\" (UID: \"8772159d-04ee-44cd-9ac6-18b8e8e5f0cd\") " pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"
Jul 23 16:26:05.337873 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.337771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8772159d-04ee-44cd-9ac6-18b8e8e5f0cd-maas-api-tls\") pod \"maas-api-57f7d5bf49-tr76n\" (UID: \"8772159d-04ee-44cd-9ac6-18b8e8e5f0cd\") " pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"
Jul 23 16:26:05.337873 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.337803    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8772159d-04ee-44cd-9ac6-18b8e8e5f0cd-openshift-service-ca\") pod \"maas-api-57f7d5bf49-tr76n\" (UID: \"8772159d-04ee-44cd-9ac6-18b8e8e5f0cd\") " pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"
Jul 23 16:26:05.438689 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.438651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf5k7\" (UniqueName: \"kubernetes.io/projected/8772159d-04ee-44cd-9ac6-18b8e8e5f0cd-kube-api-access-bf5k7\") pod \"maas-api-57f7d5bf49-tr76n\" (UID: \"8772159d-04ee-44cd-9ac6-18b8e8e5f0cd\") " pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"
Jul 23 16:26:05.438877 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.438745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8772159d-04ee-44cd-9ac6-18b8e8e5f0cd-maas-api-tls\") pod \"maas-api-57f7d5bf49-tr76n\" (UID: \"8772159d-04ee-44cd-9ac6-18b8e8e5f0cd\") " pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"
Jul 23 16:26:05.438877 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.438769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8772159d-04ee-44cd-9ac6-18b8e8e5f0cd-openshift-service-ca\") pod \"maas-api-57f7d5bf49-tr76n\" (UID: \"8772159d-04ee-44cd-9ac6-18b8e8e5f0cd\") " pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"
Jul 23 16:26:05.439525 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.439487    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8772159d-04ee-44cd-9ac6-18b8e8e5f0cd-openshift-service-ca\") pod \"maas-api-57f7d5bf49-tr76n\" (UID: \"8772159d-04ee-44cd-9ac6-18b8e8e5f0cd\") " pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"
Jul 23 16:26:05.441299 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.441273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8772159d-04ee-44cd-9ac6-18b8e8e5f0cd-maas-api-tls\") pod \"maas-api-57f7d5bf49-tr76n\" (UID: \"8772159d-04ee-44cd-9ac6-18b8e8e5f0cd\") " pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"
Jul 23 16:26:05.445932 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.445902    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf5k7\" (UniqueName: \"kubernetes.io/projected/8772159d-04ee-44cd-9ac6-18b8e8e5f0cd-kube-api-access-bf5k7\") pod \"maas-api-57f7d5bf49-tr76n\" (UID: \"8772159d-04ee-44cd-9ac6-18b8e8e5f0cd\") " pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"
Jul 23 16:26:05.572172 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.572077    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"
Jul 23 16:26:05.721219 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.721192    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"]
Jul 23 16:26:05.724316 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:26:05.724283    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8772159d_04ee_44cd_9ac6_18b8e8e5f0cd.slice/crio-6ada590ac5abf17799e232b095362f2e4be2d63526c0ef56f3ddd75611007efd WatchSource:0}: Error finding container 6ada590ac5abf17799e232b095362f2e4be2d63526c0ef56f3ddd75611007efd: Status 404 returned error can't find the container with id 6ada590ac5abf17799e232b095362f2e4be2d63526c0ef56f3ddd75611007efd
Jul 23 16:26:05.769955 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.769922    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-lbgk4"]
Jul 23 16:26:05.773258 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.773241    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-lbgk4"
Jul 23 16:26:05.775603 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.775577    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 16:26:05.775724 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.775577    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9rbht\""
Jul 23 16:26:05.782580 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.782553    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-lbgk4"]
Jul 23 16:26:05.791406 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.791375    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-75t8f"]
Jul 23 16:26:05.793768 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.793744    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-75t8f"
Jul 23 16:26:05.805679 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.805653    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-75t8f"]
Jul 23 16:26:05.842453 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.842373    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74e04e98-29ee-4c3f-bd17-241b4592420e-plugins-config-volume\") pod \"payload-processing-5bf47cd988-75t8f\" (UID: \"74e04e98-29ee-4c3f-bd17-241b4592420e\") " pod="openshift-ingress/payload-processing-5bf47cd988-75t8f"
Jul 23 16:26:05.842453 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.842417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tnph\" (UniqueName: \"kubernetes.io/projected/6b0ea791-826a-421c-9d12-de46db9816c2-kube-api-access-2tnph\") pod \"payload-pre-processing-7677b774bb-lbgk4\" (UID: \"6b0ea791-826a-421c-9d12-de46db9816c2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-lbgk4"
Jul 23 16:26:05.842453 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.842455    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr2zz\" (UniqueName: \"kubernetes.io/projected/74e04e98-29ee-4c3f-bd17-241b4592420e-kube-api-access-zr2zz\") pod \"payload-processing-5bf47cd988-75t8f\" (UID: \"74e04e98-29ee-4c3f-bd17-241b4592420e\") " pod="openshift-ingress/payload-processing-5bf47cd988-75t8f"
Jul 23 16:26:05.842737 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.842623    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b0ea791-826a-421c-9d12-de46db9816c2-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-lbgk4\" (UID: \"6b0ea791-826a-421c-9d12-de46db9816c2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-lbgk4"
Jul 23 16:26:05.943913 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.943873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr2zz\" (UniqueName: \"kubernetes.io/projected/74e04e98-29ee-4c3f-bd17-241b4592420e-kube-api-access-zr2zz\") pod \"payload-processing-5bf47cd988-75t8f\" (UID: \"74e04e98-29ee-4c3f-bd17-241b4592420e\") " pod="openshift-ingress/payload-processing-5bf47cd988-75t8f"
Jul 23 16:26:05.944101 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.943996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b0ea791-826a-421c-9d12-de46db9816c2-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-lbgk4\" (UID: \"6b0ea791-826a-421c-9d12-de46db9816c2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-lbgk4"
Jul 23 16:26:05.944101 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.944036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74e04e98-29ee-4c3f-bd17-241b4592420e-plugins-config-volume\") pod \"payload-processing-5bf47cd988-75t8f\" (UID: \"74e04e98-29ee-4c3f-bd17-241b4592420e\") " pod="openshift-ingress/payload-processing-5bf47cd988-75t8f"
Jul 23 16:26:05.944101 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.944066    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tnph\" (UniqueName: \"kubernetes.io/projected/6b0ea791-826a-421c-9d12-de46db9816c2-kube-api-access-2tnph\") pod \"payload-pre-processing-7677b774bb-lbgk4\" (UID: \"6b0ea791-826a-421c-9d12-de46db9816c2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-lbgk4"
Jul 23 16:26:05.944860 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.944836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74e04e98-29ee-4c3f-bd17-241b4592420e-plugins-config-volume\") pod \"payload-processing-5bf47cd988-75t8f\" (UID: \"74e04e98-29ee-4c3f-bd17-241b4592420e\") " pod="openshift-ingress/payload-processing-5bf47cd988-75t8f"
Jul 23 16:26:05.945022 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.944975    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b0ea791-826a-421c-9d12-de46db9816c2-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-lbgk4\" (UID: \"6b0ea791-826a-421c-9d12-de46db9816c2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-lbgk4"
Jul 23 16:26:05.951757 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.951703    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr2zz\" (UniqueName: \"kubernetes.io/projected/74e04e98-29ee-4c3f-bd17-241b4592420e-kube-api-access-zr2zz\") pod \"payload-processing-5bf47cd988-75t8f\" (UID: \"74e04e98-29ee-4c3f-bd17-241b4592420e\") " pod="openshift-ingress/payload-processing-5bf47cd988-75t8f"
Jul 23 16:26:05.951913 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:05.951892    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tnph\" (UniqueName: \"kubernetes.io/projected/6b0ea791-826a-421c-9d12-de46db9816c2-kube-api-access-2tnph\") pod \"payload-pre-processing-7677b774bb-lbgk4\" (UID: \"6b0ea791-826a-421c-9d12-de46db9816c2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-lbgk4"
Jul 23 16:26:06.085610 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:06.085580    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-lbgk4"
Jul 23 16:26:06.088125 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:06.088097    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n" event={"ID":"8772159d-04ee-44cd-9ac6-18b8e8e5f0cd","Type":"ContainerStarted","Data":"6ada590ac5abf17799e232b095362f2e4be2d63526c0ef56f3ddd75611007efd"}
Jul 23 16:26:06.105126 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:06.105093    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:06.106970 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:06.106943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-75t8f"
Jul 23 16:26:06.252282 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:06.252060    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-lbgk4"]
Jul 23 16:26:06.254232 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:26:06.254190    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0ea791_826a_421c_9d12_de46db9816c2.slice/crio-64c18125d3a1654467ea893484f1a56903d04c44eaa9b3b6395691549831221b WatchSource:0}: Error finding container 64c18125d3a1654467ea893484f1a56903d04c44eaa9b3b6395691549831221b: Status 404 returned error can't find the container with id 64c18125d3a1654467ea893484f1a56903d04c44eaa9b3b6395691549831221b
Jul 23 16:26:06.275673 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:06.275641    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-75t8f"]
Jul 23 16:26:06.277881 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:26:06.277854    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e04e98_29ee_4c3f_bd17_241b4592420e.slice/crio-16cd011b792ace2c8ed38671316bb107fad4ead553fc12c448d8c7a2a3070131 WatchSource:0}: Error finding container 16cd011b792ace2c8ed38671316bb107fad4ead553fc12c448d8c7a2a3070131: Status 404 returned error can't find the container with id 16cd011b792ace2c8ed38671316bb107fad4ead553fc12c448d8c7a2a3070131
Jul 23 16:26:07.099101 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:07.099046    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-lbgk4" event={"ID":"6b0ea791-826a-421c-9d12-de46db9816c2","Type":"ContainerStarted","Data":"64c18125d3a1654467ea893484f1a56903d04c44eaa9b3b6395691549831221b"}
Jul 23 16:26:07.101214 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:07.101183    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-75t8f" event={"ID":"74e04e98-29ee-4c3f-bd17-241b4592420e","Type":"ContainerStarted","Data":"16cd011b792ace2c8ed38671316bb107fad4ead553fc12c448d8c7a2a3070131"}
Jul 23 16:26:08.109707 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:08.109633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n" event={"ID":"8772159d-04ee-44cd-9ac6-18b8e8e5f0cd","Type":"ContainerStarted","Data":"8144d9ec2d7924add08a5ac400bfca7fb9acfe263adb4fe4e0fec14d1503a4dd"}
Jul 23 16:26:08.110176 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:08.109859    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"
Jul 23 16:26:08.126786 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:08.126548    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n" podStartSLOduration=0.943177102 podStartE2EDuration="3.126524214s" totalImagesPullingTime="2.183347112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:26:08.12523391 +0000 UTC m=+622.203661866" watchObservedRunningTime="2026-07-23 16:26:08.126524214 +0000 UTC m=+622.204952105"
Jul 23 16:26:09.116819 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:09.116781    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-75t8f" event={"ID":"74e04e98-29ee-4c3f-bd17-241b4592420e","Type":"ContainerStarted","Data":"d2ee67a6b7a4536eb6de47c3459b801c81376b73bf7f3a763345799454839249"}
Jul 23 16:26:09.117275 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:09.116939    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-75t8f"
Jul 23 16:26:09.118376 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:09.118348    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-lbgk4" event={"ID":"6b0ea791-826a-421c-9d12-de46db9816c2","Type":"ContainerStarted","Data":"070789aab14b4b636de1c565350843a68abd54dba92fb2b3f95506a5fdb82e44"}
Jul 23 16:26:09.118520 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:09.118494    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-lbgk4"
Jul 23 16:26:09.132972 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:09.132923    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-75t8f" podStartSLOduration=1.784435823 podStartE2EDuration="4.132907599s" totalImagesPullingTime="2.348471776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:26:09.131829062 +0000 UTC m=+623.210256954" watchObservedRunningTime="2026-07-23 16:26:09.132907599 +0000 UTC m=+623.211335489"
Jul 23 16:26:09.150532 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:09.147681    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-lbgk4" podStartSLOduration=1.740153879 podStartE2EDuration="4.147658991s" totalImagesPullingTime="2.407505112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:26:09.147057888 +0000 UTC m=+623.225485780" watchObservedRunningTime="2026-07-23 16:26:09.147658991 +0000 UTC m=+623.226086888"
Jul 23 16:26:09.646921 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:09.646876    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:09.744921 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:09.744874    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:14.124072 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:14.124041    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-57f7d5bf49-tr76n"
Jul 23 16:26:14.150621 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:14.150576    2576 generic.go:356] "Generic (PLEG): container finished" podID="e919fea6-ce69-4f1a-b915-32952ac61bdb" containerID="33e4d035d423d4a2b3cbc96614244ccda8e9d6e363e4b857f68a823079076eb4" exitCode=0
Jul 23 16:26:14.150805 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:14.150641    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2" event={"ID":"e919fea6-ce69-4f1a-b915-32952ac61bdb","Type":"ContainerDied","Data":"33e4d035d423d4a2b3cbc96614244ccda8e9d6e363e4b857f68a823079076eb4"}
Jul 23 16:26:14.151192 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:14.151168    2576 scope.go:117] "RemoveContainer" containerID="33e4d035d423d4a2b3cbc96614244ccda8e9d6e363e4b857f68a823079076eb4"
Jul 23 16:26:14.152525 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:14.152472    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 16:26:14.152637 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:14.152585    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 16:26:14.152691 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:14.152634    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 23 16:26:15.142728 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:15.142686    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:15.162485 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:15.162441    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2" event={"ID":"e919fea6-ce69-4f1a-b915-32952ac61bdb","Type":"ContainerStarted","Data":"6fd3515d112b14f5aba0ca3de73c14b403d9e101410841b2c8d560cfa2365715"}
Jul 23 16:26:15.220157 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:15.220105    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:15.543897 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:15.543809    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:26:15.545168 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:15.545124    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8qpg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 23 16:26:15.545339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:15.545198    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2" podUID="e919fea6-ce69-4f1a-b915-32952ac61bdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 23 16:26:16.551530 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:16.550682    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8qpg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 23 16:26:16.551530 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:16.550764    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2" podUID="e919fea6-ce69-4f1a-b915-32952ac61bdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 23 16:26:16.686639 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:16.686607    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:26:17.544060 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:17.544020    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8qpg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 23 16:26:17.544342 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:17.544313    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2" podUID="e919fea6-ce69-4f1a-b915-32952ac61bdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 23 16:26:18.544089 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:18.544047    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8qpg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 23 16:26:18.544728 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:18.544690    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2" podUID="e919fea6-ce69-4f1a-b915-32952ac61bdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 23 16:26:19.548281 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:19.548248    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:26:19.549246 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:19.549228    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8qpg2"
Jul 23 16:26:20.126273 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:20.126239    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-lbgk4"
Jul 23 16:26:20.126473 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:20.126416    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-75t8f"
Jul 23 16:26:37.581395 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:37.581361    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:47.136787 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:47.136740    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:47.236723 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:47.236692    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:48.341625 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.341590    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"]
Jul 23 16:26:48.345272 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.345245    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.347769 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.347725    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jvnq5\""
Jul 23 16:26:48.347769 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.347759    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 23 16:26:48.347993 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.347760    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 16:26:48.347993 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.347769    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 16:26:48.354812 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.354785    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"]
Jul 23 16:26:48.366555 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.366523    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:48.447105 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.447062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe59aabc-868d-4bbb-8270-1e163ab8a069-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.447105 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.447109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn6w7\" (UniqueName: \"kubernetes.io/projected/fe59aabc-868d-4bbb-8270-1e163ab8a069-kube-api-access-pn6w7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.447356 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.447211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe59aabc-868d-4bbb-8270-1e163ab8a069-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.447356 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.447255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe59aabc-868d-4bbb-8270-1e163ab8a069-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.447356 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.447325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe59aabc-868d-4bbb-8270-1e163ab8a069-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.447356 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.447343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe59aabc-868d-4bbb-8270-1e163ab8a069-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.548135 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.548100    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn6w7\" (UniqueName: \"kubernetes.io/projected/fe59aabc-868d-4bbb-8270-1e163ab8a069-kube-api-access-pn6w7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.548302 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.548177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe59aabc-868d-4bbb-8270-1e163ab8a069-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.548302 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.548214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe59aabc-868d-4bbb-8270-1e163ab8a069-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.548302 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.548260    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe59aabc-868d-4bbb-8270-1e163ab8a069-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.548302 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.548287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe59aabc-868d-4bbb-8270-1e163ab8a069-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.548499 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.548332    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe59aabc-868d-4bbb-8270-1e163ab8a069-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.548760 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.548736    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe59aabc-868d-4bbb-8270-1e163ab8a069-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.548760 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.548755    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe59aabc-868d-4bbb-8270-1e163ab8a069-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.548895 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.548793    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe59aabc-868d-4bbb-8270-1e163ab8a069-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.550667 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.550641    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe59aabc-868d-4bbb-8270-1e163ab8a069-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.550886 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.550866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe59aabc-868d-4bbb-8270-1e163ab8a069-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.556467 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.556440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn6w7\" (UniqueName: \"kubernetes.io/projected/fe59aabc-868d-4bbb-8270-1e163ab8a069-kube-api-access-pn6w7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xzfg\" (UID: \"fe59aabc-868d-4bbb-8270-1e163ab8a069\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.657209 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.657117    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:48.796562 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.796535    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"]
Jul 23 16:26:48.799754 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:26:48.799718    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe59aabc_868d_4bbb_8270_1e163ab8a069.slice/crio-f29329ca0f46eb57ab200c6af3cc5d35a9c0205a5b61f151a6375d228edcbe83 WatchSource:0}: Error finding container f29329ca0f46eb57ab200c6af3cc5d35a9c0205a5b61f151a6375d228edcbe83: Status 404 returned error can't find the container with id f29329ca0f46eb57ab200c6af3cc5d35a9c0205a5b61f151a6375d228edcbe83
Jul 23 16:26:48.801302 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:48.801279    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:26:49.339900 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:49.339854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg" event={"ID":"fe59aabc-868d-4bbb-8270-1e163ab8a069","Type":"ContainerStarted","Data":"f29329ca0f46eb57ab200c6af3cc5d35a9c0205a5b61f151a6375d228edcbe83"}
Jul 23 16:26:50.346194 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:50.346149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg" event={"ID":"fe59aabc-868d-4bbb-8270-1e163ab8a069","Type":"ContainerStarted","Data":"b55831800c70081e97f512bff0a14f0591246d44f00a4a395ad6501c0da2d9d7"}
Jul 23 16:26:50.365148 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:50.365086    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg" podStartSLOduration=1.329740608 podStartE2EDuration="2.365067813s" totalImagesPullingTime="1.035327205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:26:50.36390474 +0000 UTC m=+664.442332645" watchObservedRunningTime="2026-07-23 16:26:50.365067813 +0000 UTC m=+664.443495703"
Jul 23 16:26:58.658143 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:58.658105    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:58.658587 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:58.658166    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:58.670849 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:58.670822    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:26:59.402063 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:26:59.402031    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xzfg"
Jul 23 16:27:08.328570 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.328496    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"]
Jul 23 16:27:08.332624 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.332601    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.334688 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.334668    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 23 16:27:08.341727 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.341697    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"]
Jul 23 16:27:08.353490 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.353446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:08.453790 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.453751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a873cc42-6ecd-42f8-b98a-3390c9bad22c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.453961 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.453802    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a873cc42-6ecd-42f8-b98a-3390c9bad22c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.453961 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.453822    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggd94\" (UniqueName: \"kubernetes.io/projected/a873cc42-6ecd-42f8-b98a-3390c9bad22c-kube-api-access-ggd94\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.453961 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.453914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a873cc42-6ecd-42f8-b98a-3390c9bad22c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.454078 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.453983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a873cc42-6ecd-42f8-b98a-3390c9bad22c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.454078 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.454005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a873cc42-6ecd-42f8-b98a-3390c9bad22c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.554922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.554882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a873cc42-6ecd-42f8-b98a-3390c9bad22c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.554922 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.554927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a873cc42-6ecd-42f8-b98a-3390c9bad22c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.555158 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.554975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a873cc42-6ecd-42f8-b98a-3390c9bad22c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.555158 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.555005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a873cc42-6ecd-42f8-b98a-3390c9bad22c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.555158 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.555021    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggd94\" (UniqueName: \"kubernetes.io/projected/a873cc42-6ecd-42f8-b98a-3390c9bad22c-kube-api-access-ggd94\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.555158 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.555066    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a873cc42-6ecd-42f8-b98a-3390c9bad22c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.555385 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.555355    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a873cc42-6ecd-42f8-b98a-3390c9bad22c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.555445 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.555367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a873cc42-6ecd-42f8-b98a-3390c9bad22c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.555445 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.555433    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a873cc42-6ecd-42f8-b98a-3390c9bad22c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.557416 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.557394    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a873cc42-6ecd-42f8-b98a-3390c9bad22c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.557599 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.557580    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a873cc42-6ecd-42f8-b98a-3390c9bad22c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.562361 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.562329    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggd94\" (UniqueName: \"kubernetes.io/projected/a873cc42-6ecd-42f8-b98a-3390c9bad22c-kube-api-access-ggd94\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4pdpk\" (UID: \"a873cc42-6ecd-42f8-b98a-3390c9bad22c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.644347 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.644239    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:08.785061 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:08.785034    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"]
Jul 23 16:27:08.787177 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:27:08.787152    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda873cc42_6ecd_42f8_b98a_3390c9bad22c.slice/crio-52028c5a2ac5ad34dda866d163ff8be42746a66e7f4b5d9fa466c990c1605695 WatchSource:0}: Error finding container 52028c5a2ac5ad34dda866d163ff8be42746a66e7f4b5d9fa466c990c1605695: Status 404 returned error can't find the container with id 52028c5a2ac5ad34dda866d163ff8be42746a66e7f4b5d9fa466c990c1605695
Jul 23 16:27:09.440867 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:09.440831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk" event={"ID":"a873cc42-6ecd-42f8-b98a-3390c9bad22c","Type":"ContainerStarted","Data":"b9d76c5e26ba7625af12add3e87521a296f15c5ba647afe7ca104fe4829c9dfe"}
Jul 23 16:27:09.441241 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:09.440886    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk" event={"ID":"a873cc42-6ecd-42f8-b98a-3390c9bad22c","Type":"ContainerStarted","Data":"52028c5a2ac5ad34dda866d163ff8be42746a66e7f4b5d9fa466c990c1605695"}
Jul 23 16:27:09.457733 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:09.457679    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk" podStartSLOduration=1.241368261 podStartE2EDuration="1.457659497s" totalImagesPullingTime="216.291236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:27:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:27:09.456233042 +0000 UTC m=+683.534660932" watchObservedRunningTime="2026-07-23 16:27:09.457659497 +0000 UTC m=+683.536087388"
Jul 23 16:27:17.549669 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:17.549631    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:18.644489 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:18.644451    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:18.645008 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:18.644548    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:18.657718 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:18.657683    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:19.502069 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:19.502039    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4pdpk"
Jul 23 16:27:27.431008 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.430967    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"]
Jul 23 16:27:27.438365 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.438341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.440636 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.440615    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 23 16:27:27.446201 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.446169    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"]
Jul 23 16:27:27.462119 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.462081    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:27.527571 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.527537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cae8b136-43f4-4a85-9c38-55e2e7abe474-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.527571 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.527575    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cae8b136-43f4-4a85-9c38-55e2e7abe474-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.527809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.527593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cae8b136-43f4-4a85-9c38-55e2e7abe474-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.527809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.527715    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsx8w\" (UniqueName: \"kubernetes.io/projected/cae8b136-43f4-4a85-9c38-55e2e7abe474-kube-api-access-vsx8w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.527809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.527766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cae8b136-43f4-4a85-9c38-55e2e7abe474-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.527809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.527802    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cae8b136-43f4-4a85-9c38-55e2e7abe474-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.628487 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.628445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsx8w\" (UniqueName: \"kubernetes.io/projected/cae8b136-43f4-4a85-9c38-55e2e7abe474-kube-api-access-vsx8w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.628706 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.628500    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cae8b136-43f4-4a85-9c38-55e2e7abe474-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.628706 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.628564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cae8b136-43f4-4a85-9c38-55e2e7abe474-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.628706 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.628604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cae8b136-43f4-4a85-9c38-55e2e7abe474-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.628706 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.628622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cae8b136-43f4-4a85-9c38-55e2e7abe474-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.628706 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.628643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cae8b136-43f4-4a85-9c38-55e2e7abe474-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.629110 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.629086    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cae8b136-43f4-4a85-9c38-55e2e7abe474-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.629182 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.629142    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cae8b136-43f4-4a85-9c38-55e2e7abe474-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.629235 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.629186    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cae8b136-43f4-4a85-9c38-55e2e7abe474-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.630926 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.630904    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cae8b136-43f4-4a85-9c38-55e2e7abe474-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.631143 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.631122    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cae8b136-43f4-4a85-9c38-55e2e7abe474-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.636450 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.636429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsx8w\" (UniqueName: \"kubernetes.io/projected/cae8b136-43f4-4a85-9c38-55e2e7abe474-kube-api-access-vsx8w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ct5h5\" (UID: \"cae8b136-43f4-4a85-9c38-55e2e7abe474\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.751692 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.751596    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:27.912058 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:27.912031    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"]
Jul 23 16:27:27.914025 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:27:27.913995    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae8b136_43f4_4a85_9c38_55e2e7abe474.slice/crio-bef65ca5dd24543d192ae4c854818e3affcea5a7f38d0979802909bb7ded80c3 WatchSource:0}: Error finding container bef65ca5dd24543d192ae4c854818e3affcea5a7f38d0979802909bb7ded80c3: Status 404 returned error can't find the container with id bef65ca5dd24543d192ae4c854818e3affcea5a7f38d0979802909bb7ded80c3
Jul 23 16:27:28.536907 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:28.536866    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5" event={"ID":"cae8b136-43f4-4a85-9c38-55e2e7abe474","Type":"ContainerStarted","Data":"42c28409780e8f35a2e6ee13c5dbddc716cf74f4dc059b58c7c2b96059b6fcfe"}
Jul 23 16:27:28.537378 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:28.536919    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5" event={"ID":"cae8b136-43f4-4a85-9c38-55e2e7abe474","Type":"ContainerStarted","Data":"bef65ca5dd24543d192ae4c854818e3affcea5a7f38d0979802909bb7ded80c3"}
Jul 23 16:27:28.556199 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:28.556147    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5" podStartSLOduration=1.335445027 podStartE2EDuration="1.556128922s" totalImagesPullingTime="220.683895ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:27:28.55395197 +0000 UTC m=+702.632379862" watchObservedRunningTime="2026-07-23 16:27:28.556128922 +0000 UTC m=+702.634556813"
Jul 23 16:27:37.752622 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:37.752493    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:37.752622 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:37.752598    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:37.765081 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:37.765050    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:38.000072 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:38.000035    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:38.599007 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:38.598977    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ct5h5"
Jul 23 16:27:41.348668 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:41.348632    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:43.575527 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:43.575467    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:43.675573 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:27:43.675535    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:05.301587 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:05.301528    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:05.386372 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:05.386338    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:06.588825 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:06.588785    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:06.689529 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:06.689476    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:13.062992 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:13.062902    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:13.163195 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:13.163161    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:53.075409 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:53.075367    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-857f74fb4d-jzzrs"]
Jul 23 16:29:53.076060 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:53.075617    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-857f74fb4d-jzzrs" podUID="8b6e9716-ca50-4813-b811-24fd0dbd56a2" containerName="manager" containerID="cri-o://0ba6c434516918b36b130b7493d67822c76a34af08352f0c2cc73d50974af260" gracePeriod=30
Jul 23 16:29:53.255439 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:53.255409    2576 generic.go:356] "Generic (PLEG): container finished" podID="8b6e9716-ca50-4813-b811-24fd0dbd56a2" containerID="0ba6c434516918b36b130b7493d67822c76a34af08352f0c2cc73d50974af260" exitCode=0
Jul 23 16:29:53.255615 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:53.255459    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-857f74fb4d-jzzrs" event={"ID":"8b6e9716-ca50-4813-b811-24fd0dbd56a2","Type":"ContainerDied","Data":"0ba6c434516918b36b130b7493d67822c76a34af08352f0c2cc73d50974af260"}
Jul 23 16:29:53.342091 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:53.342062    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-857f74fb4d-jzzrs"
Jul 23 16:29:53.372263 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:53.372231    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b6e9716-ca50-4813-b811-24fd0dbd56a2-webhook-cert\") pod \"8b6e9716-ca50-4813-b811-24fd0dbd56a2\" (UID: \"8b6e9716-ca50-4813-b811-24fd0dbd56a2\") "
Jul 23 16:29:53.372451 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:53.372348    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpb9s\" (UniqueName: \"kubernetes.io/projected/8b6e9716-ca50-4813-b811-24fd0dbd56a2-kube-api-access-tpb9s\") pod \"8b6e9716-ca50-4813-b811-24fd0dbd56a2\" (UID: \"8b6e9716-ca50-4813-b811-24fd0dbd56a2\") "
Jul 23 16:29:53.374388 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:53.374346    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b6e9716-ca50-4813-b811-24fd0dbd56a2-kube-api-access-tpb9s" (OuterVolumeSpecName: "kube-api-access-tpb9s") pod "8b6e9716-ca50-4813-b811-24fd0dbd56a2" (UID: "8b6e9716-ca50-4813-b811-24fd0dbd56a2"). InnerVolumeSpecName "kube-api-access-tpb9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:29:53.374554 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:53.374417    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b6e9716-ca50-4813-b811-24fd0dbd56a2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8b6e9716-ca50-4813-b811-24fd0dbd56a2" (UID: "8b6e9716-ca50-4813-b811-24fd0dbd56a2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:29:53.474136 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:53.474094    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b6e9716-ca50-4813-b811-24fd0dbd56a2-webhook-cert\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:29:53.474136 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:53.474130    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpb9s\" (UniqueName: \"kubernetes.io/projected/8b6e9716-ca50-4813-b811-24fd0dbd56a2-kube-api-access-tpb9s\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:29:54.261742 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:54.261711    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-857f74fb4d-jzzrs" event={"ID":"8b6e9716-ca50-4813-b811-24fd0dbd56a2","Type":"ContainerDied","Data":"396e3bde312d288f924371c07a34703a06d6e3a3d473c1c61781cc81b2f60ff7"}
Jul 23 16:29:54.262196 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:54.261747    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-857f74fb4d-jzzrs"
Jul 23 16:29:54.262196 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:54.261774    2576 scope.go:117] "RemoveContainer" containerID="0ba6c434516918b36b130b7493d67822c76a34af08352f0c2cc73d50974af260"
Jul 23 16:29:54.284627 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:54.284591    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-857f74fb4d-jzzrs"]
Jul 23 16:29:54.289556 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:54.289498    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-857f74fb4d-jzzrs"]
Jul 23 16:29:54.492891 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:29:54.492856    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b6e9716-ca50-4813-b811-24fd0dbd56a2" path="/var/lib/kubelet/pods/8b6e9716-ca50-4813-b811-24fd0dbd56a2/volumes"
Jul 23 16:30:35.974853 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:35.974820    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:46.372671 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:46.372645    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:30:46.373131 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:46.373073    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:30:55.144675 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.144639    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-857f74fb4d-smwnb"]
Jul 23 16:30:55.145285 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.145254    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b6e9716-ca50-4813-b811-24fd0dbd56a2" containerName="manager"
Jul 23 16:30:55.145285 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.145275    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b6e9716-ca50-4813-b811-24fd0dbd56a2" containerName="manager"
Jul 23 16:30:55.145416 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.145368    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b6e9716-ca50-4813-b811-24fd0dbd56a2" containerName="manager"
Jul 23 16:30:55.149734 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.149711    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-857f74fb4d-smwnb"
Jul 23 16:30:55.152013 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.151992    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 16:30:55.152612 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.152594    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 16:30:55.152704 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.152633    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-l946g\""
Jul 23 16:30:55.159235 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.159192    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-857f74fb4d-smwnb"]
Jul 23 16:30:55.251127 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.251090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff-webhook-cert\") pod \"maas-controller-857f74fb4d-smwnb\" (UID: \"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff\") " pod="opendatahub/maas-controller-857f74fb4d-smwnb"
Jul 23 16:30:55.251311 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.251138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfgjw\" (UniqueName: \"kubernetes.io/projected/f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff-kube-api-access-qfgjw\") pod \"maas-controller-857f74fb4d-smwnb\" (UID: \"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff\") " pod="opendatahub/maas-controller-857f74fb4d-smwnb"
Jul 23 16:30:55.352370 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.352332    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff-webhook-cert\") pod \"maas-controller-857f74fb4d-smwnb\" (UID: \"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff\") " pod="opendatahub/maas-controller-857f74fb4d-smwnb"
Jul 23 16:30:55.352370 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.352380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfgjw\" (UniqueName: \"kubernetes.io/projected/f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff-kube-api-access-qfgjw\") pod \"maas-controller-857f74fb4d-smwnb\" (UID: \"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff\") " pod="opendatahub/maas-controller-857f74fb4d-smwnb"
Jul 23 16:30:55.354776 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.354754    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff-webhook-cert\") pod \"maas-controller-857f74fb4d-smwnb\" (UID: \"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff\") " pod="opendatahub/maas-controller-857f74fb4d-smwnb"
Jul 23 16:30:55.360302 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.360276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfgjw\" (UniqueName: \"kubernetes.io/projected/f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff-kube-api-access-qfgjw\") pod \"maas-controller-857f74fb4d-smwnb\" (UID: \"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff\") " pod="opendatahub/maas-controller-857f74fb4d-smwnb"
Jul 23 16:30:55.461675 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.461639    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-857f74fb4d-smwnb"
Jul 23 16:30:55.821991 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:55.821908    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-857f74fb4d-smwnb"]
Jul 23 16:30:55.825762 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:30:55.825734    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23a9bbf_8f5b_41a7_ad42_41cc25ae68ff.slice/crio-0046e0de584ff0021f359912441f78ef25e66c31204a2ba88f9ea494ec295bf7 WatchSource:0}: Error finding container 0046e0de584ff0021f359912441f78ef25e66c31204a2ba88f9ea494ec295bf7: Status 404 returned error can't find the container with id 0046e0de584ff0021f359912441f78ef25e66c31204a2ba88f9ea494ec295bf7
Jul 23 16:30:56.574269 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:56.574226    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-857f74fb4d-smwnb" event={"ID":"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff","Type":"ContainerStarted","Data":"951944f4de14df8f62157c3de85c8696a4958b7da3620a7e1716ec823cec9fc5"}
Jul 23 16:30:56.574677 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:56.574283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-857f74fb4d-smwnb" event={"ID":"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff","Type":"ContainerStarted","Data":"0046e0de584ff0021f359912441f78ef25e66c31204a2ba88f9ea494ec295bf7"}
Jul 23 16:30:56.574677 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:56.574334    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-857f74fb4d-smwnb"
Jul 23 16:30:56.594645 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:30:56.594589    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-857f74fb4d-smwnb" podStartSLOduration=0.964664455 podStartE2EDuration="1.594570562s" totalImagesPullingTime="629.906107ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:30:56.593048299 +0000 UTC m=+910.671476215" watchObservedRunningTime="2026-07-23 16:30:56.594570562 +0000 UTC m=+910.672998452"
Jul 23 16:31:07.581434 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:07.581402    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-857f74fb4d-smwnb"
Jul 23 16:31:12.161658 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.161590    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:12.265027 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.264990    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-857f74fb4d-smwnb"]
Jul 23 16:31:12.265223 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.265198    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-857f74fb4d-smwnb" podUID="f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff" containerName="manager" containerID="cri-o://951944f4de14df8f62157c3de85c8696a4958b7da3620a7e1716ec823cec9fc5" gracePeriod=30
Jul 23 16:31:12.518673 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.518648    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-857f74fb4d-smwnb"
Jul 23 16:31:12.611090 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.611055    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfgjw\" (UniqueName: \"kubernetes.io/projected/f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff-kube-api-access-qfgjw\") pod \"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff\" (UID: \"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff\") "
Jul 23 16:31:12.611288 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.611138    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff-webhook-cert\") pod \"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff\" (UID: \"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff\") "
Jul 23 16:31:12.613212 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.613180    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff-kube-api-access-qfgjw" (OuterVolumeSpecName: "kube-api-access-qfgjw") pod "f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff" (UID: "f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff"). InnerVolumeSpecName "kube-api-access-qfgjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:31:12.613212 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.613184    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff" (UID: "f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:31:12.655588 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.655551    2576 generic.go:356] "Generic (PLEG): container finished" podID="f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff" containerID="951944f4de14df8f62157c3de85c8696a4958b7da3620a7e1716ec823cec9fc5" exitCode=0
Jul 23 16:31:12.655761 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.655637    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-857f74fb4d-smwnb"
Jul 23 16:31:12.655761 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.655645    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-857f74fb4d-smwnb" event={"ID":"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff","Type":"ContainerDied","Data":"951944f4de14df8f62157c3de85c8696a4958b7da3620a7e1716ec823cec9fc5"}
Jul 23 16:31:12.655761 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.655702    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-857f74fb4d-smwnb" event={"ID":"f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff","Type":"ContainerDied","Data":"0046e0de584ff0021f359912441f78ef25e66c31204a2ba88f9ea494ec295bf7"}
Jul 23 16:31:12.655761 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.655731    2576 scope.go:117] "RemoveContainer" containerID="951944f4de14df8f62157c3de85c8696a4958b7da3620a7e1716ec823cec9fc5"
Jul 23 16:31:12.665338 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.665317    2576 scope.go:117] "RemoveContainer" containerID="951944f4de14df8f62157c3de85c8696a4958b7da3620a7e1716ec823cec9fc5"
Jul 23 16:31:12.665665 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:31:12.665645    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"951944f4de14df8f62157c3de85c8696a4958b7da3620a7e1716ec823cec9fc5\": container with ID starting with 951944f4de14df8f62157c3de85c8696a4958b7da3620a7e1716ec823cec9fc5 not found: ID does not exist" containerID="951944f4de14df8f62157c3de85c8696a4958b7da3620a7e1716ec823cec9fc5"
Jul 23 16:31:12.665725 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.665677    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"951944f4de14df8f62157c3de85c8696a4958b7da3620a7e1716ec823cec9fc5"} err="failed to get container status \"951944f4de14df8f62157c3de85c8696a4958b7da3620a7e1716ec823cec9fc5\": rpc error: code = NotFound desc = could not find container \"951944f4de14df8f62157c3de85c8696a4958b7da3620a7e1716ec823cec9fc5\": container with ID starting with 951944f4de14df8f62157c3de85c8696a4958b7da3620a7e1716ec823cec9fc5 not found: ID does not exist"
Jul 23 16:31:12.677333 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.677301    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-857f74fb4d-smwnb"]
Jul 23 16:31:12.681009 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.680982    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-857f74fb4d-smwnb"]
Jul 23 16:31:12.712127 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.712043    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff-webhook-cert\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:31:12.712127 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:12.712076    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfgjw\" (UniqueName: \"kubernetes.io/projected/f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff-kube-api-access-qfgjw\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:31:13.551834 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.551794    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-857f74fb4d-nkjjv"]
Jul 23 16:31:13.554282 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.552194    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff" containerName="manager"
Jul 23 16:31:13.554282 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.552206    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff" containerName="manager"
Jul 23 16:31:13.554282 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.552277    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff" containerName="manager"
Jul 23 16:31:13.555433 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.555414    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-857f74fb4d-nkjjv"
Jul 23 16:31:13.557666 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.557645    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 16:31:13.557963 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.557944    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 16:31:13.558076 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.557989    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-l946g\""
Jul 23 16:31:13.568657 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.568626    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-857f74fb4d-nkjjv"]
Jul 23 16:31:13.618608 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.618568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/311a13ae-de99-4a75-9850-4f6dc3b1224c-webhook-cert\") pod \"maas-controller-857f74fb4d-nkjjv\" (UID: \"311a13ae-de99-4a75-9850-4f6dc3b1224c\") " pod="opendatahub/maas-controller-857f74fb4d-nkjjv"
Jul 23 16:31:13.618784 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.618626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrww7\" (UniqueName: \"kubernetes.io/projected/311a13ae-de99-4a75-9850-4f6dc3b1224c-kube-api-access-zrww7\") pod \"maas-controller-857f74fb4d-nkjjv\" (UID: \"311a13ae-de99-4a75-9850-4f6dc3b1224c\") " pod="opendatahub/maas-controller-857f74fb4d-nkjjv"
Jul 23 16:31:13.719855 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.719815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrww7\" (UniqueName: \"kubernetes.io/projected/311a13ae-de99-4a75-9850-4f6dc3b1224c-kube-api-access-zrww7\") pod \"maas-controller-857f74fb4d-nkjjv\" (UID: \"311a13ae-de99-4a75-9850-4f6dc3b1224c\") " pod="opendatahub/maas-controller-857f74fb4d-nkjjv"
Jul 23 16:31:13.720066 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.719926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/311a13ae-de99-4a75-9850-4f6dc3b1224c-webhook-cert\") pod \"maas-controller-857f74fb4d-nkjjv\" (UID: \"311a13ae-de99-4a75-9850-4f6dc3b1224c\") " pod="opendatahub/maas-controller-857f74fb4d-nkjjv"
Jul 23 16:31:13.722392 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.722367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/311a13ae-de99-4a75-9850-4f6dc3b1224c-webhook-cert\") pod \"maas-controller-857f74fb4d-nkjjv\" (UID: \"311a13ae-de99-4a75-9850-4f6dc3b1224c\") " pod="opendatahub/maas-controller-857f74fb4d-nkjjv"
Jul 23 16:31:13.728455 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.728427    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrww7\" (UniqueName: \"kubernetes.io/projected/311a13ae-de99-4a75-9850-4f6dc3b1224c-kube-api-access-zrww7\") pod \"maas-controller-857f74fb4d-nkjjv\" (UID: \"311a13ae-de99-4a75-9850-4f6dc3b1224c\") " pod="opendatahub/maas-controller-857f74fb4d-nkjjv"
Jul 23 16:31:13.866645 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.866552    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-857f74fb4d-nkjjv"
Jul 23 16:31:13.954918 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:13.954865    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:14.012482 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:14.012455    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-857f74fb4d-nkjjv"]
Jul 23 16:31:14.014891 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:31:14.014859    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod311a13ae_de99_4a75_9850_4f6dc3b1224c.slice/crio-91ef86cd3b37885938e54df13fed45f2c9843f61165765ac291ea3fb336676c5 WatchSource:0}: Error finding container 91ef86cd3b37885938e54df13fed45f2c9843f61165765ac291ea3fb336676c5: Status 404 returned error can't find the container with id 91ef86cd3b37885938e54df13fed45f2c9843f61165765ac291ea3fb336676c5
Jul 23 16:31:14.493278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:14.493247    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff" path="/var/lib/kubelet/pods/f23a9bbf-8f5b-41a7-ad42-41cc25ae68ff/volumes"
Jul 23 16:31:14.669468 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:14.669432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-857f74fb4d-nkjjv" event={"ID":"311a13ae-de99-4a75-9850-4f6dc3b1224c","Type":"ContainerStarted","Data":"b6a0f24a8b120bd80028337e9403499885c42e3c568257644af50f17f4113ebe"}
Jul 23 16:31:14.669856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:14.669499    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-857f74fb4d-nkjjv"
Jul 23 16:31:14.669856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:14.669537    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-857f74fb4d-nkjjv" event={"ID":"311a13ae-de99-4a75-9850-4f6dc3b1224c","Type":"ContainerStarted","Data":"91ef86cd3b37885938e54df13fed45f2c9843f61165765ac291ea3fb336676c5"}
Jul 23 16:31:14.689890 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:14.689839    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-857f74fb4d-nkjjv" podStartSLOduration=1.223601188 podStartE2EDuration="1.689823665s" totalImagesPullingTime="466.222477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:31:14.68788033 +0000 UTC m=+928.766308255" watchObservedRunningTime="2026-07-23 16:31:14.689823665 +0000 UTC m=+928.768251555"
Jul 23 16:31:25.679691 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:25.679657    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-857f74fb4d-nkjjv"
Jul 23 16:31:47.220356 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:47.220317    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:47.307136 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:47.307100    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:47.433462 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:47.433425    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:53.372181 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:53.372139    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:53.482630 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:53.482591    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:53.572089 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:53.572050    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:53.860653 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:53.860612    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:55.017577 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:55.017540    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:59.635847 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:59.635811    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:59.709574 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:31:59.709535    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:32:59.361860 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:32:59.361820    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:32:59.462909 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:32:59.462871    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:33:41.962443 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:33:41.962359    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:35:46.402167 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:35:46.402127    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:35:46.404232 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:35:46.404211    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:36:41.718677 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:36:41.718579    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:46.492443 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:37:46.492396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:46.541719 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:37:46.541683    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:39:21.867203 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:39:21.867169    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:39:28.908856 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:39:28.908815    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:39:37.141374 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:39:37.141331    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:39:44.077741 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:39:44.077633    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:40:15.381465 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:40:15.381417    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:40:39.854107 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:40:39.854069    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:40:40.664795 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:40:40.664732    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:40:46.432924 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:40:46.432889    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:40:46.436829 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:40:46.436806    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:41:35.700485 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:41:35.700447    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:41:46.683791 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:41:46.683746    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:43:47.214773 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:43:47.214736    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:06.670701 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:06.670666    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:09.871435 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:09.871356    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:10.030046 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:10.030011    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:10.390829 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:10.390791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:16.015866 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:16.015827    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:16.114357 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:16.114308    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:16.243089 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:16.243052    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:16.557960 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:16.557905    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:16.841927 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:16.841835    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:21.775072 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:21.775035    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:21.849161 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:21.849125    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"]
Jul 23 16:44:21.852689 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:21.852667    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:21.854993 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:21.854968    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6a47fe09-serving-cert\""
Jul 23 16:44:21.856375 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:21.856334    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:21.866009 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:21.865983    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"]
Jul 23 16:44:21.945602 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:21.945565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e041b30a-3c70-4d5e-8564-c1a50254edce-maas-api-tls\") pod \"maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6\" (UID: \"e041b30a-3c70-4d5e-8564-c1a50254edce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:21.945818 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:21.945628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4n7w\" (UniqueName: \"kubernetes.io/projected/e041b30a-3c70-4d5e-8564-c1a50254edce-kube-api-access-p4n7w\") pod \"maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6\" (UID: \"e041b30a-3c70-4d5e-8564-c1a50254edce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:21.945818 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:21.945739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e041b30a-3c70-4d5e-8564-c1a50254edce-openshift-service-ca\") pod \"maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6\" (UID: \"e041b30a-3c70-4d5e-8564-c1a50254edce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:21.964937 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:21.964902    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:22.046726 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:22.046620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4n7w\" (UniqueName: \"kubernetes.io/projected/e041b30a-3c70-4d5e-8564-c1a50254edce-kube-api-access-p4n7w\") pod \"maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6\" (UID: \"e041b30a-3c70-4d5e-8564-c1a50254edce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:22.046726 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:22.046706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e041b30a-3c70-4d5e-8564-c1a50254edce-openshift-service-ca\") pod \"maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6\" (UID: \"e041b30a-3c70-4d5e-8564-c1a50254edce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:22.047082 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:22.046830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e041b30a-3c70-4d5e-8564-c1a50254edce-maas-api-tls\") pod \"maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6\" (UID: \"e041b30a-3c70-4d5e-8564-c1a50254edce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:22.047732 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:22.047705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e041b30a-3c70-4d5e-8564-c1a50254edce-openshift-service-ca\") pod \"maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6\" (UID: \"e041b30a-3c70-4d5e-8564-c1a50254edce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:22.050037 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:22.050014    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e041b30a-3c70-4d5e-8564-c1a50254edce-maas-api-tls\") pod \"maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6\" (UID: \"e041b30a-3c70-4d5e-8564-c1a50254edce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:22.058569 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:22.058537    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4n7w\" (UniqueName: \"kubernetes.io/projected/e041b30a-3c70-4d5e-8564-c1a50254edce-kube-api-access-p4n7w\") pod \"maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6\" (UID: \"e041b30a-3c70-4d5e-8564-c1a50254edce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:22.073180 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:22.073142    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:22.164087 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:22.164047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:22.305723 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:22.305636    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"]
Jul 23 16:44:22.309393 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:44:22.309354    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode041b30a_3c70_4d5e_8564_c1a50254edce.slice/crio-294bc8b53a159c83bb3efddaf10f70940a65cdfae5c1bd51dab89d1b55467e43 WatchSource:0}: Error finding container 294bc8b53a159c83bb3efddaf10f70940a65cdfae5c1bd51dab89d1b55467e43: Status 404 returned error can't find the container with id 294bc8b53a159c83bb3efddaf10f70940a65cdfae5c1bd51dab89d1b55467e43
Jul 23 16:44:22.310705 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:22.310684    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:44:22.532822 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:22.532791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:22.602039 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:22.601949    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6" event={"ID":"e041b30a-3c70-4d5e-8564-c1a50254edce","Type":"ContainerStarted","Data":"294bc8b53a159c83bb3efddaf10f70940a65cdfae5c1bd51dab89d1b55467e43"}
Jul 23 16:44:22.633898 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:22.633854    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:25.617544 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:25.617492    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6" event={"ID":"e041b30a-3c70-4d5e-8564-c1a50254edce","Type":"ContainerStarted","Data":"e6456862747c92f3e89baa2d49c32f058998a9a9877d3af63d7a1d0d3021aaf1"}
Jul 23 16:44:25.617946 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:25.617798    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:25.634536 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:25.634467    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6" podStartSLOduration=1.8685554039999999 podStartE2EDuration="4.634449002s" totalImagesPullingTime="2.765893598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:44:25.632548122 +0000 UTC m=+1719.710976038" watchObservedRunningTime="2026-07-23 16:44:25.634449002 +0000 UTC m=+1719.712876892"
Jul 23 16:44:31.628100 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:31.628070    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:45.977011 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:45.976975    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:57.826161 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:57.826118    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"]
Jul 23 16:44:57.826817 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:57.826403    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6" podUID="e041b30a-3c70-4d5e-8564-c1a50254edce" containerName="maas-api" containerID="cri-o://e6456862747c92f3e89baa2d49c32f058998a9a9877d3af63d7a1d0d3021aaf1" gracePeriod=30
Jul 23 16:44:57.864284 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:57.864250    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:44:58.077901 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.077830    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:58.168368 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.168328    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e041b30a-3c70-4d5e-8564-c1a50254edce-openshift-service-ca\") pod \"e041b30a-3c70-4d5e-8564-c1a50254edce\" (UID: \"e041b30a-3c70-4d5e-8564-c1a50254edce\") "
Jul 23 16:44:58.168605 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.168400    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4n7w\" (UniqueName: \"kubernetes.io/projected/e041b30a-3c70-4d5e-8564-c1a50254edce-kube-api-access-p4n7w\") pod \"e041b30a-3c70-4d5e-8564-c1a50254edce\" (UID: \"e041b30a-3c70-4d5e-8564-c1a50254edce\") "
Jul 23 16:44:58.168605 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.168436    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e041b30a-3c70-4d5e-8564-c1a50254edce-maas-api-tls\") pod \"e041b30a-3c70-4d5e-8564-c1a50254edce\" (UID: \"e041b30a-3c70-4d5e-8564-c1a50254edce\") "
Jul 23 16:44:58.168733 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.168696    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e041b30a-3c70-4d5e-8564-c1a50254edce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e041b30a-3c70-4d5e-8564-c1a50254edce" (UID: "e041b30a-3c70-4d5e-8564-c1a50254edce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:44:58.168801 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.168787    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e041b30a-3c70-4d5e-8564-c1a50254edce-openshift-service-ca\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:44:58.170677 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.170644    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e041b30a-3c70-4d5e-8564-c1a50254edce-kube-api-access-p4n7w" (OuterVolumeSpecName: "kube-api-access-p4n7w") pod "e041b30a-3c70-4d5e-8564-c1a50254edce" (UID: "e041b30a-3c70-4d5e-8564-c1a50254edce"). InnerVolumeSpecName "kube-api-access-p4n7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:44:58.170677 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.170655    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e041b30a-3c70-4d5e-8564-c1a50254edce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e041b30a-3c70-4d5e-8564-c1a50254edce" (UID: "e041b30a-3c70-4d5e-8564-c1a50254edce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:44:58.269986 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.269947    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4n7w\" (UniqueName: \"kubernetes.io/projected/e041b30a-3c70-4d5e-8564-c1a50254edce-kube-api-access-p4n7w\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:44:58.269986 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.269977    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e041b30a-3c70-4d5e-8564-c1a50254edce-maas-api-tls\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:44:58.779998 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.779906    2576 generic.go:356] "Generic (PLEG): container finished" podID="e041b30a-3c70-4d5e-8564-c1a50254edce" containerID="e6456862747c92f3e89baa2d49c32f058998a9a9877d3af63d7a1d0d3021aaf1" exitCode=0
Jul 23 16:44:58.779998 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.779964    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"
Jul 23 16:44:58.779998 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.779975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6" event={"ID":"e041b30a-3c70-4d5e-8564-c1a50254edce","Type":"ContainerDied","Data":"e6456862747c92f3e89baa2d49c32f058998a9a9877d3af63d7a1d0d3021aaf1"}
Jul 23 16:44:58.780244 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.780018    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6" event={"ID":"e041b30a-3c70-4d5e-8564-c1a50254edce","Type":"ContainerDied","Data":"294bc8b53a159c83bb3efddaf10f70940a65cdfae5c1bd51dab89d1b55467e43"}
Jul 23 16:44:58.780244 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.780039    2576 scope.go:117] "RemoveContainer" containerID="e6456862747c92f3e89baa2d49c32f058998a9a9877d3af63d7a1d0d3021aaf1"
Jul 23 16:44:58.789047 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.789024    2576 scope.go:117] "RemoveContainer" containerID="e6456862747c92f3e89baa2d49c32f058998a9a9877d3af63d7a1d0d3021aaf1"
Jul 23 16:44:58.789313 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:44:58.789290    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6456862747c92f3e89baa2d49c32f058998a9a9877d3af63d7a1d0d3021aaf1\": container with ID starting with e6456862747c92f3e89baa2d49c32f058998a9a9877d3af63d7a1d0d3021aaf1 not found: ID does not exist" containerID="e6456862747c92f3e89baa2d49c32f058998a9a9877d3af63d7a1d0d3021aaf1"
Jul 23 16:44:58.789359 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.789324    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6456862747c92f3e89baa2d49c32f058998a9a9877d3af63d7a1d0d3021aaf1"} err="failed to get container status \"e6456862747c92f3e89baa2d49c32f058998a9a9877d3af63d7a1d0d3021aaf1\": rpc error: code = NotFound desc = could not find container \"e6456862747c92f3e89baa2d49c32f058998a9a9877d3af63d7a1d0d3021aaf1\": container with ID starting with e6456862747c92f3e89baa2d49c32f058998a9a9877d3af63d7a1d0d3021aaf1 not found: ID does not exist"
Jul 23 16:44:58.798621 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.798594    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"]
Jul 23 16:44:58.802817 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:44:58.802789    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6a47fe09-65d7668664-4cnl6"]
Jul 23 16:45:00.492570 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:00.492531    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e041b30a-3c70-4d5e-8564-c1a50254edce" path="/var/lib/kubelet/pods/e041b30a-3c70-4d5e-8564-c1a50254edce/volumes"
Jul 23 16:45:02.442298 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:02.442261    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:02.621671 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:02.621637    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:03.281037 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:03.281000    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:03.382629 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:03.382590    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:03.481721 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:03.481679    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:03.718857 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:03.718816    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:03.916387 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:03.916351    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:06.162794 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.162757    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:06.238604 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.238572    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"]
Jul 23 16:45:06.239014 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.239001    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e041b30a-3c70-4d5e-8564-c1a50254edce" containerName="maas-api"
Jul 23 16:45:06.239062 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.239017    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e041b30a-3c70-4d5e-8564-c1a50254edce" containerName="maas-api"
Jul 23 16:45:06.239096 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.239077    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e041b30a-3c70-4d5e-8564-c1a50254edce" containerName="maas-api"
Jul 23 16:45:06.243578 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.243555    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:06.245819 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.245798    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-fe63dc8a-serving-cert\""
Jul 23 16:45:06.254162 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.254138    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"]
Jul 23 16:45:06.272492 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.272460    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:06.345925 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.345893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f95b3711-ea3d-466d-ad55-88ae06197745-openshift-service-ca\") pod \"maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg\" (UID: \"f95b3711-ea3d-466d-ad55-88ae06197745\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:06.346127 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.345931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f95b3711-ea3d-466d-ad55-88ae06197745-maas-api-tls\") pod \"maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg\" (UID: \"f95b3711-ea3d-466d-ad55-88ae06197745\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:06.346127 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.346083    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whgl5\" (UniqueName: \"kubernetes.io/projected/f95b3711-ea3d-466d-ad55-88ae06197745-kube-api-access-whgl5\") pod \"maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg\" (UID: \"f95b3711-ea3d-466d-ad55-88ae06197745\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:06.447576 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.447491    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f95b3711-ea3d-466d-ad55-88ae06197745-openshift-service-ca\") pod \"maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg\" (UID: \"f95b3711-ea3d-466d-ad55-88ae06197745\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:06.447741 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.447587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f95b3711-ea3d-466d-ad55-88ae06197745-maas-api-tls\") pod \"maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg\" (UID: \"f95b3711-ea3d-466d-ad55-88ae06197745\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:06.447741 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.447662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whgl5\" (UniqueName: \"kubernetes.io/projected/f95b3711-ea3d-466d-ad55-88ae06197745-kube-api-access-whgl5\") pod \"maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg\" (UID: \"f95b3711-ea3d-466d-ad55-88ae06197745\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:06.448293 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.448270    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f95b3711-ea3d-466d-ad55-88ae06197745-openshift-service-ca\") pod \"maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg\" (UID: \"f95b3711-ea3d-466d-ad55-88ae06197745\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:06.450115 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.450092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f95b3711-ea3d-466d-ad55-88ae06197745-maas-api-tls\") pod \"maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg\" (UID: \"f95b3711-ea3d-466d-ad55-88ae06197745\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:06.458701 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.458673    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whgl5\" (UniqueName: \"kubernetes.io/projected/f95b3711-ea3d-466d-ad55-88ae06197745-kube-api-access-whgl5\") pod \"maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg\" (UID: \"f95b3711-ea3d-466d-ad55-88ae06197745\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:06.481148 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.481095    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:06.557286 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.557247    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:06.707164 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.707141    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"]
Jul 23 16:45:06.709370 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:45:06.709343    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95b3711_ea3d_466d_ad55_88ae06197745.slice/crio-1edbb5bac408f5e9e5380046794bbd530289a148204184e4d6546b28f66dc5d5 WatchSource:0}: Error finding container 1edbb5bac408f5e9e5380046794bbd530289a148204184e4d6546b28f66dc5d5: Status 404 returned error can't find the container with id 1edbb5bac408f5e9e5380046794bbd530289a148204184e4d6546b28f66dc5d5
Jul 23 16:45:06.822065 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.822024    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg" event={"ID":"f95b3711-ea3d-466d-ad55-88ae06197745","Type":"ContainerStarted","Data":"1edbb5bac408f5e9e5380046794bbd530289a148204184e4d6546b28f66dc5d5"}
Jul 23 16:45:06.832653 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.832621    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:06.937041 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:06.937007    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:07.831057 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:07.831020    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg" event={"ID":"f95b3711-ea3d-466d-ad55-88ae06197745","Type":"ContainerStarted","Data":"a2cfa378590d13b41b4ccb9a06e642c23dd67c5e7294a616db7efee353d78f9f"}
Jul 23 16:45:07.831464 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:07.831092    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:07.850996 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:07.850938    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg" podStartSLOduration=1.148026091 podStartE2EDuration="1.850922536s" totalImagesPullingTime="702.896445ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:45:07.849712726 +0000 UTC m=+1761.928140617" watchObservedRunningTime="2026-07-23 16:45:07.850922536 +0000 UTC m=+1761.929350426"
Jul 23 16:45:13.841804 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:13.841771    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:20.817005 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:20.816971    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:20.917163 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:20.917132    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:31.517087 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:31.517053    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:41.821770 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:41.821689    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"]
Jul 23 16:45:41.822173 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:41.821932    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg" podUID="f95b3711-ea3d-466d-ad55-88ae06197745" containerName="maas-api" containerID="cri-o://a2cfa378590d13b41b4ccb9a06e642c23dd67c5e7294a616db7efee353d78f9f" gracePeriod=30
Jul 23 16:45:41.875600 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:41.875564    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:42.011848 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:42.011817    2576 generic.go:356] "Generic (PLEG): container finished" podID="f95b3711-ea3d-466d-ad55-88ae06197745" containerID="a2cfa378590d13b41b4ccb9a06e642c23dd67c5e7294a616db7efee353d78f9f" exitCode=0
Jul 23 16:45:42.012020 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:42.011893    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg" event={"ID":"f95b3711-ea3d-466d-ad55-88ae06197745","Type":"ContainerDied","Data":"a2cfa378590d13b41b4ccb9a06e642c23dd67c5e7294a616db7efee353d78f9f"}
Jul 23 16:45:42.083560 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:42.083476    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:42.179325 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:42.179294    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f95b3711-ea3d-466d-ad55-88ae06197745-openshift-service-ca\") pod \"f95b3711-ea3d-466d-ad55-88ae06197745\" (UID: \"f95b3711-ea3d-466d-ad55-88ae06197745\") "
Jul 23 16:45:42.179542 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:42.179378    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whgl5\" (UniqueName: \"kubernetes.io/projected/f95b3711-ea3d-466d-ad55-88ae06197745-kube-api-access-whgl5\") pod \"f95b3711-ea3d-466d-ad55-88ae06197745\" (UID: \"f95b3711-ea3d-466d-ad55-88ae06197745\") "
Jul 23 16:45:42.179542 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:42.179423    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f95b3711-ea3d-466d-ad55-88ae06197745-maas-api-tls\") pod \"f95b3711-ea3d-466d-ad55-88ae06197745\" (UID: \"f95b3711-ea3d-466d-ad55-88ae06197745\") "
Jul 23 16:45:42.179721 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:42.179697    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f95b3711-ea3d-466d-ad55-88ae06197745-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f95b3711-ea3d-466d-ad55-88ae06197745" (UID: "f95b3711-ea3d-466d-ad55-88ae06197745"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:45:42.181546 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:42.181488    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f95b3711-ea3d-466d-ad55-88ae06197745-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f95b3711-ea3d-466d-ad55-88ae06197745" (UID: "f95b3711-ea3d-466d-ad55-88ae06197745"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:45:42.181659 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:42.181567    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f95b3711-ea3d-466d-ad55-88ae06197745-kube-api-access-whgl5" (OuterVolumeSpecName: "kube-api-access-whgl5") pod "f95b3711-ea3d-466d-ad55-88ae06197745" (UID: "f95b3711-ea3d-466d-ad55-88ae06197745"). InnerVolumeSpecName "kube-api-access-whgl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:45:42.280611 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:42.280578    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f95b3711-ea3d-466d-ad55-88ae06197745-openshift-service-ca\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:45:42.280611 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:42.280607    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whgl5\" (UniqueName: \"kubernetes.io/projected/f95b3711-ea3d-466d-ad55-88ae06197745-kube-api-access-whgl5\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:45:42.280611 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:42.280617    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f95b3711-ea3d-466d-ad55-88ae06197745-maas-api-tls\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:45:43.017887 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:43.017855    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"
Jul 23 16:45:43.017887 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:43.017880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg" event={"ID":"f95b3711-ea3d-466d-ad55-88ae06197745","Type":"ContainerDied","Data":"1edbb5bac408f5e9e5380046794bbd530289a148204184e4d6546b28f66dc5d5"}
Jul 23 16:45:43.018352 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:43.017935    2576 scope.go:117] "RemoveContainer" containerID="a2cfa378590d13b41b4ccb9a06e642c23dd67c5e7294a616db7efee353d78f9f"
Jul 23 16:45:43.034231 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:43.034203    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"]
Jul 23 16:45:43.038494 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:43.038469    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fe63dc8a-6d7954cb4f-6jmfg"]
Jul 23 16:45:44.492866 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:44.492832    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f95b3711-ea3d-466d-ad55-88ae06197745" path="/var/lib/kubelet/pods/f95b3711-ea3d-466d-ad55-88ae06197745/volumes"
Jul 23 16:45:46.466238 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:46.466204    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:45:46.469237 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:46.469217    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:45:46.552121 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:46.552089    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:46.655457 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:46.655424    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:46.755589 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:46.755446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:46.975362 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:46.975325    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:47.328091 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:47.328056    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:47.656813 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:47.656714    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:49.241325 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.241287    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:49.333414 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.333381    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:49.491840 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.491746    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"]
Jul 23 16:45:49.492247 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.492228    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f95b3711-ea3d-466d-ad55-88ae06197745" containerName="maas-api"
Jul 23 16:45:49.492314 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.492249    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f95b3711-ea3d-466d-ad55-88ae06197745" containerName="maas-api"
Jul 23 16:45:49.492376 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.492341    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f95b3711-ea3d-466d-ad55-88ae06197745" containerName="maas-api"
Jul 23 16:45:49.495242 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.495224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:45:49.497929 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.497907    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8d7afb36-serving-cert\""
Jul 23 16:45:49.507555 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.507531    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"]
Jul 23 16:45:49.549308 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.549274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/980ffcad-29eb-451b-977a-3b45ec96acdc-maas-api-tls\") pod \"maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb\" (UID: \"980ffcad-29eb-451b-977a-3b45ec96acdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:45:49.549308 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.549308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/980ffcad-29eb-451b-977a-3b45ec96acdc-openshift-service-ca\") pod \"maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb\" (UID: \"980ffcad-29eb-451b-977a-3b45ec96acdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:45:49.549576 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.549387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg8gj\" (UniqueName: \"kubernetes.io/projected/980ffcad-29eb-451b-977a-3b45ec96acdc-kube-api-access-mg8gj\") pod \"maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb\" (UID: \"980ffcad-29eb-451b-977a-3b45ec96acdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:45:49.650045 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.650011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg8gj\" (UniqueName: \"kubernetes.io/projected/980ffcad-29eb-451b-977a-3b45ec96acdc-kube-api-access-mg8gj\") pod \"maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb\" (UID: \"980ffcad-29eb-451b-977a-3b45ec96acdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:45:49.650265 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.650135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/980ffcad-29eb-451b-977a-3b45ec96acdc-maas-api-tls\") pod \"maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb\" (UID: \"980ffcad-29eb-451b-977a-3b45ec96acdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:45:49.650265 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.650163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/980ffcad-29eb-451b-977a-3b45ec96acdc-openshift-service-ca\") pod \"maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb\" (UID: \"980ffcad-29eb-451b-977a-3b45ec96acdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:45:49.650905 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.650874    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:49.651062 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.650964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/980ffcad-29eb-451b-977a-3b45ec96acdc-openshift-service-ca\") pod \"maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb\" (UID: \"980ffcad-29eb-451b-977a-3b45ec96acdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:45:49.652831 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.652812    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/980ffcad-29eb-451b-977a-3b45ec96acdc-maas-api-tls\") pod \"maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb\" (UID: \"980ffcad-29eb-451b-977a-3b45ec96acdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:45:49.658450 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.658427    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg8gj\" (UniqueName: \"kubernetes.io/projected/980ffcad-29eb-451b-977a-3b45ec96acdc-kube-api-access-mg8gj\") pod \"maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb\" (UID: \"980ffcad-29eb-451b-977a-3b45ec96acdc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:45:49.809066 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.808963    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:45:49.881803 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.881770    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:49.956954 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:49.956825    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"]
Jul 23 16:45:49.959916 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:45:49.959861    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod980ffcad_29eb_451b_977a_3b45ec96acdc.slice/crio-bb4ac630b1a898a9622de7ef23a2de976cd8b0234bcb3517e1c03325826f20d5 WatchSource:0}: Error finding container bb4ac630b1a898a9622de7ef23a2de976cd8b0234bcb3517e1c03325826f20d5: Status 404 returned error can't find the container with id bb4ac630b1a898a9622de7ef23a2de976cd8b0234bcb3517e1c03325826f20d5
Jul 23 16:45:50.057676 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:50.057639    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb" event={"ID":"980ffcad-29eb-451b-977a-3b45ec96acdc","Type":"ContainerStarted","Data":"bb4ac630b1a898a9622de7ef23a2de976cd8b0234bcb3517e1c03325826f20d5"}
Jul 23 16:45:50.114172 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:50.114086    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:50.215123 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:50.215081    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:45:51.066005 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:51.065964    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb" event={"ID":"980ffcad-29eb-451b-977a-3b45ec96acdc","Type":"ContainerStarted","Data":"b0a7563191608c76a0faa58adb279886277358deb80b425e41e831d28aa37b2a"}
Jul 23 16:45:51.066407 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:51.066112    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:45:51.085225 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:51.085165    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb" podStartSLOduration=1.537693216 podStartE2EDuration="2.085146275s" totalImagesPullingTime="547.453059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:45:51.083039739 +0000 UTC m=+1805.161467630" watchObservedRunningTime="2026-07-23 16:45:51.085146275 +0000 UTC m=+1805.163574170"
Jul 23 16:45:57.079312 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:45:57.079282    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:46:25.777096 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:25.777054    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"]
Jul 23 16:46:25.777734 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:25.777340    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb" podUID="980ffcad-29eb-451b-977a-3b45ec96acdc" containerName="maas-api" containerID="cri-o://b0a7563191608c76a0faa58adb279886277358deb80b425e41e831d28aa37b2a" gracePeriod=30
Jul 23 16:46:25.799764 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:25.799720    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:26.036151 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.036082    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:46:26.091218 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.091185    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/980ffcad-29eb-451b-977a-3b45ec96acdc-openshift-service-ca\") pod \"980ffcad-29eb-451b-977a-3b45ec96acdc\" (UID: \"980ffcad-29eb-451b-977a-3b45ec96acdc\") "
Jul 23 16:46:26.091407 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.091262    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/980ffcad-29eb-451b-977a-3b45ec96acdc-maas-api-tls\") pod \"980ffcad-29eb-451b-977a-3b45ec96acdc\" (UID: \"980ffcad-29eb-451b-977a-3b45ec96acdc\") "
Jul 23 16:46:26.091407 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.091330    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg8gj\" (UniqueName: \"kubernetes.io/projected/980ffcad-29eb-451b-977a-3b45ec96acdc-kube-api-access-mg8gj\") pod \"980ffcad-29eb-451b-977a-3b45ec96acdc\" (UID: \"980ffcad-29eb-451b-977a-3b45ec96acdc\") "
Jul 23 16:46:26.091611 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.091587    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/980ffcad-29eb-451b-977a-3b45ec96acdc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "980ffcad-29eb-451b-977a-3b45ec96acdc" (UID: "980ffcad-29eb-451b-977a-3b45ec96acdc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:46:26.093435 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.093401    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/980ffcad-29eb-451b-977a-3b45ec96acdc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "980ffcad-29eb-451b-977a-3b45ec96acdc" (UID: "980ffcad-29eb-451b-977a-3b45ec96acdc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:46:26.093435 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.093402    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/980ffcad-29eb-451b-977a-3b45ec96acdc-kube-api-access-mg8gj" (OuterVolumeSpecName: "kube-api-access-mg8gj") pod "980ffcad-29eb-451b-977a-3b45ec96acdc" (UID: "980ffcad-29eb-451b-977a-3b45ec96acdc"). InnerVolumeSpecName "kube-api-access-mg8gj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:46:26.192056 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.192028    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg8gj\" (UniqueName: \"kubernetes.io/projected/980ffcad-29eb-451b-977a-3b45ec96acdc-kube-api-access-mg8gj\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:46:26.192056 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.192052    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/980ffcad-29eb-451b-977a-3b45ec96acdc-openshift-service-ca\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:46:26.192056 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.192063    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/980ffcad-29eb-451b-977a-3b45ec96acdc-maas-api-tls\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:46:26.249564 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.249532    2576 generic.go:356] "Generic (PLEG): container finished" podID="980ffcad-29eb-451b-977a-3b45ec96acdc" containerID="b0a7563191608c76a0faa58adb279886277358deb80b425e41e831d28aa37b2a" exitCode=0
Jul 23 16:46:26.249736 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.249584    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"
Jul 23 16:46:26.249736 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.249598    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb" event={"ID":"980ffcad-29eb-451b-977a-3b45ec96acdc","Type":"ContainerDied","Data":"b0a7563191608c76a0faa58adb279886277358deb80b425e41e831d28aa37b2a"}
Jul 23 16:46:26.249736 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.249652    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb" event={"ID":"980ffcad-29eb-451b-977a-3b45ec96acdc","Type":"ContainerDied","Data":"bb4ac630b1a898a9622de7ef23a2de976cd8b0234bcb3517e1c03325826f20d5"}
Jul 23 16:46:26.249736 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.249674    2576 scope.go:117] "RemoveContainer" containerID="b0a7563191608c76a0faa58adb279886277358deb80b425e41e831d28aa37b2a"
Jul 23 16:46:26.258805 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.258782    2576 scope.go:117] "RemoveContainer" containerID="b0a7563191608c76a0faa58adb279886277358deb80b425e41e831d28aa37b2a"
Jul 23 16:46:26.259066 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:46:26.259050    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0a7563191608c76a0faa58adb279886277358deb80b425e41e831d28aa37b2a\": container with ID starting with b0a7563191608c76a0faa58adb279886277358deb80b425e41e831d28aa37b2a not found: ID does not exist" containerID="b0a7563191608c76a0faa58adb279886277358deb80b425e41e831d28aa37b2a"
Jul 23 16:46:26.259113 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.259074    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0a7563191608c76a0faa58adb279886277358deb80b425e41e831d28aa37b2a"} err="failed to get container status \"b0a7563191608c76a0faa58adb279886277358deb80b425e41e831d28aa37b2a\": rpc error: code = NotFound desc = could not find container \"b0a7563191608c76a0faa58adb279886277358deb80b425e41e831d28aa37b2a\": container with ID starting with b0a7563191608c76a0faa58adb279886277358deb80b425e41e831d28aa37b2a not found: ID does not exist"
Jul 23 16:46:26.270575 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.270547    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"]
Jul 23 16:46:26.274597 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.274573    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8d7afb36-79cd747dc-9l2zb"]
Jul 23 16:46:26.493300 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:26.493268    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="980ffcad-29eb-451b-977a-3b45ec96acdc" path="/var/lib/kubelet/pods/980ffcad-29eb-451b-977a-3b45ec96acdc/volumes"
Jul 23 16:46:30.233890 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:30.233853    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:31.556479 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:31.556436    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:31.801176 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:31.801134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:32.040502 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:32.040461    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:32.367908 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:32.367810    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:32.882149 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:32.882108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:34.609114 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:34.609077    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:34.700987 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:34.700949    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:34.800294 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:34.800256    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:34.901029 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:34.900940    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:35.174422 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.174391    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"]
Jul 23 16:46:35.174809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.174795    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="980ffcad-29eb-451b-977a-3b45ec96acdc" containerName="maas-api"
Jul 23 16:46:35.174857 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.174810    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="980ffcad-29eb-451b-977a-3b45ec96acdc" containerName="maas-api"
Jul 23 16:46:35.174891 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.174876    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="980ffcad-29eb-451b-977a-3b45ec96acdc" containerName="maas-api"
Jul 23 16:46:35.179423 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.179397    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:46:35.181779 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.181757    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-8be8a357-serving-cert\""
Jul 23 16:46:35.195746 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.195716    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"]
Jul 23 16:46:35.220890 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.220840    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:35.280721 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.280677    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-maas-api-tls\") pod \"maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s\" (UID: \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:46:35.280721 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.280713    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-openshift-service-ca\") pod \"maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s\" (UID: \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:46:35.280986 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.280805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dms4z\" (UniqueName: \"kubernetes.io/projected/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-kube-api-access-dms4z\") pod \"maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s\" (UID: \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:46:35.382526 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.382480    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dms4z\" (UniqueName: \"kubernetes.io/projected/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-kube-api-access-dms4z\") pod \"maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s\" (UID: \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:46:35.382739 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.382638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-maas-api-tls\") pod \"maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s\" (UID: \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:46:35.382739 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.382670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-openshift-service-ca\") pod \"maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s\" (UID: \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:46:35.382870 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:46:35.382783    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-serving-cert: secret "maas-api-e2e-derive-8be8a357-serving-cert" not found
Jul 23 16:46:35.382870 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:46:35.382849    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-maas-api-tls podName:09527f36-46d6-4d1d-aa15-79d5fd0d2a55 nodeName:}" failed. No retries permitted until 2026-07-23 16:46:35.882832933 +0000 UTC m=+1849.961260801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-maas-api-tls") pod "maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s" (UID: "09527f36-46d6-4d1d-aa15-79d5fd0d2a55") : secret "maas-api-e2e-derive-8be8a357-serving-cert" not found
Jul 23 16:46:35.383412 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.383388    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-openshift-service-ca\") pod \"maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s\" (UID: \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:46:35.390338 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.390312    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dms4z\" (UniqueName: \"kubernetes.io/projected/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-kube-api-access-dms4z\") pod \"maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s\" (UID: \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:46:35.702239 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.702192    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:35.832206 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.832175    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:35.887486 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.887453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-maas-api-tls\") pod \"maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s\" (UID: \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:46:35.889992 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.889965    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-maas-api-tls\") pod \"maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s\" (UID: \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:46:35.934000 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:35.933951    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:46:36.090701 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:36.090614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:46:36.246207 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:36.246181    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"]
Jul 23 16:46:36.248180 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:46:36.248152    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09527f36_46d6_4d1d_aa15_79d5fd0d2a55.slice/crio-6f2deb65deff5f1b72f752e2a52f484e2b121e0f20548f8cd0859bac7b3642e8 WatchSource:0}: Error finding container 6f2deb65deff5f1b72f752e2a52f484e2b121e0f20548f8cd0859bac7b3642e8: Status 404 returned error can't find the container with id 6f2deb65deff5f1b72f752e2a52f484e2b121e0f20548f8cd0859bac7b3642e8
Jul 23 16:46:36.301363 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:36.301327    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s" event={"ID":"09527f36-46d6-4d1d-aa15-79d5fd0d2a55","Type":"ContainerStarted","Data":"6f2deb65deff5f1b72f752e2a52f484e2b121e0f20548f8cd0859bac7b3642e8"}
Jul 23 16:46:37.307609 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:37.307568    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s" event={"ID":"09527f36-46d6-4d1d-aa15-79d5fd0d2a55","Type":"ContainerStarted","Data":"b06f052c9728eff977324a3fd507fc88bafed7cc4df9cc1b54ba257a6b306ad9"}
Jul 23 16:46:37.308107 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:37.307707    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:46:37.323644 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:37.323586    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s" podStartSLOduration=1.817322648 podStartE2EDuration="2.323565958s" totalImagesPullingTime="506.24331ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:46:37.323437678 +0000 UTC m=+1851.401865570" watchObservedRunningTime="2026-07-23 16:46:37.323565958 +0000 UTC m=+1851.401993843"
Jul 23 16:46:43.319414 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:46:43.319379    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:47:09.867756 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:09.867544    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"]
Jul 23 16:47:09.870386 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:09.868535    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s" podUID="09527f36-46d6-4d1d-aa15-79d5fd0d2a55" containerName="maas-api" containerID="cri-o://b06f052c9728eff977324a3fd507fc88bafed7cc4df9cc1b54ba257a6b306ad9" gracePeriod=30
Jul 23 16:47:09.885256 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:09.885223    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:10.127331 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.127264    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:47:10.213450 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.213415    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-maas-api-tls\") pod \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\" (UID: \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\") "
Jul 23 16:47:10.213664 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.213474    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-openshift-service-ca\") pod \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\" (UID: \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\") "
Jul 23 16:47:10.213721 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.213682    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dms4z\" (UniqueName: \"kubernetes.io/projected/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-kube-api-access-dms4z\") pod \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\" (UID: \"09527f36-46d6-4d1d-aa15-79d5fd0d2a55\") "
Jul 23 16:47:10.213889 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.213864    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "09527f36-46d6-4d1d-aa15-79d5fd0d2a55" (UID: "09527f36-46d6-4d1d-aa15-79d5fd0d2a55"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:47:10.214007 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.213992    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-openshift-service-ca\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:47:10.215550 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.215525    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "09527f36-46d6-4d1d-aa15-79d5fd0d2a55" (UID: "09527f36-46d6-4d1d-aa15-79d5fd0d2a55"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:47:10.215642 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.215627    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-kube-api-access-dms4z" (OuterVolumeSpecName: "kube-api-access-dms4z") pod "09527f36-46d6-4d1d-aa15-79d5fd0d2a55" (UID: "09527f36-46d6-4d1d-aa15-79d5fd0d2a55"). InnerVolumeSpecName "kube-api-access-dms4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:47:10.315226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.315183    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-maas-api-tls\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:47:10.315226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.315219    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dms4z\" (UniqueName: \"kubernetes.io/projected/09527f36-46d6-4d1d-aa15-79d5fd0d2a55-kube-api-access-dms4z\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:47:10.473823 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.473783    2576 generic.go:356] "Generic (PLEG): container finished" podID="09527f36-46d6-4d1d-aa15-79d5fd0d2a55" containerID="b06f052c9728eff977324a3fd507fc88bafed7cc4df9cc1b54ba257a6b306ad9" exitCode=0
Jul 23 16:47:10.473823 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.473825    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"
Jul 23 16:47:10.474044 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.473827    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s" event={"ID":"09527f36-46d6-4d1d-aa15-79d5fd0d2a55","Type":"ContainerDied","Data":"b06f052c9728eff977324a3fd507fc88bafed7cc4df9cc1b54ba257a6b306ad9"}
Jul 23 16:47:10.474044 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.473959    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s" event={"ID":"09527f36-46d6-4d1d-aa15-79d5fd0d2a55","Type":"ContainerDied","Data":"6f2deb65deff5f1b72f752e2a52f484e2b121e0f20548f8cd0859bac7b3642e8"}
Jul 23 16:47:10.474044 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.473987    2576 scope.go:117] "RemoveContainer" containerID="b06f052c9728eff977324a3fd507fc88bafed7cc4df9cc1b54ba257a6b306ad9"
Jul 23 16:47:10.483395 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.483373    2576 scope.go:117] "RemoveContainer" containerID="b06f052c9728eff977324a3fd507fc88bafed7cc4df9cc1b54ba257a6b306ad9"
Jul 23 16:47:10.483689 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:47:10.483667    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b06f052c9728eff977324a3fd507fc88bafed7cc4df9cc1b54ba257a6b306ad9\": container with ID starting with b06f052c9728eff977324a3fd507fc88bafed7cc4df9cc1b54ba257a6b306ad9 not found: ID does not exist" containerID="b06f052c9728eff977324a3fd507fc88bafed7cc4df9cc1b54ba257a6b306ad9"
Jul 23 16:47:10.483779 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.483698    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b06f052c9728eff977324a3fd507fc88bafed7cc4df9cc1b54ba257a6b306ad9"} err="failed to get container status \"b06f052c9728eff977324a3fd507fc88bafed7cc4df9cc1b54ba257a6b306ad9\": rpc error: code = NotFound desc = could not find container \"b06f052c9728eff977324a3fd507fc88bafed7cc4df9cc1b54ba257a6b306ad9\": container with ID starting with b06f052c9728eff977324a3fd507fc88bafed7cc4df9cc1b54ba257a6b306ad9 not found: ID does not exist"
Jul 23 16:47:10.494188 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.494158    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"]
Jul 23 16:47:10.499496 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:10.499469    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8be8a357-77bdc55f76-mvq6s"]
Jul 23 16:47:12.492573 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:12.492543    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09527f36-46d6-4d1d-aa15-79d5fd0d2a55" path="/var/lib/kubelet/pods/09527f36-46d6-4d1d-aa15-79d5fd0d2a55/volumes"
Jul 23 16:47:14.521143 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:14.521103    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:14.681751 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:14.681710    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:14.942277 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:14.942246    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:15.463424 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:15.463388    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:15.562407 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:15.562375    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:15.664571 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:15.664536    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:17.220343 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:17.220300    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:23.249923 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:23.249883    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:23.313731 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:23.313687    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:23.404440 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:23.404388    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:23.503270 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:23.503173    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:23.602871 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:23.602840    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:24.015770 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:24.015736    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:50.047555 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:50.047495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:56.451453 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:56.451413    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:56.564519 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:56.564479    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:47:56.656245 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:47:56.656206    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:12.671325 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:12.671279    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:19.073546 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:19.073495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:19.144853 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:19.144807    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:19.244638 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:19.244608    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:19.341157 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:19.341059    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:29.846358 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:29.846322    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:30.707278 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:30.707240    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:37.741156 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:37.741079    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:37.847868 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:37.847829    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:37.949779 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:37.949747    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:38.082017 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:38.081918    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:38.924453 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:38.924414    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:39.007958 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:39.007924    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:39.107115 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:39.107079    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:40.914383 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:40.914343    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:47.051038 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:47.050992    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:47.137623 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:47.137580    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:47.736352 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:47.736317    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:54.003201 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:54.003155    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:54.103312 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:54.103277    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:54.275337 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:54.275238    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:54.694573 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:54.694498    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:55.225560 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:55.225494    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:57.969147 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:57.969097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:58.134047 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.134008    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:58.247899 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.247817    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"]
Jul 23 16:48:58.248219 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.248206    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09527f36-46d6-4d1d-aa15-79d5fd0d2a55" containerName="maas-api"
Jul 23 16:48:58.248274 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.248220    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="09527f36-46d6-4d1d-aa15-79d5fd0d2a55" containerName="maas-api"
Jul 23 16:48:58.248324 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.248300    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="09527f36-46d6-4d1d-aa15-79d5fd0d2a55" containerName="maas-api"
Jul 23 16:48:58.251543 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.251495    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:48:58.255077 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.255052    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9affa933-serving-cert\""
Jul 23 16:48:58.271260 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.271224    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"]
Jul 23 16:48:58.310211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.310175    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:58.349567 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.349532    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-maas-api-tls\") pod \"maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc\" (UID: \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:48:58.349749 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.349676    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-openshift-service-ca\") pod \"maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc\" (UID: \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:48:58.349749 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.349740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfwb9\" (UniqueName: \"kubernetes.io/projected/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-kube-api-access-rfwb9\") pod \"maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc\" (UID: \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:48:58.450984 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.450944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-openshift-service-ca\") pod \"maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc\" (UID: \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:48:58.451205 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.451017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfwb9\" (UniqueName: \"kubernetes.io/projected/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-kube-api-access-rfwb9\") pod \"maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc\" (UID: \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:48:58.451205 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.451063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-maas-api-tls\") pod \"maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc\" (UID: \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:48:58.451806 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.451786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-openshift-service-ca\") pod \"maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc\" (UID: \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:48:58.453552 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.453530    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-maas-api-tls\") pod \"maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc\" (UID: \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:48:58.473009 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.472971    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfwb9\" (UniqueName: \"kubernetes.io/projected/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-kube-api-access-rfwb9\") pod \"maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc\" (UID: \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:48:58.560275 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.560182    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:58.561991 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.561964    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:48:58.730426 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:58.730398    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"]
Jul 23 16:48:58.732850 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:48:58.732816    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2267c98c_db51_4bbe_9015_ed3d8f9bf57c.slice/crio-e6906b70cb781e507c3de08260f657ae3dc0b52dcaba9eb9a199e9d79cd170d9 WatchSource:0}: Error finding container e6906b70cb781e507c3de08260f657ae3dc0b52dcaba9eb9a199e9d79cd170d9: Status 404 returned error can't find the container with id e6906b70cb781e507c3de08260f657ae3dc0b52dcaba9eb9a199e9d79cd170d9
Jul 23 16:48:59.026523 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:59.026471    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc" event={"ID":"2267c98c-db51-4bbe-9015-ed3d8f9bf57c","Type":"ContainerStarted","Data":"e6906b70cb781e507c3de08260f657ae3dc0b52dcaba9eb9a199e9d79cd170d9"}
Jul 23 16:48:59.126259 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:59.126230    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:48:59.222784 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:48:59.222750    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:00.033435 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:00.033396    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc" event={"ID":"2267c98c-db51-4bbe-9015-ed3d8f9bf57c","Type":"ContainerStarted","Data":"4ef95464744534552454d5d3226fca08c9ce23b47d03ae800947424fd075dea0"}
Jul 23 16:49:00.033884 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:00.033459    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:49:00.051032 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:00.050964    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc" podStartSLOduration=1.6508192080000001 podStartE2EDuration="2.050943056s" totalImagesPullingTime="400.123848ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:49:00.049774385 +0000 UTC m=+1994.128202300" watchObservedRunningTime="2026-07-23 16:49:00.050943056 +0000 UTC m=+1994.129370947"
Jul 23 16:49:02.498271 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:02.498235    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:03.220307 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:03.220264    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:03.314303 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:03.314265    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:03.678527 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:03.678473    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:06.045724 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:06.045688    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:49:09.593403 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:09.593364    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:09.661677 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:09.661641    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:20.501085 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:20.501049    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"]
Jul 23 16:49:20.501523 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:20.501275    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc" podUID="2267c98c-db51-4bbe-9015-ed3d8f9bf57c" containerName="maas-api" containerID="cri-o://4ef95464744534552454d5d3226fca08c9ce23b47d03ae800947424fd075dea0" gracePeriod=30
Jul 23 16:49:20.538660 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:20.538631    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:20.758538 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:20.758454    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:49:20.872192 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:20.872161    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-maas-api-tls\") pod \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\" (UID: \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\") "
Jul 23 16:49:20.872400 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:20.872219    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfwb9\" (UniqueName: \"kubernetes.io/projected/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-kube-api-access-rfwb9\") pod \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\" (UID: \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\") "
Jul 23 16:49:20.872400 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:20.872296    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-openshift-service-ca\") pod \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\" (UID: \"2267c98c-db51-4bbe-9015-ed3d8f9bf57c\") "
Jul 23 16:49:20.872706 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:20.872680    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2267c98c-db51-4bbe-9015-ed3d8f9bf57c" (UID: "2267c98c-db51-4bbe-9015-ed3d8f9bf57c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:49:20.874444 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:20.874412    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2267c98c-db51-4bbe-9015-ed3d8f9bf57c" (UID: "2267c98c-db51-4bbe-9015-ed3d8f9bf57c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:49:20.874567 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:20.874474    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-kube-api-access-rfwb9" (OuterVolumeSpecName: "kube-api-access-rfwb9") pod "2267c98c-db51-4bbe-9015-ed3d8f9bf57c" (UID: "2267c98c-db51-4bbe-9015-ed3d8f9bf57c"). InnerVolumeSpecName "kube-api-access-rfwb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:49:20.973378 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:20.973338    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-openshift-service-ca\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:49:20.973378 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:20.973372    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-maas-api-tls\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:49:20.973378 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:20.973381    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfwb9\" (UniqueName: \"kubernetes.io/projected/2267c98c-db51-4bbe-9015-ed3d8f9bf57c-kube-api-access-rfwb9\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:49:21.140742 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:21.140645    2576 generic.go:356] "Generic (PLEG): container finished" podID="2267c98c-db51-4bbe-9015-ed3d8f9bf57c" containerID="4ef95464744534552454d5d3226fca08c9ce23b47d03ae800947424fd075dea0" exitCode=0
Jul 23 16:49:21.140742 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:21.140693    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"
Jul 23 16:49:21.140742 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:21.140719    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc" event={"ID":"2267c98c-db51-4bbe-9015-ed3d8f9bf57c","Type":"ContainerDied","Data":"4ef95464744534552454d5d3226fca08c9ce23b47d03ae800947424fd075dea0"}
Jul 23 16:49:21.140987 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:21.140772    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc" event={"ID":"2267c98c-db51-4bbe-9015-ed3d8f9bf57c","Type":"ContainerDied","Data":"e6906b70cb781e507c3de08260f657ae3dc0b52dcaba9eb9a199e9d79cd170d9"}
Jul 23 16:49:21.140987 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:21.140796    2576 scope.go:117] "RemoveContainer" containerID="4ef95464744534552454d5d3226fca08c9ce23b47d03ae800947424fd075dea0"
Jul 23 16:49:21.150154 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:21.150136    2576 scope.go:117] "RemoveContainer" containerID="4ef95464744534552454d5d3226fca08c9ce23b47d03ae800947424fd075dea0"
Jul 23 16:49:21.150433 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:49:21.150412    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef95464744534552454d5d3226fca08c9ce23b47d03ae800947424fd075dea0\": container with ID starting with 4ef95464744534552454d5d3226fca08c9ce23b47d03ae800947424fd075dea0 not found: ID does not exist" containerID="4ef95464744534552454d5d3226fca08c9ce23b47d03ae800947424fd075dea0"
Jul 23 16:49:21.150486 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:21.150444    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef95464744534552454d5d3226fca08c9ce23b47d03ae800947424fd075dea0"} err="failed to get container status \"4ef95464744534552454d5d3226fca08c9ce23b47d03ae800947424fd075dea0\": rpc error: code = NotFound desc = could not find container \"4ef95464744534552454d5d3226fca08c9ce23b47d03ae800947424fd075dea0\": container with ID starting with 4ef95464744534552454d5d3226fca08c9ce23b47d03ae800947424fd075dea0 not found: ID does not exist"
Jul 23 16:49:21.161018 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:21.160993    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"]
Jul 23 16:49:21.165325 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:21.165304    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9affa933-64fbbb7f55-jcsfc"]
Jul 23 16:49:22.492529 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:22.492476    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2267c98c-db51-4bbe-9015-ed3d8f9bf57c" path="/var/lib/kubelet/pods/2267c98c-db51-4bbe-9015-ed3d8f9bf57c/volumes"
Jul 23 16:49:25.072005 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:25.071972    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:25.481053 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:25.481017    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:31.273636 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:31.273596    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:31.342963 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:31.342903    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:31.626123 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:31.626019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:31.820164 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:31.820131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:31.951776 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:31.951739    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:32.054154 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:32.054110    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:32.178926 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:32.178888    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:39.259726 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:39.259693    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:39.367710 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:39.367666    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:39.522843 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:39.522753    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:39.686472 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:39.686433    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:45.566249 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:45.566212    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:45.687520 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:45.687466    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:52.608073 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:52.608031    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:52.933809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:52.933768    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:53.196146 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:53.196054    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:56.347201 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.347107    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:56.449223 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.449174    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:56.536013 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.535979    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"]
Jul 23 16:49:56.536394 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.536381    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2267c98c-db51-4bbe-9015-ed3d8f9bf57c" containerName="maas-api"
Jul 23 16:49:56.536458 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.536396    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2267c98c-db51-4bbe-9015-ed3d8f9bf57c" containerName="maas-api"
Jul 23 16:49:56.536497 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.536456    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2267c98c-db51-4bbe-9015-ed3d8f9bf57c" containerName="maas-api"
Jul 23 16:49:56.539635 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.539609    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:49:56.542033 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.542008    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-4fef36f3-serving-cert\""
Jul 23 16:49:56.554304 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.554249    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"]
Jul 23 16:49:56.608941 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.608858    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:56.708650 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.708611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4b4l\" (UniqueName: \"kubernetes.io/projected/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-kube-api-access-l4b4l\") pod \"maas-api-e2e-mt-4fef36f3-65887698c8-7xz22\" (UID: \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:49:56.708863 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.708667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-openshift-service-ca\") pod \"maas-api-e2e-mt-4fef36f3-65887698c8-7xz22\" (UID: \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:49:56.708863 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.708786    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-maas-api-tls\") pod \"maas-api-e2e-mt-4fef36f3-65887698c8-7xz22\" (UID: \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:49:56.717321 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.717278    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:56.809906 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.809868    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-maas-api-tls\") pod \"maas-api-e2e-mt-4fef36f3-65887698c8-7xz22\" (UID: \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:49:56.810109 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.809966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4b4l\" (UniqueName: \"kubernetes.io/projected/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-kube-api-access-l4b4l\") pod \"maas-api-e2e-mt-4fef36f3-65887698c8-7xz22\" (UID: \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:49:56.810109 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.810013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-openshift-service-ca\") pod \"maas-api-e2e-mt-4fef36f3-65887698c8-7xz22\" (UID: \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:49:56.810689 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.810669    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-openshift-service-ca\") pod \"maas-api-e2e-mt-4fef36f3-65887698c8-7xz22\" (UID: \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:49:56.812433 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.812399    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-maas-api-tls\") pod \"maas-api-e2e-mt-4fef36f3-65887698c8-7xz22\" (UID: \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:49:56.818850 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.818820    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4b4l\" (UniqueName: \"kubernetes.io/projected/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-kube-api-access-l4b4l\") pod \"maas-api-e2e-mt-4fef36f3-65887698c8-7xz22\" (UID: \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:49:56.853206 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:56.853177    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:49:57.008008 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:57.007979    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"]
Jul 23 16:49:57.009804 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:49:57.009767    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff44f3d_91aa_4d74_97fc_d7fda1713eda.slice/crio-1baeadb43478af767079493745cacdc22c0ce1133584e5dce8eb387d03612abd WatchSource:0}: Error finding container 1baeadb43478af767079493745cacdc22c0ce1133584e5dce8eb387d03612abd: Status 404 returned error can't find the container with id 1baeadb43478af767079493745cacdc22c0ce1133584e5dce8eb387d03612abd
Jul 23 16:49:57.011352 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:57.011331    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:49:57.177947 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:57.177911    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:57.316364 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:57.316328    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22" event={"ID":"8ff44f3d-91aa-4d74-97fc-d7fda1713eda","Type":"ContainerStarted","Data":"1baeadb43478af767079493745cacdc22c0ce1133584e5dce8eb387d03612abd"}
Jul 23 16:49:57.331229 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:57.331190    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:49:58.323272 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:58.323238    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22" event={"ID":"8ff44f3d-91aa-4d74-97fc-d7fda1713eda","Type":"ContainerStarted","Data":"2dd2881fcd07482f94835419de2221cf442f19f3fbbe76f037ceccefeb1fe52e"}
Jul 23 16:49:58.323752 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:49:58.323369    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:50:00.769251 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:00.769208    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:50:04.333328 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:04.333297    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:50:04.352782 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:04.352729    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22" podStartSLOduration=7.926687885 podStartE2EDuration="8.352713204s" totalImagesPullingTime="426.025319ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:49:58.345986966 +0000 UTC m=+2052.424414869" watchObservedRunningTime="2026-07-23 16:50:04.352713204 +0000 UTC m=+2058.431141095"
Jul 23 16:50:04.628045 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:04.628014    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:50:33.932880 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:33.932844    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:50:33.994839 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:33.994802    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:50:39.805544 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:39.805449    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"]
Jul 23 16:50:39.806703 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:39.806668    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22" podUID="8ff44f3d-91aa-4d74-97fc-d7fda1713eda" containerName="maas-api" containerID="cri-o://2dd2881fcd07482f94835419de2221cf442f19f3fbbe76f037ceccefeb1fe52e" gracePeriod=30
Jul 23 16:50:39.842331 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:39.842299    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:50:40.074721 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.074636    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:50:40.228843 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.228809    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-maas-api-tls\") pod \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\" (UID: \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\") "
Jul 23 16:50:40.229036 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.228894    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4b4l\" (UniqueName: \"kubernetes.io/projected/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-kube-api-access-l4b4l\") pod \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\" (UID: \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\") "
Jul 23 16:50:40.229036 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.228991    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-openshift-service-ca\") pod \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\" (UID: \"8ff44f3d-91aa-4d74-97fc-d7fda1713eda\") "
Jul 23 16:50:40.229425 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.229391    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ff44f3d-91aa-4d74-97fc-d7fda1713eda" (UID: "8ff44f3d-91aa-4d74-97fc-d7fda1713eda"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:50:40.231100 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.231072    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ff44f3d-91aa-4d74-97fc-d7fda1713eda" (UID: "8ff44f3d-91aa-4d74-97fc-d7fda1713eda"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:50:40.231198 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.231109    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-kube-api-access-l4b4l" (OuterVolumeSpecName: "kube-api-access-l4b4l") pod "8ff44f3d-91aa-4d74-97fc-d7fda1713eda" (UID: "8ff44f3d-91aa-4d74-97fc-d7fda1713eda"). InnerVolumeSpecName "kube-api-access-l4b4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:50:40.330237 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.330140    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-maas-api-tls\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:50:40.330237 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.330173    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4b4l\" (UniqueName: \"kubernetes.io/projected/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-kube-api-access-l4b4l\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:50:40.330237 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.330183    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff44f3d-91aa-4d74-97fc-d7fda1713eda-openshift-service-ca\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:50:40.541011 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.540972    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ff44f3d-91aa-4d74-97fc-d7fda1713eda" containerID="2dd2881fcd07482f94835419de2221cf442f19f3fbbe76f037ceccefeb1fe52e" exitCode=0
Jul 23 16:50:40.541011 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.541011    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"
Jul 23 16:50:40.541231 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.541063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22" event={"ID":"8ff44f3d-91aa-4d74-97fc-d7fda1713eda","Type":"ContainerDied","Data":"2dd2881fcd07482f94835419de2221cf442f19f3fbbe76f037ceccefeb1fe52e"}
Jul 23 16:50:40.541231 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.541108    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22" event={"ID":"8ff44f3d-91aa-4d74-97fc-d7fda1713eda","Type":"ContainerDied","Data":"1baeadb43478af767079493745cacdc22c0ce1133584e5dce8eb387d03612abd"}
Jul 23 16:50:40.541231 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.541129    2576 scope.go:117] "RemoveContainer" containerID="2dd2881fcd07482f94835419de2221cf442f19f3fbbe76f037ceccefeb1fe52e"
Jul 23 16:50:40.550081 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.550059    2576 scope.go:117] "RemoveContainer" containerID="2dd2881fcd07482f94835419de2221cf442f19f3fbbe76f037ceccefeb1fe52e"
Jul 23 16:50:40.550370 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:50:40.550353    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dd2881fcd07482f94835419de2221cf442f19f3fbbe76f037ceccefeb1fe52e\": container with ID starting with 2dd2881fcd07482f94835419de2221cf442f19f3fbbe76f037ceccefeb1fe52e not found: ID does not exist" containerID="2dd2881fcd07482f94835419de2221cf442f19f3fbbe76f037ceccefeb1fe52e"
Jul 23 16:50:40.550421 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.550378    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd2881fcd07482f94835419de2221cf442f19f3fbbe76f037ceccefeb1fe52e"} err="failed to get container status \"2dd2881fcd07482f94835419de2221cf442f19f3fbbe76f037ceccefeb1fe52e\": rpc error: code = NotFound desc = could not find container \"2dd2881fcd07482f94835419de2221cf442f19f3fbbe76f037ceccefeb1fe52e\": container with ID starting with 2dd2881fcd07482f94835419de2221cf442f19f3fbbe76f037ceccefeb1fe52e not found: ID does not exist"
Jul 23 16:50:40.557964 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.557937    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"]
Jul 23 16:50:40.565219 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:40.565188    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4fef36f3-65887698c8-7xz22"]
Jul 23 16:50:42.492452 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:42.492419    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ff44f3d-91aa-4d74-97fc-d7fda1713eda" path="/var/lib/kubelet/pods/8ff44f3d-91aa-4d74-97fc-d7fda1713eda/volumes"
Jul 23 16:50:44.399173 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:44.399139    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:50:46.496906 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:46.496877    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:50:46.501897 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:46.501871    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:50:46.718837 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:46.718808    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:50:51.797620 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:50:51.797577    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:27.938807 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:27.938775    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:29.068618 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:29.068576    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:34.701296 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:34.701262    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:34.803560 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:34.803486    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:34.979484 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:34.979379    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:35.202349 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:35.202308    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:35.641211 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:35.641169    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:35.741137 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:35.741103    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:36.345662 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:36.345604    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:36.434329 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:36.434300    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:36.534851 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:36.534820    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:37.373755 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:37.373719    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:37.452527 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:37.452472    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:37.552340 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:37.552290    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:39.022710 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:39.022670    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:45.104814 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:45.104783    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:45.174476 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:45.174439    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:45.829029 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:45.828990    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:52.329846 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:52.329810    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:52.431712 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:52.431673    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:51:52.531045 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:51:52.531005    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:03.094585 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:03.094541    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:03.454923 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:03.454891    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:24.495908 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:24.495867    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:31.360850 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:31.360814    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:31.460452 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:31.460419    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:31.802093 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:31.802062    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:32.072543 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:32.072432    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:32.197645 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:32.197606    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:35.137122 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.137087    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:35.213580 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.213546    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"]
Jul 23 16:52:35.213957 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.213942    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ff44f3d-91aa-4d74-97fc-d7fda1713eda" containerName="maas-api"
Jul 23 16:52:35.213957 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.213958    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ff44f3d-91aa-4d74-97fc-d7fda1713eda" containerName="maas-api"
Jul 23 16:52:35.214100 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.214034    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ff44f3d-91aa-4d74-97fc-d7fda1713eda" containerName="maas-api"
Jul 23 16:52:35.216961 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.216938    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:35.218846 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.218818    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:35.218977 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.218947    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-546d5f-serving-cert\""
Jul 23 16:52:35.226990 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.226951    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"]
Jul 23 16:52:35.317560 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.317500    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/284165c5-2550-4a12-9abc-4bfd86fde784-maas-api-tls\") pod \"maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv\" (UID: \"284165c5-2550-4a12-9abc-4bfd86fde784\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:35.317755 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.317641    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq5t6\" (UniqueName: \"kubernetes.io/projected/284165c5-2550-4a12-9abc-4bfd86fde784-kube-api-access-zq5t6\") pod \"maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv\" (UID: \"284165c5-2550-4a12-9abc-4bfd86fde784\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:35.317755 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.317718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/284165c5-2550-4a12-9abc-4bfd86fde784-openshift-service-ca\") pod \"maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv\" (UID: \"284165c5-2550-4a12-9abc-4bfd86fde784\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:35.342100 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.342060    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:35.418569 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.418439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/284165c5-2550-4a12-9abc-4bfd86fde784-maas-api-tls\") pod \"maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv\" (UID: \"284165c5-2550-4a12-9abc-4bfd86fde784\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:35.418569 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.418496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq5t6\" (UniqueName: \"kubernetes.io/projected/284165c5-2550-4a12-9abc-4bfd86fde784-kube-api-access-zq5t6\") pod \"maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv\" (UID: \"284165c5-2550-4a12-9abc-4bfd86fde784\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:35.418569 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.418552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/284165c5-2550-4a12-9abc-4bfd86fde784-openshift-service-ca\") pod \"maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv\" (UID: \"284165c5-2550-4a12-9abc-4bfd86fde784\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:35.418861 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:52:35.418605    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-serving-cert: secret "maas-api-e2e-inf-a-546d5f-serving-cert" not found
Jul 23 16:52:35.418861 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:52:35.418672    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/284165c5-2550-4a12-9abc-4bfd86fde784-maas-api-tls podName:284165c5-2550-4a12-9abc-4bfd86fde784 nodeName:}" failed. No retries permitted until 2026-07-23 16:52:35.918655012 +0000 UTC m=+2209.997082882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/284165c5-2550-4a12-9abc-4bfd86fde784-maas-api-tls") pod "maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv" (UID: "284165c5-2550-4a12-9abc-4bfd86fde784") : secret "maas-api-e2e-inf-a-546d5f-serving-cert" not found
Jul 23 16:52:35.419257 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.419235    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/284165c5-2550-4a12-9abc-4bfd86fde784-openshift-service-ca\") pod \"maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv\" (UID: \"284165c5-2550-4a12-9abc-4bfd86fde784\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:35.436214 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.436183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq5t6\" (UniqueName: \"kubernetes.io/projected/284165c5-2550-4a12-9abc-4bfd86fde784-kube-api-access-zq5t6\") pod \"maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv\" (UID: \"284165c5-2550-4a12-9abc-4bfd86fde784\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:35.572950 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.572918    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:35.819862 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.819821    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:35.919657 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.919619    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:35.923700 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.923664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/284165c5-2550-4a12-9abc-4bfd86fde784-maas-api-tls\") pod \"maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv\" (UID: \"284165c5-2550-4a12-9abc-4bfd86fde784\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:35.926228 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:35.926205    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/284165c5-2550-4a12-9abc-4bfd86fde784-maas-api-tls\") pod \"maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv\" (UID: \"284165c5-2550-4a12-9abc-4bfd86fde784\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:36.128892 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:36.128798    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:36.282852 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:36.282823    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"]
Jul 23 16:52:36.285395 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:52:36.285367    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284165c5_2550_4a12_9abc_4bfd86fde784.slice/crio-d7135fe53c4e87e705b6774a1c0f940db9b8864040f286140f49c4b7e8d3802e WatchSource:0}: Error finding container d7135fe53c4e87e705b6774a1c0f940db9b8864040f286140f49c4b7e8d3802e: Status 404 returned error can't find the container with id d7135fe53c4e87e705b6774a1c0f940db9b8864040f286140f49c4b7e8d3802e
Jul 23 16:52:37.119237 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:37.119199    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv" event={"ID":"284165c5-2550-4a12-9abc-4bfd86fde784","Type":"ContainerStarted","Data":"d7135fe53c4e87e705b6774a1c0f940db9b8864040f286140f49c4b7e8d3802e"}
Jul 23 16:52:38.125611 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:38.125574    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv" event={"ID":"284165c5-2550-4a12-9abc-4bfd86fde784","Type":"ContainerStarted","Data":"ff6a7bf1a3a9679071f60136962815bfed4239c152f51d7fd9de10ca1caa3fbd"}
Jul 23 16:52:38.126021 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:38.125679    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:38.142992 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:38.142938    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv" podStartSLOduration=2.3523725730000002 podStartE2EDuration="3.142918907s" totalImagesPullingTime="790.546334ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:52:38.141366184 +0000 UTC m=+2212.219794076" watchObservedRunningTime="2026-07-23 16:52:38.142918907 +0000 UTC m=+2212.221346830"
Jul 23 16:52:39.674468 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:39.674437    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:40.037721 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:40.037625    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:40.389824 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:40.389729    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:40.742816 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:40.742778    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:43.148403 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.148350    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:43.253523 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.253476    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:43.317625 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.317582    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"]
Jul 23 16:52:43.321994 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.321967    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:43.324128 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.324102    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-16a998-serving-cert\""
Jul 23 16:52:43.330820 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.330795    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"]
Jul 23 16:52:43.353731 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.353694    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:43.395621 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.395583    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16e90def-ef5a-49d8-96d5-db2c232d7ed5-maas-api-tls\") pod \"maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:43.395797 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.395656    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvhpn\" (UniqueName: \"kubernetes.io/projected/16e90def-ef5a-49d8-96d5-db2c232d7ed5-kube-api-access-dvhpn\") pod \"maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:43.395797 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.395730    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16e90def-ef5a-49d8-96d5-db2c232d7ed5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:43.496827 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.496788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvhpn\" (UniqueName: \"kubernetes.io/projected/16e90def-ef5a-49d8-96d5-db2c232d7ed5-kube-api-access-dvhpn\") pod \"maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:43.496997 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.496847    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16e90def-ef5a-49d8-96d5-db2c232d7ed5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:43.496997 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.496948    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16e90def-ef5a-49d8-96d5-db2c232d7ed5-maas-api-tls\") pod \"maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:43.497102 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:52:43.497049    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-serving-cert: secret "maas-api-e2e-inf-b-16a998-serving-cert" not found
Jul 23 16:52:43.497144 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:52:43.497120    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e90def-ef5a-49d8-96d5-db2c232d7ed5-maas-api-tls podName:16e90def-ef5a-49d8-96d5-db2c232d7ed5 nodeName:}" failed. No retries permitted until 2026-07-23 16:52:43.997100854 +0000 UTC m=+2218.075528723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/16e90def-ef5a-49d8-96d5-db2c232d7ed5-maas-api-tls") pod "maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k" (UID: "16e90def-ef5a-49d8-96d5-db2c232d7ed5") : secret "maas-api-e2e-inf-b-16a998-serving-cert" not found
Jul 23 16:52:43.497502 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.497476    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16e90def-ef5a-49d8-96d5-db2c232d7ed5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:43.507430 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.507392    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvhpn\" (UniqueName: \"kubernetes.io/projected/16e90def-ef5a-49d8-96d5-db2c232d7ed5-kube-api-access-dvhpn\") pod \"maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:43.822001 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.821911    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:43.926094 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:43.926058    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:44.001377 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:44.001336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16e90def-ef5a-49d8-96d5-db2c232d7ed5-maas-api-tls\") pod \"maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:44.001592 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:52:44.001541    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-serving-cert: secret "maas-api-e2e-inf-b-16a998-serving-cert" not found
Jul 23 16:52:44.001659 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:52:44.001612    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e90def-ef5a-49d8-96d5-db2c232d7ed5-maas-api-tls podName:16e90def-ef5a-49d8-96d5-db2c232d7ed5 nodeName:}" failed. No retries permitted until 2026-07-23 16:52:45.001596959 +0000 UTC m=+2219.080024829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/16e90def-ef5a-49d8-96d5-db2c232d7ed5-maas-api-tls") pod "maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k" (UID: "16e90def-ef5a-49d8-96d5-db2c232d7ed5") : secret "maas-api-e2e-inf-b-16a998-serving-cert" not found
Jul 23 16:52:44.082581 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:44.082468    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:44.137290 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:44.137256    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:52:45.012311 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:45.012268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16e90def-ef5a-49d8-96d5-db2c232d7ed5-maas-api-tls\") pod \"maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:45.014831 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:45.014809    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16e90def-ef5a-49d8-96d5-db2c232d7ed5-maas-api-tls\") pod \"maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:45.134953 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:45.134915    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:45.278407 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:45.278381    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"]
Jul 23 16:52:45.281070 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:52:45.281035    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e90def_ef5a_49d8_96d5_db2c232d7ed5.slice/crio-82d23aa75741dfa0f6965d9ad23b3f1b5c08fafad9a7ae212548e19cf6cdfe85 WatchSource:0}: Error finding container 82d23aa75741dfa0f6965d9ad23b3f1b5c08fafad9a7ae212548e19cf6cdfe85: Status 404 returned error can't find the container with id 82d23aa75741dfa0f6965d9ad23b3f1b5c08fafad9a7ae212548e19cf6cdfe85
Jul 23 16:52:46.170409 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:46.170372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k" event={"ID":"16e90def-ef5a-49d8-96d5-db2c232d7ed5","Type":"ContainerStarted","Data":"5c71d4f242d89793d418eaf4b88c46e984ee3992d5491ecf4da5035f8c273865"}
Jul 23 16:52:46.170788 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:46.170436    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k" event={"ID":"16e90def-ef5a-49d8-96d5-db2c232d7ed5","Type":"ContainerStarted","Data":"82d23aa75741dfa0f6965d9ad23b3f1b5c08fafad9a7ae212548e19cf6cdfe85"}
Jul 23 16:52:46.170788 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:46.170466    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:46.187940 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:46.187887    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k" podStartSLOduration=2.826897785 podStartE2EDuration="3.187865693s" totalImagesPullingTime="360.967908ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:52:46.186749501 +0000 UTC m=+2220.265177390" watchObservedRunningTime="2026-07-23 16:52:46.187865693 +0000 UTC m=+2220.266293584"
Jul 23 16:52:47.697194 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:47.697162    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:52.181033 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:52.181000    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:52:56.842485 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:56.842437    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:52:56.907690 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:52:56.907657    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:53:03.463302 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:53:03.463259    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:53:04.616913 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:53:04.616865    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:53:04.717311 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:53:04.717271    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:53:29.238375 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:53:29.238341    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:53:45.575381 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:53:45.575340    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:28.185763 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:28.185720    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:29.094938 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:29.094889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:29.892461 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:29.892419    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:29.997130 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:29.997088    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:35.283934 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:35.283890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:35.341484 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:35.341449    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:39.665560 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:39.665447    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"]
Jul 23 16:54:39.666018 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:39.665739    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv" podUID="284165c5-2550-4a12-9abc-4bfd86fde784" containerName="maas-api" containerID="cri-o://ff6a7bf1a3a9679071f60136962815bfed4239c152f51d7fd9de10ca1caa3fbd" gracePeriod=30
Jul 23 16:54:39.692134 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:39.692105    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:39.920245 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:39.920170    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:54:39.975581 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:39.975540    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/284165c5-2550-4a12-9abc-4bfd86fde784-openshift-service-ca\") pod \"284165c5-2550-4a12-9abc-4bfd86fde784\" (UID: \"284165c5-2550-4a12-9abc-4bfd86fde784\") "
Jul 23 16:54:39.975797 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:39.975617    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/284165c5-2550-4a12-9abc-4bfd86fde784-maas-api-tls\") pod \"284165c5-2550-4a12-9abc-4bfd86fde784\" (UID: \"284165c5-2550-4a12-9abc-4bfd86fde784\") "
Jul 23 16:54:39.975797 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:39.975658    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq5t6\" (UniqueName: \"kubernetes.io/projected/284165c5-2550-4a12-9abc-4bfd86fde784-kube-api-access-zq5t6\") pod \"284165c5-2550-4a12-9abc-4bfd86fde784\" (UID: \"284165c5-2550-4a12-9abc-4bfd86fde784\") "
Jul 23 16:54:39.976032 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:39.976005    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/284165c5-2550-4a12-9abc-4bfd86fde784-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "284165c5-2550-4a12-9abc-4bfd86fde784" (UID: "284165c5-2550-4a12-9abc-4bfd86fde784"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:54:39.977814 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:39.977778    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/284165c5-2550-4a12-9abc-4bfd86fde784-kube-api-access-zq5t6" (OuterVolumeSpecName: "kube-api-access-zq5t6") pod "284165c5-2550-4a12-9abc-4bfd86fde784" (UID: "284165c5-2550-4a12-9abc-4bfd86fde784"). InnerVolumeSpecName "kube-api-access-zq5t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:54:39.977814 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:39.977803    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/284165c5-2550-4a12-9abc-4bfd86fde784-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "284165c5-2550-4a12-9abc-4bfd86fde784" (UID: "284165c5-2550-4a12-9abc-4bfd86fde784"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:54:40.077297 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:40.077248    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/284165c5-2550-4a12-9abc-4bfd86fde784-openshift-service-ca\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:54:40.077297 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:40.077288    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/284165c5-2550-4a12-9abc-4bfd86fde784-maas-api-tls\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:54:40.077297 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:40.077301    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq5t6\" (UniqueName: \"kubernetes.io/projected/284165c5-2550-4a12-9abc-4bfd86fde784-kube-api-access-zq5t6\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:54:40.747857 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:40.747820    2576 generic.go:356] "Generic (PLEG): container finished" podID="284165c5-2550-4a12-9abc-4bfd86fde784" containerID="ff6a7bf1a3a9679071f60136962815bfed4239c152f51d7fd9de10ca1caa3fbd" exitCode=0
Jul 23 16:54:40.748339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:40.747886    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"
Jul 23 16:54:40.748339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:40.747902    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv" event={"ID":"284165c5-2550-4a12-9abc-4bfd86fde784","Type":"ContainerDied","Data":"ff6a7bf1a3a9679071f60136962815bfed4239c152f51d7fd9de10ca1caa3fbd"}
Jul 23 16:54:40.748339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:40.747961    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv" event={"ID":"284165c5-2550-4a12-9abc-4bfd86fde784","Type":"ContainerDied","Data":"d7135fe53c4e87e705b6774a1c0f940db9b8864040f286140f49c4b7e8d3802e"}
Jul 23 16:54:40.748339 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:40.747984    2576 scope.go:117] "RemoveContainer" containerID="ff6a7bf1a3a9679071f60136962815bfed4239c152f51d7fd9de10ca1caa3fbd"
Jul 23 16:54:40.757147 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:40.757135    2576 scope.go:117] "RemoveContainer" containerID="ff6a7bf1a3a9679071f60136962815bfed4239c152f51d7fd9de10ca1caa3fbd"
Jul 23 16:54:40.757442 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:54:40.757417    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff6a7bf1a3a9679071f60136962815bfed4239c152f51d7fd9de10ca1caa3fbd\": container with ID starting with ff6a7bf1a3a9679071f60136962815bfed4239c152f51d7fd9de10ca1caa3fbd not found: ID does not exist" containerID="ff6a7bf1a3a9679071f60136962815bfed4239c152f51d7fd9de10ca1caa3fbd"
Jul 23 16:54:40.757491 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:40.757452    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff6a7bf1a3a9679071f60136962815bfed4239c152f51d7fd9de10ca1caa3fbd"} err="failed to get container status \"ff6a7bf1a3a9679071f60136962815bfed4239c152f51d7fd9de10ca1caa3fbd\": rpc error: code = NotFound desc = could not find container \"ff6a7bf1a3a9679071f60136962815bfed4239c152f51d7fd9de10ca1caa3fbd\": container with ID starting with ff6a7bf1a3a9679071f60136962815bfed4239c152f51d7fd9de10ca1caa3fbd not found: ID does not exist"
Jul 23 16:54:40.766337 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:40.766311    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"]
Jul 23 16:54:40.770284 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:40.770262    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-546d5f-755c7cbc47-ppcjv"]
Jul 23 16:54:42.492744 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:42.492715    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="284165c5-2550-4a12-9abc-4bfd86fde784" path="/var/lib/kubelet/pods/284165c5-2550-4a12-9abc-4bfd86fde784/volumes"
Jul 23 16:54:44.307200 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:44.307163    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:46.199885 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:46.199834    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:50.551251 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:50.551208    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:50.655005 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:50.654967    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:50.857741 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:50.857652    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:51.096854 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:51.096814    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:52.036308 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:52.036267    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:52.136323 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:52.136294    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:56.327910 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:56.327850    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:54:56.399654 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:54:56.399586    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:01.727711 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:01.727673    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"]
Jul 23 16:55:01.728283 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:01.727938    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k" podUID="16e90def-ef5a-49d8-96d5-db2c232d7ed5" containerName="maas-api" containerID="cri-o://5c71d4f242d89793d418eaf4b88c46e984ee3992d5491ecf4da5035f8c273865" gracePeriod=30
Jul 23 16:55:01.749991 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:01.749951    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:01.857910 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:01.857881    2576 generic.go:356] "Generic (PLEG): container finished" podID="16e90def-ef5a-49d8-96d5-db2c232d7ed5" containerID="5c71d4f242d89793d418eaf4b88c46e984ee3992d5491ecf4da5035f8c273865" exitCode=0
Jul 23 16:55:01.858048 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:01.857955    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k" event={"ID":"16e90def-ef5a-49d8-96d5-db2c232d7ed5","Type":"ContainerDied","Data":"5c71d4f242d89793d418eaf4b88c46e984ee3992d5491ecf4da5035f8c273865"}
Jul 23 16:55:01.996546 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:01.996520    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:55:02.091083 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.091049    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvhpn\" (UniqueName: \"kubernetes.io/projected/16e90def-ef5a-49d8-96d5-db2c232d7ed5-kube-api-access-dvhpn\") pod \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") "
Jul 23 16:55:02.091083 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.091097    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16e90def-ef5a-49d8-96d5-db2c232d7ed5-openshift-service-ca\") pod \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") "
Jul 23 16:55:02.091327 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.091170    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16e90def-ef5a-49d8-96d5-db2c232d7ed5-maas-api-tls\") pod \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\" (UID: \"16e90def-ef5a-49d8-96d5-db2c232d7ed5\") "
Jul 23 16:55:02.091557 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.091535    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16e90def-ef5a-49d8-96d5-db2c232d7ed5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "16e90def-ef5a-49d8-96d5-db2c232d7ed5" (UID: "16e90def-ef5a-49d8-96d5-db2c232d7ed5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:55:02.093361 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.093334    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16e90def-ef5a-49d8-96d5-db2c232d7ed5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "16e90def-ef5a-49d8-96d5-db2c232d7ed5" (UID: "16e90def-ef5a-49d8-96d5-db2c232d7ed5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:55:02.093445 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.093381    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e90def-ef5a-49d8-96d5-db2c232d7ed5-kube-api-access-dvhpn" (OuterVolumeSpecName: "kube-api-access-dvhpn") pod "16e90def-ef5a-49d8-96d5-db2c232d7ed5" (UID: "16e90def-ef5a-49d8-96d5-db2c232d7ed5"). InnerVolumeSpecName "kube-api-access-dvhpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:55:02.192233 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.192185    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvhpn\" (UniqueName: \"kubernetes.io/projected/16e90def-ef5a-49d8-96d5-db2c232d7ed5-kube-api-access-dvhpn\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:55:02.192233 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.192225    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16e90def-ef5a-49d8-96d5-db2c232d7ed5-openshift-service-ca\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:55:02.192233 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.192235    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16e90def-ef5a-49d8-96d5-db2c232d7ed5-maas-api-tls\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:55:02.863811 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.863722    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"
Jul 23 16:55:02.863811 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.863723    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k" event={"ID":"16e90def-ef5a-49d8-96d5-db2c232d7ed5","Type":"ContainerDied","Data":"82d23aa75741dfa0f6965d9ad23b3f1b5c08fafad9a7ae212548e19cf6cdfe85"}
Jul 23 16:55:02.864329 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.863854    2576 scope.go:117] "RemoveContainer" containerID="5c71d4f242d89793d418eaf4b88c46e984ee3992d5491ecf4da5035f8c273865"
Jul 23 16:55:02.883453 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.883420    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"]
Jul 23 16:55:02.891955 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:02.891925    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-16a998-f89545f7b-nxn2k"]
Jul 23 16:55:04.494150 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:04.494111    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16e90def-ef5a-49d8-96d5-db2c232d7ed5" path="/var/lib/kubelet/pods/16e90def-ef5a-49d8-96d5-db2c232d7ed5/volumes"
Jul 23 16:55:06.303485 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:06.303453    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:06.739814 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:06.739780    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:12.965381 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:12.965342    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:13.065159 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:13.065124    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:13.239151 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:13.239064    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:13.491976 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:13.491864    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:13.888618 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:13.888500    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:14.251498 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:14.251459    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:14.570195 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:14.570096    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:17.106587 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.106544    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:17.213688 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.213647    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:17.231539 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.231490    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"]
Jul 23 16:55:17.231928 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.231915    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284165c5-2550-4a12-9abc-4bfd86fde784" containerName="maas-api"
Jul 23 16:55:17.231991 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.231931    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="284165c5-2550-4a12-9abc-4bfd86fde784" containerName="maas-api"
Jul 23 16:55:17.231991 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.231940    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16e90def-ef5a-49d8-96d5-db2c232d7ed5" containerName="maas-api"
Jul 23 16:55:17.231991 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.231946    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="16e90def-ef5a-49d8-96d5-db2c232d7ed5" containerName="maas-api"
Jul 23 16:55:17.232094 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.232021    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="16e90def-ef5a-49d8-96d5-db2c232d7ed5" containerName="maas-api"
Jul 23 16:55:17.232094 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.232029    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="284165c5-2550-4a12-9abc-4bfd86fde784" containerName="maas-api"
Jul 23 16:55:17.235095 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.235076    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:17.237304 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.237281    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-74f67a-serving-cert\""
Jul 23 16:55:17.250916 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.250889    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"]
Jul 23 16:55:17.314223 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.314187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:17.334940 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.334907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06c45b01-46ba-43d3-9f6d-22d589e866cc-maas-api-tls\") pod \"maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq\" (UID: \"06c45b01-46ba-43d3-9f6d-22d589e866cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:17.335117 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.334957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx2xl\" (UniqueName: \"kubernetes.io/projected/06c45b01-46ba-43d3-9f6d-22d589e866cc-kube-api-access-bx2xl\") pod \"maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq\" (UID: \"06c45b01-46ba-43d3-9f6d-22d589e866cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:17.335117 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.335062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06c45b01-46ba-43d3-9f6d-22d589e866cc-openshift-service-ca\") pod \"maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq\" (UID: \"06c45b01-46ba-43d3-9f6d-22d589e866cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:17.435731 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.435683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06c45b01-46ba-43d3-9f6d-22d589e866cc-openshift-service-ca\") pod \"maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq\" (UID: \"06c45b01-46ba-43d3-9f6d-22d589e866cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:17.435930 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.435753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06c45b01-46ba-43d3-9f6d-22d589e866cc-maas-api-tls\") pod \"maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq\" (UID: \"06c45b01-46ba-43d3-9f6d-22d589e866cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:17.435930 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.435804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx2xl\" (UniqueName: \"kubernetes.io/projected/06c45b01-46ba-43d3-9f6d-22d589e866cc-kube-api-access-bx2xl\") pod \"maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq\" (UID: \"06c45b01-46ba-43d3-9f6d-22d589e866cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:17.436468 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.436448    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06c45b01-46ba-43d3-9f6d-22d589e866cc-openshift-service-ca\") pod \"maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq\" (UID: \"06c45b01-46ba-43d3-9f6d-22d589e866cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:17.438328 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.438308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06c45b01-46ba-43d3-9f6d-22d589e866cc-maas-api-tls\") pod \"maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq\" (UID: \"06c45b01-46ba-43d3-9f6d-22d589e866cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:17.445966 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.445932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx2xl\" (UniqueName: \"kubernetes.io/projected/06c45b01-46ba-43d3-9f6d-22d589e866cc-kube-api-access-bx2xl\") pod \"maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq\" (UID: \"06c45b01-46ba-43d3-9f6d-22d589e866cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:17.484658 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.484612    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:17.545834 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.545792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:17.694343 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.694316    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"]
Jul 23 16:55:17.697016 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:55:17.696983    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c45b01_46ba_43d3_9f6d_22d589e866cc.slice/crio-ff004aef0a0233371da5f7d8cc3dfcfd4bd24985b2c832ee331402bca96afff2 WatchSource:0}: Error finding container ff004aef0a0233371da5f7d8cc3dfcfd4bd24985b2c832ee331402bca96afff2: Status 404 returned error can't find the container with id ff004aef0a0233371da5f7d8cc3dfcfd4bd24985b2c832ee331402bca96afff2
Jul 23 16:55:17.698466 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.698444    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:55:17.916049 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.916008    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:17.942571 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:17.942538    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq" event={"ID":"06c45b01-46ba-43d3-9f6d-22d589e866cc","Type":"ContainerStarted","Data":"ff004aef0a0233371da5f7d8cc3dfcfd4bd24985b2c832ee331402bca96afff2"}
Jul 23 16:55:18.018257 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:18.018163    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:18.949501 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:18.949464    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq" event={"ID":"06c45b01-46ba-43d3-9f6d-22d589e866cc","Type":"ContainerStarted","Data":"13eb9b37d73e2c6175ad88b617b5546aae1a0f5ae70e0d13d362038f59e87cc8"}
Jul 23 16:55:18.949945 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:18.949543    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:18.975465 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:18.975412    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq" podStartSLOduration=1.378463563 podStartE2EDuration="1.975396071s" totalImagesPullingTime="596.932508ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:55:18.971996247 +0000 UTC m=+2373.050424173" watchObservedRunningTime="2026-07-23 16:55:18.975396071 +0000 UTC m=+2373.053823962"
Jul 23 16:55:21.615095 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:21.615058    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:22.135188 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:22.135144    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:22.479239 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:22.479187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:22.777152 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:22.777062    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:24.961118 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:24.961086    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:25.039800 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.039745    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:25.137977 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.137792    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"]
Jul 23 16:55:25.141447 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.141427    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:55:25.144638 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.144610    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-e090e9-serving-cert\""
Jul 23 16:55:25.155578 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.155554    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"]
Jul 23 16:55:25.205351 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.205314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72cc93ed-1187-44de-802d-bfa8ec7cec75-openshift-service-ca\") pod \"maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf\" (UID: \"72cc93ed-1187-44de-802d-bfa8ec7cec75\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:55:25.205590 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.205383    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72cc93ed-1187-44de-802d-bfa8ec7cec75-maas-api-tls\") pod \"maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf\" (UID: \"72cc93ed-1187-44de-802d-bfa8ec7cec75\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:55:25.205590 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.205411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbsp9\" (UniqueName: \"kubernetes.io/projected/72cc93ed-1187-44de-802d-bfa8ec7cec75-kube-api-access-nbsp9\") pod \"maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf\" (UID: \"72cc93ed-1187-44de-802d-bfa8ec7cec75\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:55:25.306038 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.305951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72cc93ed-1187-44de-802d-bfa8ec7cec75-maas-api-tls\") pod \"maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf\" (UID: \"72cc93ed-1187-44de-802d-bfa8ec7cec75\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:55:25.306038 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.305992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbsp9\" (UniqueName: \"kubernetes.io/projected/72cc93ed-1187-44de-802d-bfa8ec7cec75-kube-api-access-nbsp9\") pod \"maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf\" (UID: \"72cc93ed-1187-44de-802d-bfa8ec7cec75\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:55:25.306247 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.306106    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72cc93ed-1187-44de-802d-bfa8ec7cec75-openshift-service-ca\") pod \"maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf\" (UID: \"72cc93ed-1187-44de-802d-bfa8ec7cec75\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:55:25.306823 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.306804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72cc93ed-1187-44de-802d-bfa8ec7cec75-openshift-service-ca\") pod \"maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf\" (UID: \"72cc93ed-1187-44de-802d-bfa8ec7cec75\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:55:25.308498 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.308470    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72cc93ed-1187-44de-802d-bfa8ec7cec75-maas-api-tls\") pod \"maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf\" (UID: \"72cc93ed-1187-44de-802d-bfa8ec7cec75\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:55:25.314346 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.314321    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbsp9\" (UniqueName: \"kubernetes.io/projected/72cc93ed-1187-44de-802d-bfa8ec7cec75-kube-api-access-nbsp9\") pod \"maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf\" (UID: \"72cc93ed-1187-44de-802d-bfa8ec7cec75\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:55:25.455183 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.455147    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:55:25.601165 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.601083    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"]
Jul 23 16:55:25.604606 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:55:25.604579    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72cc93ed_1187_44de_802d_bfa8ec7cec75.slice/crio-9ff557bf88ec50b1a55bfb9b926416aa6e771c8d1e13f252f9c0cf7a97f17a0d WatchSource:0}: Error finding container 9ff557bf88ec50b1a55bfb9b926416aa6e771c8d1e13f252f9c0cf7a97f17a0d: Status 404 returned error can't find the container with id 9ff557bf88ec50b1a55bfb9b926416aa6e771c8d1e13f252f9c0cf7a97f17a0d
Jul 23 16:55:25.984323 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:25.984290    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf" event={"ID":"72cc93ed-1187-44de-802d-bfa8ec7cec75","Type":"ContainerStarted","Data":"9ff557bf88ec50b1a55bfb9b926416aa6e771c8d1e13f252f9c0cf7a97f17a0d"}
Jul 23 16:55:26.991371 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:26.991332    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf" event={"ID":"72cc93ed-1187-44de-802d-bfa8ec7cec75","Type":"ContainerStarted","Data":"f9f79b92de19899a66b02651a335ea34a54ed7fbc156f0d4c1d1eb0c9201f2f9"}
Jul 23 16:55:26.991813 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:26.991492    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:55:27.008695 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:27.008643    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf" podStartSLOduration=1.6436580840000001 podStartE2EDuration="2.008624428s" totalImagesPullingTime="364.966344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:55:27.007054826 +0000 UTC m=+2381.085482718" watchObservedRunningTime="2026-07-23 16:55:27.008624428 +0000 UTC m=+2381.087052319"
Jul 23 16:55:27.613336 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:27.613297    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:27.713108 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:27.713070    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:29.011726 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:29.011671    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:29.581170 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:29.581130    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:33.002901 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:33.002867    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:55:38.552471 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:38.552428    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:38.652493 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:38.652454    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:46.528412 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:46.528380    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:55:46.534040 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:46.534015    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 16:55:46.935698 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:46.935653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:47.037226 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:47.037185    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:50.569266 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:50.569222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:50.731859 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:50.731815    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:53.834554 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:53.834503    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"]
Jul 23 16:55:53.835319 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:53.835284    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq" podUID="06c45b01-46ba-43d3-9f6d-22d589e866cc" containerName="maas-api" containerID="cri-o://13eb9b37d73e2c6175ad88b617b5546aae1a0f5ae70e0d13d362038f59e87cc8" gracePeriod=30
Jul 23 16:55:53.866809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:53.866765    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:54.093566 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.093478    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:54.138980 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.138946    2576 generic.go:356] "Generic (PLEG): container finished" podID="06c45b01-46ba-43d3-9f6d-22d589e866cc" containerID="13eb9b37d73e2c6175ad88b617b5546aae1a0f5ae70e0d13d362038f59e87cc8" exitCode=0
Jul 23 16:55:54.138980 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.138985    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"
Jul 23 16:55:54.139251 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.139012    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq" event={"ID":"06c45b01-46ba-43d3-9f6d-22d589e866cc","Type":"ContainerDied","Data":"13eb9b37d73e2c6175ad88b617b5546aae1a0f5ae70e0d13d362038f59e87cc8"}
Jul 23 16:55:54.139251 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.139060    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq" event={"ID":"06c45b01-46ba-43d3-9f6d-22d589e866cc","Type":"ContainerDied","Data":"ff004aef0a0233371da5f7d8cc3dfcfd4bd24985b2c832ee331402bca96afff2"}
Jul 23 16:55:54.139251 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.139084    2576 scope.go:117] "RemoveContainer" containerID="13eb9b37d73e2c6175ad88b617b5546aae1a0f5ae70e0d13d362038f59e87cc8"
Jul 23 16:55:54.148321 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.148297    2576 scope.go:117] "RemoveContainer" containerID="13eb9b37d73e2c6175ad88b617b5546aae1a0f5ae70e0d13d362038f59e87cc8"
Jul 23 16:55:54.148642 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:55:54.148622    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13eb9b37d73e2c6175ad88b617b5546aae1a0f5ae70e0d13d362038f59e87cc8\": container with ID starting with 13eb9b37d73e2c6175ad88b617b5546aae1a0f5ae70e0d13d362038f59e87cc8 not found: ID does not exist" containerID="13eb9b37d73e2c6175ad88b617b5546aae1a0f5ae70e0d13d362038f59e87cc8"
Jul 23 16:55:54.148701 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.148653    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13eb9b37d73e2c6175ad88b617b5546aae1a0f5ae70e0d13d362038f59e87cc8"} err="failed to get container status \"13eb9b37d73e2c6175ad88b617b5546aae1a0f5ae70e0d13d362038f59e87cc8\": rpc error: code = NotFound desc = could not find container \"13eb9b37d73e2c6175ad88b617b5546aae1a0f5ae70e0d13d362038f59e87cc8\": container with ID starting with 13eb9b37d73e2c6175ad88b617b5546aae1a0f5ae70e0d13d362038f59e87cc8 not found: ID does not exist"
Jul 23 16:55:54.175779 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.175748    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06c45b01-46ba-43d3-9f6d-22d589e866cc-maas-api-tls\") pod \"06c45b01-46ba-43d3-9f6d-22d589e866cc\" (UID: \"06c45b01-46ba-43d3-9f6d-22d589e866cc\") "
Jul 23 16:55:54.175951 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.175793    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06c45b01-46ba-43d3-9f6d-22d589e866cc-openshift-service-ca\") pod \"06c45b01-46ba-43d3-9f6d-22d589e866cc\" (UID: \"06c45b01-46ba-43d3-9f6d-22d589e866cc\") "
Jul 23 16:55:54.175951 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.175891    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx2xl\" (UniqueName: \"kubernetes.io/projected/06c45b01-46ba-43d3-9f6d-22d589e866cc-kube-api-access-bx2xl\") pod \"06c45b01-46ba-43d3-9f6d-22d589e866cc\" (UID: \"06c45b01-46ba-43d3-9f6d-22d589e866cc\") "
Jul 23 16:55:54.176174 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.176152    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06c45b01-46ba-43d3-9f6d-22d589e866cc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06c45b01-46ba-43d3-9f6d-22d589e866cc" (UID: "06c45b01-46ba-43d3-9f6d-22d589e866cc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:55:54.178076 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.178047    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06c45b01-46ba-43d3-9f6d-22d589e866cc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06c45b01-46ba-43d3-9f6d-22d589e866cc" (UID: "06c45b01-46ba-43d3-9f6d-22d589e866cc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:55:54.178172 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.178052    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c45b01-46ba-43d3-9f6d-22d589e866cc-kube-api-access-bx2xl" (OuterVolumeSpecName: "kube-api-access-bx2xl") pod "06c45b01-46ba-43d3-9f6d-22d589e866cc" (UID: "06c45b01-46ba-43d3-9f6d-22d589e866cc"). InnerVolumeSpecName "kube-api-access-bx2xl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:55:54.277287 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.277244    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx2xl\" (UniqueName: \"kubernetes.io/projected/06c45b01-46ba-43d3-9f6d-22d589e866cc-kube-api-access-bx2xl\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:55:54.277287 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.277280    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06c45b01-46ba-43d3-9f6d-22d589e866cc-maas-api-tls\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:55:54.277287 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.277290    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06c45b01-46ba-43d3-9f6d-22d589e866cc-openshift-service-ca\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:55:54.463384 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.463349    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"]
Jul 23 16:55:54.466882 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.466853    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-74f67a-6dd7df4ddf-ctjrq"]
Jul 23 16:55:54.492741 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:54.492712    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06c45b01-46ba-43d3-9f6d-22d589e866cc" path="/var/lib/kubelet/pods/06c45b01-46ba-43d3-9f6d-22d589e866cc/volumes"
Jul 23 16:55:57.987196 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:57.987148    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:55:58.381122 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:55:58.381026    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:04.084792 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:04.084753    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:04.155335 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:04.155273    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:04.368568 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:04.368440    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:04.607357 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:04.607318    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:05.376256 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:05.376026    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:05.478984 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:05.478950    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:20.371835 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:20.371723    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"]
Jul 23 16:56:20.373777 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:20.371976    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf" podUID="72cc93ed-1187-44de-802d-bfa8ec7cec75" containerName="maas-api" containerID="cri-o://f9f79b92de19899a66b02651a335ea34a54ed7fbc156f0d4c1d1eb0c9201f2f9" gracePeriod=30
Jul 23 16:56:20.416550 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:20.416482    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:20.628488 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:20.628414    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:56:20.726080 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:20.726042    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbsp9\" (UniqueName: \"kubernetes.io/projected/72cc93ed-1187-44de-802d-bfa8ec7cec75-kube-api-access-nbsp9\") pod \"72cc93ed-1187-44de-802d-bfa8ec7cec75\" (UID: \"72cc93ed-1187-44de-802d-bfa8ec7cec75\") "
Jul 23 16:56:20.726258 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:20.726144    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72cc93ed-1187-44de-802d-bfa8ec7cec75-maas-api-tls\") pod \"72cc93ed-1187-44de-802d-bfa8ec7cec75\" (UID: \"72cc93ed-1187-44de-802d-bfa8ec7cec75\") "
Jul 23 16:56:20.726258 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:20.726197    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72cc93ed-1187-44de-802d-bfa8ec7cec75-openshift-service-ca\") pod \"72cc93ed-1187-44de-802d-bfa8ec7cec75\" (UID: \"72cc93ed-1187-44de-802d-bfa8ec7cec75\") "
Jul 23 16:56:20.726639 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:20.726606    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72cc93ed-1187-44de-802d-bfa8ec7cec75-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "72cc93ed-1187-44de-802d-bfa8ec7cec75" (UID: "72cc93ed-1187-44de-802d-bfa8ec7cec75"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:56:20.728145 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:20.728114    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72cc93ed-1187-44de-802d-bfa8ec7cec75-kube-api-access-nbsp9" (OuterVolumeSpecName: "kube-api-access-nbsp9") pod "72cc93ed-1187-44de-802d-bfa8ec7cec75" (UID: "72cc93ed-1187-44de-802d-bfa8ec7cec75"). InnerVolumeSpecName "kube-api-access-nbsp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:56:20.728243 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:20.728183    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72cc93ed-1187-44de-802d-bfa8ec7cec75-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "72cc93ed-1187-44de-802d-bfa8ec7cec75" (UID: "72cc93ed-1187-44de-802d-bfa8ec7cec75"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:56:20.827206 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:20.827167    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbsp9\" (UniqueName: \"kubernetes.io/projected/72cc93ed-1187-44de-802d-bfa8ec7cec75-kube-api-access-nbsp9\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:56:20.827206 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:20.827198    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72cc93ed-1187-44de-802d-bfa8ec7cec75-maas-api-tls\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:56:20.827206 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:20.827207    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72cc93ed-1187-44de-802d-bfa8ec7cec75-openshift-service-ca\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 16:56:21.278297 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:21.278262    2576 generic.go:356] "Generic (PLEG): container finished" podID="72cc93ed-1187-44de-802d-bfa8ec7cec75" containerID="f9f79b92de19899a66b02651a335ea34a54ed7fbc156f0d4c1d1eb0c9201f2f9" exitCode=0
Jul 23 16:56:21.278499 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:21.278310    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"
Jul 23 16:56:21.278499 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:21.278323    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf" event={"ID":"72cc93ed-1187-44de-802d-bfa8ec7cec75","Type":"ContainerDied","Data":"f9f79b92de19899a66b02651a335ea34a54ed7fbc156f0d4c1d1eb0c9201f2f9"}
Jul 23 16:56:21.278499 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:21.278376    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf" event={"ID":"72cc93ed-1187-44de-802d-bfa8ec7cec75","Type":"ContainerDied","Data":"9ff557bf88ec50b1a55bfb9b926416aa6e771c8d1e13f252f9c0cf7a97f17a0d"}
Jul 23 16:56:21.278499 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:21.278407    2576 scope.go:117] "RemoveContainer" containerID="f9f79b92de19899a66b02651a335ea34a54ed7fbc156f0d4c1d1eb0c9201f2f9"
Jul 23 16:56:21.287925 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:21.287905    2576 scope.go:117] "RemoveContainer" containerID="f9f79b92de19899a66b02651a335ea34a54ed7fbc156f0d4c1d1eb0c9201f2f9"
Jul 23 16:56:21.288221 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:56:21.288201    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9f79b92de19899a66b02651a335ea34a54ed7fbc156f0d4c1d1eb0c9201f2f9\": container with ID starting with f9f79b92de19899a66b02651a335ea34a54ed7fbc156f0d4c1d1eb0c9201f2f9 not found: ID does not exist" containerID="f9f79b92de19899a66b02651a335ea34a54ed7fbc156f0d4c1d1eb0c9201f2f9"
Jul 23 16:56:21.288274 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:21.288239    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9f79b92de19899a66b02651a335ea34a54ed7fbc156f0d4c1d1eb0c9201f2f9"} err="failed to get container status \"f9f79b92de19899a66b02651a335ea34a54ed7fbc156f0d4c1d1eb0c9201f2f9\": rpc error: code = NotFound desc = could not find container \"f9f79b92de19899a66b02651a335ea34a54ed7fbc156f0d4c1d1eb0c9201f2f9\": container with ID starting with f9f79b92de19899a66b02651a335ea34a54ed7fbc156f0d4c1d1eb0c9201f2f9 not found: ID does not exist"
Jul 23 16:56:21.300558 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:21.300497    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"]
Jul 23 16:56:21.302609 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:21.302581    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e090e9-77f5d86df9-d8dwf"]
Jul 23 16:56:22.492614 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:22.492578    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72cc93ed-1187-44de-802d-bfa8ec7cec75" path="/var/lib/kubelet/pods/72cc93ed-1187-44de-802d-bfa8ec7cec75/volumes"
Jul 23 16:56:24.843639 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:24.843597    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:24.941168 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:24.941131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:25.287930 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:25.287891    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:31.390297 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:31.390257    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:31.476462 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:31.476409    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:31.683374 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:31.683336    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:31.913817 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:31.913774    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:32.281537 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:32.281466    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:32.623411 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:32.623292    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:32.822048 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:32.822006    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:35.489982 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.489945    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:35.595173 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.595134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:35.603009 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.602978    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"]
Jul 23 16:56:35.603821 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.603792    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72cc93ed-1187-44de-802d-bfa8ec7cec75" containerName="maas-api"
Jul 23 16:56:35.603821 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.603821    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="72cc93ed-1187-44de-802d-bfa8ec7cec75" containerName="maas-api"
Jul 23 16:56:35.603956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.603852    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c45b01-46ba-43d3-9f6d-22d589e866cc" containerName="maas-api"
Jul 23 16:56:35.603956 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.603861    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c45b01-46ba-43d3-9f6d-22d589e866cc" containerName="maas-api"
Jul 23 16:56:35.604026 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.603957    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="06c45b01-46ba-43d3-9f6d-22d589e866cc" containerName="maas-api"
Jul 23 16:56:35.604026 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.603972    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="72cc93ed-1187-44de-802d-bfa8ec7cec75" containerName="maas-api"
Jul 23 16:56:35.607687 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.607665    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:35.610817 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.610793    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-dc9a69-serving-cert\""
Jul 23 16:56:35.621119 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.621096    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"]
Jul 23 16:56:35.670158 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.670126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gphcz\" (UniqueName: \"kubernetes.io/projected/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-kube-api-access-gphcz\") pod \"maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst\" (UID: \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:35.670346 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.670173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst\" (UID: \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:35.670346 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.670280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-maas-api-tls\") pod \"maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst\" (UID: \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:35.689947 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.689909    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:35.771857 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.771766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-maas-api-tls\") pod \"maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst\" (UID: \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:35.771857 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.771852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gphcz\" (UniqueName: \"kubernetes.io/projected/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-kube-api-access-gphcz\") pod \"maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst\" (UID: \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:35.772053 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.771887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst\" (UID: \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:35.772053 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:56:35.771915    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-serving-cert: secret "maas-api-e2e-shared-a-dc9a69-serving-cert" not found
Jul 23 16:56:35.772053 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:56:35.771976    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-maas-api-tls podName:f57c7643-551f-4a6a-b8d6-b2c9d831fdfe nodeName:}" failed. No retries permitted until 2026-07-23 16:56:36.271959182 +0000 UTC m=+2450.350387051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-maas-api-tls") pod "maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst" (UID: "f57c7643-551f-4a6a-b8d6-b2c9d831fdfe") : secret "maas-api-e2e-shared-a-dc9a69-serving-cert" not found
Jul 23 16:56:35.772576 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.772559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst\" (UID: \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:35.797092 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.797057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gphcz\" (UniqueName: \"kubernetes.io/projected/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-kube-api-access-gphcz\") pod \"maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst\" (UID: \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:35.879038 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:35.878994    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:36.199271 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:36.199234    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:36.276184 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:36.276149    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-maas-api-tls\") pod \"maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst\" (UID: \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:36.278625 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:36.278606    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-maas-api-tls\") pod \"maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst\" (UID: \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:36.300886 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:36.300855    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:36.519941 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:36.519836    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:36.669577 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:36.669552    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"]
Jul 23 16:56:36.671766 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:56:36.671736    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf57c7643_551f_4a6a_b8d6_b2c9d831fdfe.slice/crio-9313e54f4a85594f55965b9fdb529f9f53ee4c2173787157884b030d9cd33c1f WatchSource:0}: Error finding container 9313e54f4a85594f55965b9fdb529f9f53ee4c2173787157884b030d9cd33c1f: Status 404 returned error can't find the container with id 9313e54f4a85594f55965b9fdb529f9f53ee4c2173787157884b030d9cd33c1f
Jul 23 16:56:37.201084 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:37.201052    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:37.304103 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:37.304066    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:37.365747 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:37.365707    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst" event={"ID":"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe","Type":"ContainerStarted","Data":"d2899b8dd0e25e2f71acac8e81bb3a4b438370704298531c5b3519c27295ee43"}
Jul 23 16:56:37.365974 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:37.365809    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst" event={"ID":"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe","Type":"ContainerStarted","Data":"9313e54f4a85594f55965b9fdb529f9f53ee4c2173787157884b030d9cd33c1f"}
Jul 23 16:56:37.365974 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:37.365834    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:37.385000 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:37.384894    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst" podStartSLOduration=1.9249136500000001 podStartE2EDuration="2.384876154s" totalImagesPullingTime="459.962504ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:56:37.383547854 +0000 UTC m=+2451.461975766" watchObservedRunningTime="2026-07-23 16:56:37.384876154 +0000 UTC m=+2451.463304045"
Jul 23 16:56:38.010731 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:38.010695    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:38.109969 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:38.109939    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:40.043316 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:40.043280    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:40.403207 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:40.403107    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:40.737111 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:40.737069    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:41.155741 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:41.155627    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:43.079240 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.079172    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:43.179191 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.179142    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:43.377306 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.377219    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 16:56:43.554028 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.553986    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:43.644285 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.644202    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"]
Jul 23 16:56:43.647896 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.647867    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:43.652355 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.652323    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-6a0c6b-serving-cert\""
Jul 23 16:56:43.659152 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.659123    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:43.661837 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.661809    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"]
Jul 23 16:56:43.746735 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.746689    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqs9r\" (UniqueName: \"kubernetes.io/projected/3ef15cdb-db53-4b74-8962-d792632381ff-kube-api-access-bqs9r\") pod \"maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq\" (UID: \"3ef15cdb-db53-4b74-8962-d792632381ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:43.746893 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.746758    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef15cdb-db53-4b74-8962-d792632381ff-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq\" (UID: \"3ef15cdb-db53-4b74-8962-d792632381ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:43.746893 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.746852    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ef15cdb-db53-4b74-8962-d792632381ff-maas-api-tls\") pod \"maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq\" (UID: \"3ef15cdb-db53-4b74-8962-d792632381ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:43.749821 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.749780    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:43.847753 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.847711    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef15cdb-db53-4b74-8962-d792632381ff-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq\" (UID: \"3ef15cdb-db53-4b74-8962-d792632381ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:43.847970 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.847765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ef15cdb-db53-4b74-8962-d792632381ff-maas-api-tls\") pod \"maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq\" (UID: \"3ef15cdb-db53-4b74-8962-d792632381ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:43.847970 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.847831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqs9r\" (UniqueName: \"kubernetes.io/projected/3ef15cdb-db53-4b74-8962-d792632381ff-kube-api-access-bqs9r\") pod \"maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq\" (UID: \"3ef15cdb-db53-4b74-8962-d792632381ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:43.847970 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:56:43.847939    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-serving-cert: secret "maas-api-e2e-shared-b-6a0c6b-serving-cert" not found
Jul 23 16:56:43.848155 ip-10-0-138-199 kubenswrapper[2576]: E0723 16:56:43.848010    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef15cdb-db53-4b74-8962-d792632381ff-maas-api-tls podName:3ef15cdb-db53-4b74-8962-d792632381ff nodeName:}" failed. No retries permitted until 2026-07-23 16:56:44.347991265 +0000 UTC m=+2458.426419152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3ef15cdb-db53-4b74-8962-d792632381ff-maas-api-tls") pod "maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq" (UID: "3ef15cdb-db53-4b74-8962-d792632381ff") : secret "maas-api-e2e-shared-b-6a0c6b-serving-cert" not found
Jul 23 16:56:43.848494 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.848469    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef15cdb-db53-4b74-8962-d792632381ff-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq\" (UID: \"3ef15cdb-db53-4b74-8962-d792632381ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:43.858182 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.858156    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqs9r\" (UniqueName: \"kubernetes.io/projected/3ef15cdb-db53-4b74-8962-d792632381ff-kube-api-access-bqs9r\") pod \"maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq\" (UID: \"3ef15cdb-db53-4b74-8962-d792632381ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:43.909809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:43.909721    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:44.259840 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:44.259800    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:44.352899 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:44.352850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ef15cdb-db53-4b74-8962-d792632381ff-maas-api-tls\") pod \"maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq\" (UID: \"3ef15cdb-db53-4b74-8962-d792632381ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:44.355462 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:44.355429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ef15cdb-db53-4b74-8962-d792632381ff-maas-api-tls\") pod \"maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq\" (UID: \"3ef15cdb-db53-4b74-8962-d792632381ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:44.360853 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:44.360822    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:44.561406 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:44.561313    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:44.714340 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:44.714312    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"]
Jul 23 16:56:44.716346 ip-10-0-138-199 kubenswrapper[2576]: W0723 16:56:44.716317    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef15cdb_db53_4b74_8962_d792632381ff.slice/crio-29706919f3fa1764645943dc01f99c274084b5d8996936c811928ebdf569b2f3 WatchSource:0}: Error finding container 29706919f3fa1764645943dc01f99c274084b5d8996936c811928ebdf569b2f3: Status 404 returned error can't find the container with id 29706919f3fa1764645943dc01f99c274084b5d8996936c811928ebdf569b2f3
Jul 23 16:56:45.405809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:45.405699    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq" event={"ID":"3ef15cdb-db53-4b74-8962-d792632381ff","Type":"ContainerStarted","Data":"2c5c50a87075e33e41c5d470f2cfe35741947d4d3685f8c23362649340a3351f"}
Jul 23 16:56:45.405809 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:45.405768    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq" event={"ID":"3ef15cdb-db53-4b74-8962-d792632381ff","Type":"ContainerStarted","Data":"29706919f3fa1764645943dc01f99c274084b5d8996936c811928ebdf569b2f3"}
Jul 23 16:56:45.406248 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:45.405899    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:45.424964 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:45.424900    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq" podStartSLOduration=2.003424784 podStartE2EDuration="2.424880973s" totalImagesPullingTime="421.456189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:56:45.424186128 +0000 UTC m=+2459.502614020" watchObservedRunningTime="2026-07-23 16:56:45.424880973 +0000 UTC m=+2459.503308863"
Jul 23 16:56:48.115361 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:48.115311    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:51.417968 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:51.417939    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 16:56:57.118584 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:57.118549    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:56:57.221859 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:56:57.221822    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:57:03.722497 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:57:03.722460    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:57:05.024674 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:57:05.024632    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:57:05.124761 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:57:05.124721    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:57:21.266568 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:57:21.266526    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:59:25.801276 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:59:25.801199    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:59:27.258580 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:59:27.258545    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 16:59:46.156803 ip-10-0-138-199 kubenswrapper[2576]: I0723 16:59:46.156739    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:00:14.649769 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:00:14.649727    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:00:22.054220 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:00:22.054188    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:00:46.559797 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:00:46.559716    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 17:00:46.566321 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:00:46.566298    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ffs9_649ecfc2-c40a-42c7-8265-d7222b74a67b/ovn-acl-logging/0.log"
Jul 23 17:00:49.910962 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:00:49.910922    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:00:57.744019 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:00:57.743988    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:00:58.740273 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:00:58.740239    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:01:01.745352 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:01:01.745315    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:01:13.845414 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:01:13.845376    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:01:24.029348 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:01:24.029316    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:01:38.027559 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:01:38.027492    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:01:38.125485 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:01:38.125451    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:01:58.001562 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:01:58.001501    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:01:58.128556 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:01:58.128522    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:01:59.692318 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:01:59.692283    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:02:01.251859 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:02:01.251818    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:02:05.950590 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:02:05.950555    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:02:06.052435 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:02:06.052399    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:02:42.093390 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:02:42.093360    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:02:43.077190 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:02:43.077156    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:02.787611 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:02.787572    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:02.892359 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:02.892322    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:12.522434 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:12.522402    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"]
Jul 23 17:03:12.524962 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:12.522648    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst" podUID="f57c7643-551f-4a6a-b8d6-b2c9d831fdfe" containerName="maas-api" containerID="cri-o://d2899b8dd0e25e2f71acac8e81bb3a4b438370704298531c5b3519c27295ee43" gracePeriod=30
Jul 23 17:03:12.546809 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:12.546751    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:12.788427 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:12.788400    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 17:03:12.829042 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:12.829008    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-openshift-service-ca\") pod \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\" (UID: \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\") "
Jul 23 17:03:12.829042 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:12.829048    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-maas-api-tls\") pod \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\" (UID: \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\") "
Jul 23 17:03:12.829254 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:12.829180    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gphcz\" (UniqueName: \"kubernetes.io/projected/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-kube-api-access-gphcz\") pod \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\" (UID: \"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe\") "
Jul 23 17:03:12.829407 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:12.829382    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f57c7643-551f-4a6a-b8d6-b2c9d831fdfe" (UID: "f57c7643-551f-4a6a-b8d6-b2c9d831fdfe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 17:03:12.829585 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:12.829564    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-openshift-service-ca\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 17:03:12.831254 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:12.831226    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f57c7643-551f-4a6a-b8d6-b2c9d831fdfe" (UID: "f57c7643-551f-4a6a-b8d6-b2c9d831fdfe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 17:03:12.831365 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:12.831278    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-kube-api-access-gphcz" (OuterVolumeSpecName: "kube-api-access-gphcz") pod "f57c7643-551f-4a6a-b8d6-b2c9d831fdfe" (UID: "f57c7643-551f-4a6a-b8d6-b2c9d831fdfe"). InnerVolumeSpecName "kube-api-access-gphcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:03:12.930242 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:12.930203    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-maas-api-tls\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 17:03:12.930242 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:12.930235    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gphcz\" (UniqueName: \"kubernetes.io/projected/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe-kube-api-access-gphcz\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 17:03:13.390906 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:13.390873    2576 generic.go:356] "Generic (PLEG): container finished" podID="f57c7643-551f-4a6a-b8d6-b2c9d831fdfe" containerID="d2899b8dd0e25e2f71acac8e81bb3a4b438370704298531c5b3519c27295ee43" exitCode=0
Jul 23 17:03:13.391076 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:13.390918    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"
Jul 23 17:03:13.391076 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:13.390933    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst" event={"ID":"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe","Type":"ContainerDied","Data":"d2899b8dd0e25e2f71acac8e81bb3a4b438370704298531c5b3519c27295ee43"}
Jul 23 17:03:13.391076 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:13.390975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst" event={"ID":"f57c7643-551f-4a6a-b8d6-b2c9d831fdfe","Type":"ContainerDied","Data":"9313e54f4a85594f55965b9fdb529f9f53ee4c2173787157884b030d9cd33c1f"}
Jul 23 17:03:13.391076 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:13.390996    2576 scope.go:117] "RemoveContainer" containerID="d2899b8dd0e25e2f71acac8e81bb3a4b438370704298531c5b3519c27295ee43"
Jul 23 17:03:13.402092 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:13.402063    2576 scope.go:117] "RemoveContainer" containerID="d2899b8dd0e25e2f71acac8e81bb3a4b438370704298531c5b3519c27295ee43"
Jul 23 17:03:13.402481 ip-10-0-138-199 kubenswrapper[2576]: E0723 17:03:13.402463    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2899b8dd0e25e2f71acac8e81bb3a4b438370704298531c5b3519c27295ee43\": container with ID starting with d2899b8dd0e25e2f71acac8e81bb3a4b438370704298531c5b3519c27295ee43 not found: ID does not exist" containerID="d2899b8dd0e25e2f71acac8e81bb3a4b438370704298531c5b3519c27295ee43"
Jul 23 17:03:13.402610 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:13.402494    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2899b8dd0e25e2f71acac8e81bb3a4b438370704298531c5b3519c27295ee43"} err="failed to get container status \"d2899b8dd0e25e2f71acac8e81bb3a4b438370704298531c5b3519c27295ee43\": rpc error: code = NotFound desc = could not find container \"d2899b8dd0e25e2f71acac8e81bb3a4b438370704298531c5b3519c27295ee43\": container with ID starting with d2899b8dd0e25e2f71acac8e81bb3a4b438370704298531c5b3519c27295ee43 not found: ID does not exist"
Jul 23 17:03:13.412037 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:13.412012    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"]
Jul 23 17:03:13.416033 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:13.416010    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dc9a69-cc9c97445-njvst"]
Jul 23 17:03:14.492493 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:14.492460    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f57c7643-551f-4a6a-b8d6-b2c9d831fdfe" path="/var/lib/kubelet/pods/f57c7643-551f-4a6a-b8d6-b2c9d831fdfe/volumes"
Jul 23 17:03:17.180574 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:17.180535    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:17.606166 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:17.606077    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:24.026898 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:24.026866    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:24.127855 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:24.127820    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:24.272767 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:24.272726    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:24.529201 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:24.529169    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:25.360085 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:25.360055    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:25.461141 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:25.461108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:35.135077 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.135038    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"]
Jul 23 17:03:35.135474 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.135245    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq" podUID="3ef15cdb-db53-4b74-8962-d792632381ff" containerName="maas-api" containerID="cri-o://2c5c50a87075e33e41c5d470f2cfe35741947d4d3685f8c23362649340a3351f" gracePeriod=30
Jul 23 17:03:35.156168 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.156135    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:35.398746 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.398675    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 17:03:35.506283 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.506244    2576 generic.go:356] "Generic (PLEG): container finished" podID="3ef15cdb-db53-4b74-8962-d792632381ff" containerID="2c5c50a87075e33e41c5d470f2cfe35741947d4d3685f8c23362649340a3351f" exitCode=0
Jul 23 17:03:35.506481 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.506290    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"
Jul 23 17:03:35.506481 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.506312    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq" event={"ID":"3ef15cdb-db53-4b74-8962-d792632381ff","Type":"ContainerDied","Data":"2c5c50a87075e33e41c5d470f2cfe35741947d4d3685f8c23362649340a3351f"}
Jul 23 17:03:35.506481 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.506356    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq" event={"ID":"3ef15cdb-db53-4b74-8962-d792632381ff","Type":"ContainerDied","Data":"29706919f3fa1764645943dc01f99c274084b5d8996936c811928ebdf569b2f3"}
Jul 23 17:03:35.506481 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.506379    2576 scope.go:117] "RemoveContainer" containerID="2c5c50a87075e33e41c5d470f2cfe35741947d4d3685f8c23362649340a3351f"
Jul 23 17:03:35.515009 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.514986    2576 scope.go:117] "RemoveContainer" containerID="2c5c50a87075e33e41c5d470f2cfe35741947d4d3685f8c23362649340a3351f"
Jul 23 17:03:35.515269 ip-10-0-138-199 kubenswrapper[2576]: E0723 17:03:35.515248    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c5c50a87075e33e41c5d470f2cfe35741947d4d3685f8c23362649340a3351f\": container with ID starting with 2c5c50a87075e33e41c5d470f2cfe35741947d4d3685f8c23362649340a3351f not found: ID does not exist" containerID="2c5c50a87075e33e41c5d470f2cfe35741947d4d3685f8c23362649340a3351f"
Jul 23 17:03:35.515320 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.515285    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c5c50a87075e33e41c5d470f2cfe35741947d4d3685f8c23362649340a3351f"} err="failed to get container status \"2c5c50a87075e33e41c5d470f2cfe35741947d4d3685f8c23362649340a3351f\": rpc error: code = NotFound desc = could not find container \"2c5c50a87075e33e41c5d470f2cfe35741947d4d3685f8c23362649340a3351f\": container with ID starting with 2c5c50a87075e33e41c5d470f2cfe35741947d4d3685f8c23362649340a3351f not found: ID does not exist"
Jul 23 17:03:35.549293 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.549267    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqs9r\" (UniqueName: \"kubernetes.io/projected/3ef15cdb-db53-4b74-8962-d792632381ff-kube-api-access-bqs9r\") pod \"3ef15cdb-db53-4b74-8962-d792632381ff\" (UID: \"3ef15cdb-db53-4b74-8962-d792632381ff\") "
Jul 23 17:03:35.549414 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.549319    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ef15cdb-db53-4b74-8962-d792632381ff-maas-api-tls\") pod \"3ef15cdb-db53-4b74-8962-d792632381ff\" (UID: \"3ef15cdb-db53-4b74-8962-d792632381ff\") "
Jul 23 17:03:35.549414 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.549379    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef15cdb-db53-4b74-8962-d792632381ff-openshift-service-ca\") pod \"3ef15cdb-db53-4b74-8962-d792632381ff\" (UID: \"3ef15cdb-db53-4b74-8962-d792632381ff\") "
Jul 23 17:03:35.549786 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.549762    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ef15cdb-db53-4b74-8962-d792632381ff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3ef15cdb-db53-4b74-8962-d792632381ff" (UID: "3ef15cdb-db53-4b74-8962-d792632381ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 17:03:35.551314 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.551291    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ef15cdb-db53-4b74-8962-d792632381ff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3ef15cdb-db53-4b74-8962-d792632381ff" (UID: "3ef15cdb-db53-4b74-8962-d792632381ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 17:03:35.551435 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.551420    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ef15cdb-db53-4b74-8962-d792632381ff-kube-api-access-bqs9r" (OuterVolumeSpecName: "kube-api-access-bqs9r") pod "3ef15cdb-db53-4b74-8962-d792632381ff" (UID: "3ef15cdb-db53-4b74-8962-d792632381ff"). InnerVolumeSpecName "kube-api-access-bqs9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:03:35.650762 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.650677    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ef15cdb-db53-4b74-8962-d792632381ff-maas-api-tls\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 17:03:35.650762 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.650707    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef15cdb-db53-4b74-8962-d792632381ff-openshift-service-ca\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 17:03:35.650762 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.650717    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqs9r\" (UniqueName: \"kubernetes.io/projected/3ef15cdb-db53-4b74-8962-d792632381ff-kube-api-access-bqs9r\") on node \"ip-10-0-138-199.ec2.internal\" DevicePath \"\""
Jul 23 17:03:35.840918 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.840885    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"]
Jul 23 17:03:35.848627 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:35.848600    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6a0c6b-85d84bc6d4-8x6qq"]
Jul 23 17:03:36.493598 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:36.493564    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ef15cdb-db53-4b74-8962-d792632381ff" path="/var/lib/kubelet/pods/3ef15cdb-db53-4b74-8962-d792632381ff/volumes"
Jul 23 17:03:39.737909 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:39.737785    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:40.175107 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:40.175059    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:46.460239 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:46.460177    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:46.609914 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:46.609877    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:46.802112 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:46.802077    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:47.059255 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:47.059166    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:03:53.673992 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:53.673956    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-857f74fb4d-nkjjv_311a13ae-de99-4a75-9850-4f6dc3b1224c/manager/0.log"
Jul 23 17:03:54.061881 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:54.061794    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678945769f-46pvj_8b73bb7d-8bae-4e24-a72f-c9d1332dea2c/copy-manifests/0.log"
Jul 23 17:03:54.075631 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:54.075597    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678945769f-46pvj_8b73bb7d-8bae-4e24-a72f-c9d1332dea2c/manager/0.log"
Jul 23 17:03:54.734188 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:54.734155    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-57f7d5bf49-tr76n_8772159d-04ee-44cd-9ac6-18b8e8e5f0cd/maas-api/0.log"
Jul 23 17:03:55.234489 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:55.234449    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-r8hmd_de5a045d-c56f-4f01-b8c3-8d293a205672/postgres/0.log"
Jul 23 17:03:56.911381 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:56.911334    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5mc47_80f8a9f5-2452-4196-a6f4-1458461513b8/manager/0.log"
Jul 23 17:03:57.552168 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:57.552136    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tj9r9_b9da788a-a7b9-4b74-91c4-b7db6c310253/manager/0.log"
Jul 23 17:03:57.924224 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:57.924193    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4phf7n_66c78d79-8577-4d60-8657-fe5c6ab15b64/istio-proxy/0.log"
Jul 23 17:03:58.054855 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:58.054828    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9ztk8_96fdd75b-015b-4927-9d69-a86a42d97771/discovery/0.log"
Jul 23 17:03:58.305381 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:58.305295    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545d74bcdb-xhdg5_73169176-123c-4f27-9011-1c506f90c1f5/kube-auth-proxy/0.log"
Jul 23 17:03:58.434487 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:58.434455    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8qpg2_e919fea6-ce69-4f1a-b915-32952ac61bdb/istio-proxy/1.log"
Jul 23 17:03:58.569290 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:58.569203    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-lbgk4_6b0ea791-826a-421c-9d12-de46db9816c2/payload-pre-processing/0.log"
Jul 23 17:03:58.696650 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:58.696618    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-75t8f_74e04e98-29ee-4c3f-bd17-241b4592420e/payload-processing/0.log"
Jul 23 17:03:59.317457 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:59.317429    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-8xzfg_fe59aabc-868d-4bbb-8270-1e163ab8a069/main/0.log"
Jul 23 17:03:59.444243 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:59.444211    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4pdpk_a873cc42-6ecd-42f8-b98a-3390c9bad22c/main/0.log"
Jul 23 17:03:59.697146 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:03:59.697116    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-ct5h5_cae8b136-43f4-4a85-9c38-55e2e7abe474/main/0.log"
Jul 23 17:04:06.214978 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:06.214929    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:04:06.457709 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:06.457674    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log" limit=1024
Jul 23 17:04:09.572549 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:09.572499    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lrbgb_3e56bbd1-51ad-4f56-b2cf-a9b7e5256fc7/global-pull-secret-syncer/0.log"
Jul 23 17:04:09.619982 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:09.619950    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ftmhx_791c2ce5-f0c6-40c9-a70d-eed11f5a1044/konnectivity-agent/0.log"
Jul 23 17:04:09.733112 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:09.733080    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-199.ec2.internal_f14cf1c9a8c48460a0bf4348398408ba/haproxy/0.log"
Jul 23 17:04:14.993981 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:14.993949    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5mc47_80f8a9f5-2452-4196-a6f4-1458461513b8/manager/0.log"
Jul 23 17:04:15.349141 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:15.349053    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tj9r9_b9da788a-a7b9-4b74-91c4-b7db6c310253/manager/0.log"
Jul 23 17:04:17.366453 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:17.366422    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-h4f7l_26eee933-e958-4c56-accb-e2a8a96311f2/monitoring-plugin/0.log"
Jul 23 17:04:17.572033 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:17.572006    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z6pqj_62b70892-9f62-4d0c-a897-78c6ee811c67/node-exporter/0.log"
Jul 23 17:04:17.594249 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:17.594202    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z6pqj_62b70892-9f62-4d0c-a897-78c6ee811c67/kube-rbac-proxy/0.log"
Jul 23 17:04:17.617325 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:17.617234    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z6pqj_62b70892-9f62-4d0c-a897-78c6ee811c67/init-textfile/0.log"
Jul 23 17:04:17.911834 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:17.911744    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-s8hcj_556dfb4f-2f1b-4664-82bf-079b609d103a/prometheus-operator/0.log"
Jul 23 17:04:17.936044 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:17.936018    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-s8hcj_556dfb4f-2f1b-4664-82bf-079b609d103a/kube-rbac-proxy/0.log"
Jul 23 17:04:18.001968 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:18.001941    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c8f58b6dd-rmqct_4efb0ade-fcdb-4038-acd1-8bcc230d720a/telemeter-client/0.log"
Jul 23 17:04:18.026063 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:18.026032    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c8f58b6dd-rmqct_4efb0ade-fcdb-4038-acd1-8bcc230d720a/reload/0.log"
Jul 23 17:04:18.048957 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:18.048928    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c8f58b6dd-rmqct_4efb0ade-fcdb-4038-acd1-8bcc230d720a/kube-rbac-proxy/0.log"
Jul 23 17:04:18.081262 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:18.081238    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5679c9c79f-cfg9v_733fbc83-a390-4758-a26c-313fa008f89b/thanos-query/0.log"
Jul 23 17:04:18.107743 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:18.107714    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5679c9c79f-cfg9v_733fbc83-a390-4758-a26c-313fa008f89b/kube-rbac-proxy-web/0.log"
Jul 23 17:04:18.150594 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:18.150566    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5679c9c79f-cfg9v_733fbc83-a390-4758-a26c-313fa008f89b/kube-rbac-proxy/0.log"
Jul 23 17:04:18.182697 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:18.182669    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5679c9c79f-cfg9v_733fbc83-a390-4758-a26c-313fa008f89b/prom-label-proxy/0.log"
Jul 23 17:04:18.209091 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:18.209050    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5679c9c79f-cfg9v_733fbc83-a390-4758-a26c-313fa008f89b/kube-rbac-proxy-rules/0.log"
Jul 23 17:04:18.232164 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:18.232140    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5679c9c79f-cfg9v_733fbc83-a390-4758-a26c-313fa008f89b/kube-rbac-proxy-metrics/0.log"
Jul 23 17:04:19.658874 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.658841    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"]
Jul 23 17:04:19.659249 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.659223    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ef15cdb-db53-4b74-8962-d792632381ff" containerName="maas-api"
Jul 23 17:04:19.659249 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.659235    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ef15cdb-db53-4b74-8962-d792632381ff" containerName="maas-api"
Jul 23 17:04:19.659249 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.659250    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f57c7643-551f-4a6a-b8d6-b2c9d831fdfe" containerName="maas-api"
Jul 23 17:04:19.659351 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.659256    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f57c7643-551f-4a6a-b8d6-b2c9d831fdfe" containerName="maas-api"
Jul 23 17:04:19.659351 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.659328    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f57c7643-551f-4a6a-b8d6-b2c9d831fdfe" containerName="maas-api"
Jul 23 17:04:19.659351 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.659339    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ef15cdb-db53-4b74-8962-d792632381ff" containerName="maas-api"
Jul 23 17:04:19.662767 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.662749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.664852 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.664830    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wvj2n\"/\"default-dockercfg-9xm84\""
Jul 23 17:04:19.664852 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.664845    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wvj2n\"/\"kube-root-ca.crt\""
Jul 23 17:04:19.665027 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.664830    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wvj2n\"/\"openshift-service-ca.crt\""
Jul 23 17:04:19.672761 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.672737    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"]
Jul 23 17:04:19.769061 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.769023    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f06ba288-4631-4883-b5df-573286f6948b-sys\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.769061 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.769062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f06ba288-4631-4883-b5df-573286f6948b-proc\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.769317 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.769079    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f06ba288-4631-4883-b5df-573286f6948b-podres\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.769317 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.769137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f06ba288-4631-4883-b5df-573286f6948b-lib-modules\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.769317 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.769165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4twr\" (UniqueName: \"kubernetes.io/projected/f06ba288-4631-4883-b5df-573286f6948b-kube-api-access-q4twr\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.870245 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.870210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f06ba288-4631-4883-b5df-573286f6948b-sys\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.870245 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.870248    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f06ba288-4631-4883-b5df-573286f6948b-proc\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.870502 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.870267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f06ba288-4631-4883-b5df-573286f6948b-podres\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.870502 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.870301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f06ba288-4631-4883-b5df-573286f6948b-lib-modules\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.870502 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.870329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4twr\" (UniqueName: \"kubernetes.io/projected/f06ba288-4631-4883-b5df-573286f6948b-kube-api-access-q4twr\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.870502 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.870358    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f06ba288-4631-4883-b5df-573286f6948b-proc\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.870502 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.870358    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f06ba288-4631-4883-b5df-573286f6948b-sys\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.870502 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.870404    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f06ba288-4631-4883-b5df-573286f6948b-podres\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.870502 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.870451    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f06ba288-4631-4883-b5df-573286f6948b-lib-modules\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.877469 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.877444    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4twr\" (UniqueName: \"kubernetes.io/projected/f06ba288-4631-4883-b5df-573286f6948b-kube-api-access-q4twr\") pod \"perf-node-gather-daemonset-2hnh8\" (UID: \"f06ba288-4631-4883-b5df-573286f6948b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:19.973354 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:19.973317    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:20.111570 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:20.111536    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"]
Jul 23 17:04:20.115184 ip-10-0-138-199 kubenswrapper[2576]: W0723 17:04:20.115150    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf06ba288_4631_4883_b5df_573286f6948b.slice/crio-29bc305ba3958d3fedd550e3eefe0f1e8f878816f6c50be7b9fc8952ab2f3598 WatchSource:0}: Error finding container 29bc305ba3958d3fedd550e3eefe0f1e8f878816f6c50be7b9fc8952ab2f3598: Status 404 returned error can't find the container with id 29bc305ba3958d3fedd550e3eefe0f1e8f878816f6c50be7b9fc8952ab2f3598
Jul 23 17:04:20.729781 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:20.729742    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8" event={"ID":"f06ba288-4631-4883-b5df-573286f6948b","Type":"ContainerStarted","Data":"ad015ae5572e436be4dd360c963fba6ced9c752a935144d6bbf2c4f12a4bb48f"}
Jul 23 17:04:20.730269 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:20.729801    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8" event={"ID":"f06ba288-4631-4883-b5df-573286f6948b","Type":"ContainerStarted","Data":"29bc305ba3958d3fedd550e3eefe0f1e8f878816f6c50be7b9fc8952ab2f3598"}
Jul 23 17:04:20.730269 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:20.729861    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:20.748560 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:20.748489    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8" podStartSLOduration=1.748473197 podStartE2EDuration="1.748473197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:04:20.745566783 +0000 UTC m=+2914.823994668" watchObservedRunningTime="2026-07-23 17:04:20.748473197 +0000 UTC m=+2914.826901087"
Jul 23 17:04:22.312594 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:22.312564    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m7lrs_673eeaec-efbd-4189-a3e5-b64a585f39c8/dns/0.log"
Jul 23 17:04:22.332694 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:22.332670    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m7lrs_673eeaec-efbd-4189-a3e5-b64a585f39c8/kube-rbac-proxy/0.log"
Jul 23 17:04:22.382954 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:22.382925    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kl24z_2cf0f0b6-bffc-4f05-9e7a-796cbe1a35b8/dns-node-resolver/0.log"
Jul 23 17:04:22.914997 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:22.914957    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6996878896-wlsfx_ce2b5089-9751-4142-b70c-729502337dd6/registry/0.log"
Jul 23 17:04:22.965133 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:22.965099    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hbbf4_c5760df7-1880-4919-b43c-47398f52a1f7/node-ca/0.log"
Jul 23 17:04:23.943941 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:23.943909    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4phf7n_66c78d79-8577-4d60-8657-fe5c6ab15b64/istio-proxy/0.log"
Jul 23 17:04:24.074290 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:24.074258    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9ztk8_96fdd75b-015b-4927-9d69-a86a42d97771/discovery/0.log"
Jul 23 17:04:24.120367 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:24.120340    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545d74bcdb-xhdg5_73169176-123c-4f27-9011-1c506f90c1f5/kube-auth-proxy/0.log"
Jul 23 17:04:24.148194 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:24.148164    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8qpg2_e919fea6-ce69-4f1a-b915-32952ac61bdb/istio-proxy/0.log"
Jul 23 17:04:24.173686 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:24.173657    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8qpg2_e919fea6-ce69-4f1a-b915-32952ac61bdb/istio-proxy/1.log"
Jul 23 17:04:24.206150 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:24.206068    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-lbgk4_6b0ea791-826a-421c-9d12-de46db9816c2/payload-pre-processing/0.log"
Jul 23 17:04:24.235907 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:24.235879    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-75t8f_74e04e98-29ee-4c3f-bd17-241b4592420e/payload-processing/0.log"
Jul 23 17:04:24.920389 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:24.920359    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fxvqj_3e5980c4-c5f1-40a9-a0ee-9cadabb68d0c/serve-healthcheck-canary/0.log"
Jul 23 17:04:25.482908 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:25.482878    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h9nrn_2170c531-389a-47f3-ad79-7a1ae1c90a7b/kube-rbac-proxy/0.log"
Jul 23 17:04:25.511346 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:25.511317    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h9nrn_2170c531-389a-47f3-ad79-7a1ae1c90a7b/exporter/0.log"
Jul 23 17:04:25.535048 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:25.535016    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h9nrn_2170c531-389a-47f3-ad79-7a1ae1c90a7b/extractor/0.log"
Jul 23 17:04:26.745245 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:26.745216    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-2hnh8"
Jul 23 17:04:28.050498 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:28.050467    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-857f74fb4d-nkjjv_311a13ae-de99-4a75-9850-4f6dc3b1224c/manager/0.log"
Jul 23 17:04:28.443241 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:28.443207    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678945769f-46pvj_8b73bb7d-8bae-4e24-a72f-c9d1332dea2c/manager/0.log"
Jul 23 17:04:28.461866 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:28.461842    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678945769f-46pvj_8b73bb7d-8bae-4e24-a72f-c9d1332dea2c/copy-manifests/0.log"
Jul 23 17:04:30.071249 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:30.071217    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-l6j6l_0e04c6af-0c33-498d-b90d-707694237c28/openshift-lws-operator/0.log"
Jul 23 17:04:30.201852 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:30.201821    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4phf7n_66c78d79-8577-4d60-8657-fe5c6ab15b64/istio-proxy/0.log"
Jul 23 17:04:30.319566 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:30.319535    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9ztk8_96fdd75b-015b-4927-9d69-a86a42d97771/discovery/0.log"
Jul 23 17:04:30.346938 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:30.346910    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545d74bcdb-xhdg5_73169176-123c-4f27-9011-1c506f90c1f5/kube-auth-proxy/0.log"
Jul 23 17:04:30.377650 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:30.377603    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8qpg2_e919fea6-ce69-4f1a-b915-32952ac61bdb/istio-proxy/0.log"
Jul 23 17:04:30.402268 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:30.402224    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8qpg2_e919fea6-ce69-4f1a-b915-32952ac61bdb/istio-proxy/1.log"
Jul 23 17:04:30.423478 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:30.423452    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-lbgk4_6b0ea791-826a-421c-9d12-de46db9816c2/payload-pre-processing/0.log"
Jul 23 17:04:30.449483 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:30.449457    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-75t8f_74e04e98-29ee-4c3f-bd17-241b4592420e/payload-processing/0.log"
Jul 23 17:04:31.675883 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:31.675854    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4phf7n_66c78d79-8577-4d60-8657-fe5c6ab15b64/istio-proxy/0.log"
Jul 23 17:04:31.811425 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:31.811395    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9ztk8_96fdd75b-015b-4927-9d69-a86a42d97771/discovery/0.log"
Jul 23 17:04:31.853237 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:31.853209    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545d74bcdb-xhdg5_73169176-123c-4f27-9011-1c506f90c1f5/kube-auth-proxy/0.log"
Jul 23 17:04:31.883979 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:31.883933    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8qpg2_e919fea6-ce69-4f1a-b915-32952ac61bdb/istio-proxy/0.log"
Jul 23 17:04:31.910866 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:31.910836    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8qpg2_e919fea6-ce69-4f1a-b915-32952ac61bdb/istio-proxy/1.log"
Jul 23 17:04:31.936755 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:31.936663    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-lbgk4_6b0ea791-826a-421c-9d12-de46db9816c2/payload-pre-processing/0.log"
Jul 23 17:04:31.961569 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:31.961544    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-75t8f_74e04e98-29ee-4c3f-bd17-241b4592420e/payload-processing/0.log"
Jul 23 17:04:36.698754 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:36.698727    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2pv8b_ad1d0917-834d-4557-8fa0-96f4b4e5021a/kube-multus/0.log"
Jul 23 17:04:36.752419 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:36.752391    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnhfg_8ef77fd7-fb93-4940-b1f6-03591148fb4f/kube-multus-additional-cni-plugins/0.log"
Jul 23 17:04:36.782277 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:36.782249    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnhfg_8ef77fd7-fb93-4940-b1f6-03591148fb4f/egress-router-binary-copy/0.log"
Jul 23 17:04:36.803656 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:36.803628    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnhfg_8ef77fd7-fb93-4940-b1f6-03591148fb4f/cni-plugins/0.log"
Jul 23 17:04:36.829423 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:36.829395    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnhfg_8ef77fd7-fb93-4940-b1f6-03591148fb4f/bond-cni-plugin/0.log"
Jul 23 17:04:36.853481 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:36.853451    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnhfg_8ef77fd7-fb93-4940-b1f6-03591148fb4f/routeoverride-cni/0.log"
Jul 23 17:04:36.876354 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:36.876328    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnhfg_8ef77fd7-fb93-4940-b1f6-03591148fb4f/whereabouts-cni-bincopy/0.log"
Jul 23 17:04:36.901984 ip-10-0-138-199 kubenswrapper[2576]: I0723 17:04:36.901958    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnhfg_8ef77fd7-fb93-4940-b1f6-03591148fb4f/whereabouts-cni/0.log"