Aug 05 19:01:38.395321 ip-10-0-143-76 systemd[1]: Starting Kubernetes Kubelet...
Aug 05 19:01:38.766145 ip-10-0-143-76 kubenswrapper[2533]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 19:01:38.766145 ip-10-0-143-76 kubenswrapper[2533]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 05 19:01:38.766145 ip-10-0-143-76 kubenswrapper[2533]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 19:01:38.766145 ip-10-0-143-76 kubenswrapper[2533]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 05 19:01:38.766145 ip-10-0-143-76 kubenswrapper[2533]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 19:01:38.768092 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.767958    2533 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 05 19:01:38.774357 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774328    2533 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 19:01:38.774357 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774351    2533 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 19:01:38.774357 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774355    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 19:01:38.774357 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774360    2533 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 19:01:38.774357 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774363    2533 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 19:01:38.774357 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774366    2533 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774369    2533 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774372    2533 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774375    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774378    2533 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774383    2533 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774388    2533 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774392    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774396    2533 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774399    2533 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774403    2533 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774406    2533 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774409    2533 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774412    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774415    2533 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774418    2533 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774420    2533 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774424    2533 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774426    2533 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774429    2533 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 19:01:38.774596 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774432    2533 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774435    2533 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774437    2533 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774440    2533 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774443    2533 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774446    2533 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774448    2533 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774451    2533 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774453    2533 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774456    2533 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774459    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774462    2533 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774464    2533 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774467    2533 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774474    2533 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774476    2533 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774479    2533 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774482    2533 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774484    2533 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 19:01:38.775115 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774487    2533 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774490    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774492    2533 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774495    2533 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774498    2533 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774501    2533 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774504    2533 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774507    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774510    2533 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774512    2533 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774515    2533 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774517    2533 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774520    2533 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774523    2533 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774525    2533 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774528    2533 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774531    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774534    2533 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774536    2533 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774539    2533 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 19:01:38.775578 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774541    2533 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774544    2533 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774547    2533 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774550    2533 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774553    2533 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774555    2533 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774558    2533 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774562    2533 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774564    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774567    2533 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774570    2533 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774572    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774575    2533 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774578    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774581    2533 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774583    2533 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774586    2533 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774588    2533 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774591    2533 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774595    2533 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 19:01:38.776078 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774598    2533 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774601    2533 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774604    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774607    2533 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774610    2533 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774612    2533 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774615    2533 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774618    2533 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774620    2533 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774623    2533 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774626    2533 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774628    2533 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774631    2533 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774634    2533 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.774638    2533 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775450    2533 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775459    2533 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775463    2533 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775466    2533 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 19:01:38.776612 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775470    2533 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775473    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775475    2533 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775479    2533 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775482    2533 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775484    2533 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775488    2533 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775491    2533 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775494    2533 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775496    2533 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775499    2533 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775502    2533 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775505    2533 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775508    2533 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775511    2533 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775514    2533 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775517    2533 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775519    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775522    2533 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775526    2533 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 19:01:38.777081 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775530    2533 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775533    2533 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775536    2533 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775539    2533 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775542    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775544    2533 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775547    2533 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775550    2533 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775552    2533 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775555    2533 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775558    2533 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775561    2533 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775565    2533 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775568    2533 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775570    2533 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775573    2533 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775576    2533 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775579    2533 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775582    2533 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775585    2533 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 19:01:38.777582 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775588    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775591    2533 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775593    2533 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775651    2533 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775655    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775659    2533 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775662    2533 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775666    2533 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775668    2533 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775671    2533 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775676    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775679    2533 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775682    2533 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775685    2533 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775688    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775691    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775694    2533 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775698    2533 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775700    2533 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775703    2533 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 19:01:38.778088 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775706    2533 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775709    2533 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775712    2533 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775714    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775717    2533 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775720    2533 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775722    2533 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775725    2533 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775728    2533 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775732    2533 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775736    2533 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775739    2533 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775743    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775746    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775749    2533 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775751    2533 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775754    2533 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775757    2533 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775759    2533 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 19:01:38.778580 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775762    2533 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775765    2533 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775768    2533 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775770    2533 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775773    2533 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775776    2533 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775779    2533 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775781    2533 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775784    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775788    2533 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775792    2533 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775802    2533 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775805    2533 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775809    2533 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775812    2533 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.775814    2533 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776267    2533 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776273    2533 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776276    2533 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 19:01:38.779070 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776280    2533 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776283    2533 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776286    2533 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776289    2533 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776292    2533 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776295    2533 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776298    2533 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776301    2533 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776304    2533 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776307    2533 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776309    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776312    2533 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776315    2533 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776318    2533 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776321    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776323    2533 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776326    2533 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776329    2533 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776333    2533 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776335    2533 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 19:01:38.779558 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776338    2533 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776340    2533 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776343    2533 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776346    2533 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776349    2533 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776352    2533 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776355    2533 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776358    2533 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776361    2533 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776363    2533 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776367    2533 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776371    2533 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776375    2533 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776378    2533 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776380    2533 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776383    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776386    2533 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776389    2533 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776391    2533 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 19:01:38.780059 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776394    2533 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776397    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776400    2533 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776402    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776405    2533 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776408    2533 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776410    2533 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776414    2533 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776417    2533 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776420    2533 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776422    2533 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776425    2533 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776427    2533 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776430    2533 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776432    2533 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776435    2533 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776438    2533 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776442    2533 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776445    2533 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 19:01:38.780511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776448    2533 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776451    2533 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776454    2533 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776456    2533 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776459    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776462    2533 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776464    2533 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776467    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776470    2533 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776473    2533 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776475    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776478    2533 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776481    2533 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776483    2533 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776486    2533 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776489    2533 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776494    2533 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776498    2533 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776501    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776503    2533 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 19:01:38.780980 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776506    2533 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776510    2533 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776513    2533 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776515    2533 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776518    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776521    2533 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776523    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776526    2533 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776529    2533 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776532    2533 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776535    2533 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776537    2533 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776540    2533 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776543    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776545    2533 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776548    2533 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776551    2533 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.776556    2533 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776638    2533 flags.go:64] FLAG: --address="0.0.0.0"
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776647    2533 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 05 19:01:38.781510 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776655    2533 flags.go:64] FLAG: --anonymous-auth="true"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776661    2533 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776667    2533 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776672    2533 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776677    2533 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776682    2533 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776685    2533 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776688    2533 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776691    2533 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776695    2533 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776698    2533 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776701    2533 flags.go:64] FLAG: --cgroup-root=""
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776704    2533 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776708    2533 flags.go:64] FLAG: --client-ca-file=""
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776712    2533 flags.go:64] FLAG: --cloud-provider="external"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776715    2533 flags.go:64] FLAG: --cluster-dns="[]"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776719    2533 flags.go:64] FLAG: --cluster-domain=""
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776722    2533 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776725    2533 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776728    2533 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776731    2533 flags.go:64] FLAG: --container-log-max-files="5"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776736    2533 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776739    2533 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 05 19:01:38.782021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776742    2533 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776746    2533 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776749    2533 flags.go:64] FLAG: --contention-profiling="false"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776752    2533 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776755    2533 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776758    2533 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776763    2533 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776768    2533 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776771    2533 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776774    2533 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776777    2533 flags.go:64] FLAG: --enable-load-reader="false"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776780    2533 flags.go:64] FLAG: --enable-server="true"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776784    2533 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776789    2533 flags.go:64] FLAG: --event-burst="100"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776792    2533 flags.go:64] FLAG: --event-qps="50"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776795    2533 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776799    2533 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776802    2533 flags.go:64] FLAG: --eviction-hard=""
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776806    2533 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776809    2533 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776812    2533 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776815    2533 flags.go:64] FLAG: --eviction-soft=""
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776818    2533 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776821    2533 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776825    2533 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 05 19:01:38.782566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776828    2533 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776831    2533 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776834    2533 flags.go:64] FLAG: --fail-swap-on="true"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776837    2533 flags.go:64] FLAG: --feature-gates=""
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776841    2533 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776845    2533 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776848    2533 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776851    2533 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776855    2533 flags.go:64] FLAG: --healthz-port="10248"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776858    2533 flags.go:64] FLAG: --help="false"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776861    2533 flags.go:64] FLAG: --hostname-override="ip-10-0-143-76.ec2.internal"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776864    2533 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776867    2533 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776871    2533 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776875    2533 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776878    2533 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776881    2533 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776884    2533 flags.go:64] FLAG: --image-service-endpoint=""
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776887    2533 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776890    2533 flags.go:64] FLAG: --kube-api-burst="100"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776893    2533 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776896    2533 flags.go:64] FLAG: --kube-api-qps="50"
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776899    2533 flags.go:64] FLAG: --kube-reserved=""
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776902    2533 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 05 19:01:38.783208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776905    2533 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776908    2533 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776911    2533 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776914    2533 flags.go:64] FLAG: --lock-file=""
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776917    2533 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776920    2533 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776923    2533 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776929    2533 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776932    2533 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776935    2533 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776938    2533 flags.go:64] FLAG: --logging-format="text"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776941    2533 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776945    2533 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776948    2533 flags.go:64] FLAG: --manifest-url=""
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776951    2533 flags.go:64] FLAG: --manifest-url-header=""
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776955    2533 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776958    2533 flags.go:64] FLAG: --max-open-files="1000000"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776963    2533 flags.go:64] FLAG: --max-pods="110"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776966    2533 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776969    2533 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776972    2533 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776977    2533 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776980    2533 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776982    2533 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.776999    2533 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 05 19:01:38.783833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777008    2533 flags.go:64] FLAG: --node-status-max-images="50"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777011    2533 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777014    2533 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777018    2533 flags.go:64] FLAG: --pod-cidr=""
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777021    2533 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777026    2533 flags.go:64] FLAG: --pod-manifest-path=""
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777029    2533 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777032    2533 flags.go:64] FLAG: --pods-per-core="0"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777035    2533 flags.go:64] FLAG: --port="10250"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777038    2533 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777041    2533 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0291c840a8794c889"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777045    2533 flags.go:64] FLAG: --qos-reserved=""
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777048    2533 flags.go:64] FLAG: --read-only-port="10255"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777051    2533 flags.go:64] FLAG: --register-node="true"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777054    2533 flags.go:64] FLAG: --register-with-taints=""
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777058    2533 flags.go:64] FLAG: --registry-burst="10"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777062    2533 flags.go:64] FLAG: --registry-qps="5"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777065    2533 flags.go:64] FLAG: --reserved-cpus=""
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777068    2533 flags.go:64] FLAG: --reserved-memory=""
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777071    2533 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777074    2533 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777079    2533 flags.go:64] FLAG: --rotate-certificates="false"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777082    2533 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777085    2533 flags.go:64] FLAG: --runonce="false"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777089    2533 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 05 19:01:38.784513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777092    2533 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777096    2533 flags.go:64] FLAG: --seccomp-default="false"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777099    2533 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777103    2533 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777106    2533 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777109    2533 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777113    2533 flags.go:64] FLAG: --storage-driver-password="root"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777117    2533 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777120    2533 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777123    2533 flags.go:64] FLAG: --storage-driver-user="root"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777126    2533 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777129    2533 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777132    2533 flags.go:64] FLAG: --system-cgroups=""
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777135    2533 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777140    2533 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777143    2533 flags.go:64] FLAG: --tls-cert-file=""
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777146    2533 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777150    2533 flags.go:64] FLAG: --tls-min-version=""
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777153    2533 flags.go:64] FLAG: --tls-private-key-file=""
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777156    2533 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777159    2533 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777162    2533 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777165    2533 flags.go:64] FLAG: --v="2"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777169    2533 flags.go:64] FLAG: --version="false"
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777174    2533 flags.go:64] FLAG: --vmodule=""
Aug 05 19:01:38.785189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777178    2533 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.777182    2533 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777300    2533 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777307    2533 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777311    2533 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777314    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777317    2533 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777320    2533 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777323    2533 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777326    2533 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777331    2533 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777334    2533 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777336    2533 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777340    2533 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777342    2533 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777345    2533 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777348    2533 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777351    2533 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777354    2533 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777357    2533 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 19:01:38.785799 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777360    2533 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777362    2533 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777365    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777368    2533 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777370    2533 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777373    2533 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777376    2533 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777378    2533 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777381    2533 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777384    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777386    2533 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777389    2533 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777392    2533 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777395    2533 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777397    2533 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777402    2533 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777404    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777407    2533 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777410    2533 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777412    2533 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 19:01:38.786314 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777415    2533 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777418    2533 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777423    2533 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777425    2533 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777428    2533 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777431    2533 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777433    2533 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777436    2533 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777439    2533 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777442    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777444    2533 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777447    2533 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777450    2533 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777453    2533 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777455    2533 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777458    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777460    2533 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777463    2533 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777466    2533 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777468    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 19:01:38.786807 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777471    2533 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777473    2533 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777476    2533 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777479    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777481    2533 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777484    2533 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777487    2533 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777493    2533 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777496    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777500    2533 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777502    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777505    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777508    2533 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777511    2533 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777515    2533 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777518    2533 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777520    2533 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777523    2533 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777526    2533 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 19:01:38.787323 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777530    2533 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777534    2533 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777537    2533 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777539    2533 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777543    2533 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777547    2533 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777550    2533 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777553    2533 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777556    2533 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777559    2533 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777562    2533 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777564    2533 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777568    2533 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777571    2533 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777573    2533 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777576    2533 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777579    2533 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777582    2533 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777585    2533 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 19:01:38.787785 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777588    2533 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777592    2533 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.777595    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.778249    2533 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.785539    2533 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.785558    2533 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.785582    2533 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.785589    2533 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785648    2533 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785654    2533 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785657    2533 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785660    2533 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785663    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785666    2533 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785669    2533 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 19:01:38.788392 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785672    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785675    2533 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785678    2533 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785681    2533 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785684    2533 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785687    2533 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785690    2533 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785694    2533 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785696    2533 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785699    2533 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785702    2533 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785704    2533 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785709    2533 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785714    2533 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785717    2533 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785720    2533 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785723    2533 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785727    2533 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785729    2533 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785732    2533 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 19:01:38.788772 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785735    2533 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785737    2533 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785741    2533 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785744    2533 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785747    2533 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785750    2533 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785752    2533 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785755    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785758    2533 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785761    2533 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785764    2533 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785766    2533 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785769    2533 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785772    2533 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785775    2533 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785777    2533 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785780    2533 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785783    2533 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785786    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785789    2533 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 19:01:38.789270 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785791    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785794    2533 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785797    2533 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785800    2533 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785802    2533 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785805    2533 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785808    2533 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785811    2533 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785814    2533 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785818    2533 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785821    2533 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785823    2533 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785826    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785829    2533 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785832    2533 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785835    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785840    2533 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785844    2533 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785847    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 19:01:38.789758 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785850    2533 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785853    2533 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785855    2533 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785859    2533 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785862    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785865    2533 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785867    2533 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785871    2533 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785873    2533 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785877    2533 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785880    2533 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785884    2533 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785887    2533 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785890    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785893    2533 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785896    2533 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785899    2533 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785902    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785905    2533 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 19:01:38.790298 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785908    2533 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785910    2533 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785913    2533 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785916    2533 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785918    2533 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785921    2533 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785924    2533 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785926    2533 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785930    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785933    2533 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785936    2533 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785939    2533 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785942    2533 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.785945    2533 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.785950    2533 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 19:01:38.790794 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786089    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786095    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786099    2533 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786104    2533 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786108    2533 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786112    2533 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786115    2533 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786119    2533 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786123    2533 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786125    2533 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786128    2533 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786132    2533 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786135    2533 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786138    2533 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786141    2533 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786143    2533 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786146    2533 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786149    2533 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 19:01:38.791239 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786152    2533 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786154    2533 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786157    2533 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786160    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786162    2533 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786166    2533 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786170    2533 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786173    2533 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786177    2533 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786180    2533 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786183    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786186    2533 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786189    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786191    2533 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786194    2533 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786197    2533 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786199    2533 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786202    2533 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786205    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786207    2533 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 19:01:38.791792 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786210    2533 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786213    2533 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786216    2533 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786218    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786221    2533 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786223    2533 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786226    2533 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786229    2533 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786231    2533 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786234    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786237    2533 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786240    2533 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786243    2533 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786245    2533 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786248    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786250    2533 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786253    2533 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786256    2533 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786259    2533 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 19:01:38.792381 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786261    2533 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786264    2533 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786267    2533 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786269    2533 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786272    2533 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786275    2533 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786278    2533 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786280    2533 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786283    2533 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786285    2533 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786288    2533 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786290    2533 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786293    2533 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786295    2533 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786298    2533 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786301    2533 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786304    2533 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786306    2533 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786309    2533 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786312    2533 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 19:01:38.793169 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786314    2533 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786317    2533 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786320    2533 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786323    2533 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786325    2533 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786328    2533 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786331    2533 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786334    2533 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786337    2533 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786340    2533 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786342    2533 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786345    2533 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786347    2533 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786350    2533 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786353    2533 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786355    2533 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786358    2533 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786361    2533 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786364    2533 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786366    2533 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 19:01:38.793886 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786369    2533 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 19:01:38.794394 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:38.786372    2533 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 19:01:38.794394 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.786377    2533 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 19:01:38.794394 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.786512    2533 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 05 19:01:38.794394 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.789901    2533 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 05 19:01:38.794394 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.791280    2533 server.go:1019] "Starting client certificate rotation"
Aug 05 19:01:38.794394 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.791399    2533 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 19:01:38.794394 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.791499    2533 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 19:01:38.794394 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.793916    2533 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 19:01:38.799000 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.798959    2533 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 19:01:38.809237 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.809213    2533 log.go:25] "Validated CRI v1 runtime API"
Aug 05 19:01:38.812239 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.812222    2533 log.go:25] "Validated CRI v1 image API"
Aug 05 19:01:38.813754 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.813739    2533 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 05 19:01:38.816060 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.816036    2533 fs.go:135] Filesystem UUIDs: map[06402de2-7cac-4fef-b846-b7b38532e28f:/dev/nvme0n1p3 1dba4970-bed1-4db4-9b4a-c38c8aabbd10:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Aug 05 19:01:38.816157 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.816057    2533 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 05 19:01:38.818550 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.818527    2533 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 19:01:38.820972 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.820854    2533 manager.go:216] Machine: {Timestamp:2026-08-05 19:01:38.819917826 +0000 UTC m=+0.309852912 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102512 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2947629efadbda67724d39fe1b3d1a SystemUUID:ec294762-9efa-dbda-6772-4d39fe1b3d1a BootID:7ca53c77-1662-4d88-96ad-501a328f3f38 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d4:6b:42:d5:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d4:6b:42:d5:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:32:9f:36:69:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 05 19:01:38.820972 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.820963    2533 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 05 19:01:38.821151 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.821094    2533 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 05 19:01:38.822022 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.821971    2533 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 05 19:01:38.822163 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.822024    2533 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-76.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 05 19:01:38.822734 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.822725    2533 topology_manager.go:138] "Creating topology manager with none policy"
Aug 05 19:01:38.822763 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.822737    2533 container_manager_linux.go:309] "Creating device plugin manager"
Aug 05 19:01:38.822763 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.822745    2533 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 19:01:38.823276 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.823265    2533 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 19:01:38.824344 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.824334    2533 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 05 19:01:38.828271 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.828259    2533 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 19:01:38.828394 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.828386    2533 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 05 19:01:38.828423 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.828419    2533 kubelet.go:486] "Attempting to sync node with API server"
Aug 05 19:01:38.828449 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.828427    2533 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 05 19:01:38.828449 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.828440    2533 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 05 19:01:38.828449 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.828449    2533 kubelet.go:398] "Adding apiserver pod source"
Aug 05 19:01:38.828553 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.828458    2533 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 05 19:01:38.828825 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.828813    2533 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 19:01:38.828865 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.828833    2533 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 19:01:38.831955 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.831935    2533 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 05 19:01:38.833466 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.833453    2533 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 05 19:01:38.833524 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.833481    2533 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 05 19:01:38.834504 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.834490    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 05 19:01:38.834550 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.834508    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 05 19:01:38.834550 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.834514    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 05 19:01:38.834550 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.834520    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 05 19:01:38.834550 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.834528    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 05 19:01:38.834550 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.834533    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 05 19:01:38.834550 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.834541    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 05 19:01:38.834550 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.834548    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 05 19:01:38.834788 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.834558    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 05 19:01:38.834788 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.834563    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 05 19:01:38.834788 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.834572    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 05 19:01:38.834788 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.834577    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 05 19:01:38.835604 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.835592    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 05 19:01:38.835604 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.835601    2533 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 05 19:01:38.838476 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.838463    2533 server.go:1268] "Started kubelet"
Aug 05 19:01:38.838697 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.838534    2533 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 05 19:01:38.838697 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.838577    2533 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 05 19:01:38.838697 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.838647    2533 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 05 19:01:38.841300 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.841277    2533 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 05 19:01:38.841755 ip-10-0-143-76 systemd[1]: Started Kubernetes Kubelet.
Aug 05 19:01:38.843132 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.841803    2533 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-76.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 05 19:01:38.843132 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:38.842497    2533 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 05 19:01:38.843132 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:38.842556    2533 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-76.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 05 19:01:38.843132 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.843101    2533 server.go:310] "Adding debug handlers to kubelet server"
Aug 05 19:01:38.844459 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:38.844437    2533 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 05 19:01:38.846516 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:38.845461    2533 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-76.ec2.internal.18c8fdf92990c065  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-76.ec2.internal,UID:ip-10-0-143-76.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-76.ec2.internal,},FirstTimestamp:2026-08-05 19:01:38.838437989 +0000 UTC m=+0.328373051,LastTimestamp:2026-08-05 19:01:38.838437989 +0000 UTC m=+0.328373051,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-76.ec2.internal,}"
Aug 05 19:01:38.849716 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.849695    2533 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 05 19:01:38.849716 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.849707    2533 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 05 19:01:38.849849 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:38.849760    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:38.850346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.850324    2533 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 05 19:01:38.850346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.850347    2533 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 05 19:01:38.850483 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.850365    2533 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 05 19:01:38.850523 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.850502    2533 reconstruct.go:97] "Volume reconstruction finished"
Aug 05 19:01:38.850523 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.850511    2533 reconciler.go:29] "Reconciler: start to sync state"
Aug 05 19:01:38.850955 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.850942    2533 factory.go:55] Registering systemd factory
Aug 05 19:01:38.850955 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.850957    2533 factory.go:223] Registration of the systemd container factory successfully
Aug 05 19:01:38.851174 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.851153    2533 factory.go:153] Registering CRI-O factory
Aug 05 19:01:38.851219 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.851176    2533 factory.go:223] Registration of the crio container factory successfully
Aug 05 19:01:38.851219 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.851217    2533 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 05 19:01:38.851276 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.851235    2533 factory.go:103] Registering Raw factory
Aug 05 19:01:38.851276 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.851247    2533 manager.go:1196] Started watching for new ooms in manager
Aug 05 19:01:38.851575 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.851564    2533 manager.go:349] Starting recovery of all containers
Aug 05 19:01:38.852651 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.852625    2533 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kz6jv"
Aug 05 19:01:38.858547 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.858518    2533 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kz6jv"
Aug 05 19:01:38.859229 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:38.859209    2533 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-76.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 05 19:01:38.859311 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:38.859296    2533 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 05 19:01:38.860915 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.860893    2533 manager.go:354] Recovery completed
Aug 05 19:01:38.865239 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.865227    2533 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:38.867301 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.867286    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:38.867357 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.867316    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:38.867357 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.867328    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:38.867846 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.867829    2533 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 05 19:01:38.867846 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.867839    2533 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 05 19:01:38.867947 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.867853    2533 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 19:01:38.867947 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.867869    2533 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:38.868498 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.868482    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:38.868545 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.868509    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:38.868545 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.868519    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:38.868851 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.868839    2533 policy_none.go:49] "None policy: Start"
Aug 05 19:01:38.868907 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.868854    2533 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 05 19:01:38.868907 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.868864    2533 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 05 19:01:38.869836 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.869826    2533 policy_none.go:47] "Start"
Aug 05 19:01:38.909681 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.909527    2533 manager.go:337] "Starting Device Plugin manager"
Aug 05 19:01:38.909809 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:38.909702    2533 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 05 19:01:38.909809 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.909716    2533 server.go:87] "Starting device plugin registration server"
Aug 05 19:01:38.909964 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.909953    2533 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 05 19:01:38.910027 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.909965    2533 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 05 19:01:38.910061 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.910050    2533 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 05 19:01:38.910129 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.910119    2533 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 05 19:01:38.910168 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:38.910130    2533 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 05 19:01:38.910620 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:38.910596    2533 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 05 19:01:38.910721 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:38.910652    2533 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:39.005098 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.005060    2533 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 05 19:01:39.006144 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.006127    2533 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 05 19:01:39.006227 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.006165    2533 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 05 19:01:39.006227 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.006188    2533 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 05 19:01:39.006227 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.006223    2533 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 05 19:01:39.008251 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.008228    2533 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 19:01:39.010871 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.010858    2533 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:39.011648 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.011633    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:39.011771 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.011658    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:39.011771 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.011668    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:39.011771 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.011688    2533 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.016964 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.016917    2533 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.016964 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.016939    2533 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-76.ec2.internal\": node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:39.031751 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.031729    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:39.107309 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.107263    2533 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-76.ec2.internal"]
Aug 05 19:01:39.107458 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.107352    2533 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:39.108351 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.108326    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:39.108351 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.108355    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:39.108484 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.108364    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:39.109694 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.109680    2533 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:39.109796 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.109783    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.109843 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.109812    2533 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:39.110437 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.110421    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:39.110533 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.110450    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:39.110533 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.110461    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:39.111533 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.111517    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:39.111610 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.111539    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:39.111610 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.111547    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:39.111610 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.111557    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.111610 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.111586    2533 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 19:01:39.112277 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.112260    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 19:01:39.112373 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.112290    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 19:01:39.112373 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.112303    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeHasSufficientPID"
Aug 05 19:01:39.132195 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.132162    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:39.135803 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.135783    2533 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-76.ec2.internal\" not found" node="ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.140194 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.140175    2533 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-76.ec2.internal\" not found" node="ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.151662 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.151636    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e17d0a2e08bf110a6a814f4cf093cda-config\") pod \"kube-apiserver-proxy-ip-10-0-143-76.ec2.internal\" (UID: \"0e17d0a2e08bf110a6a814f4cf093cda\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.151789 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.151670    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e99f115db4fad37b49c9da7aca3b3a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal\" (UID: \"0e99f115db4fad37b49c9da7aca3b3a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.151789 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.151692    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e99f115db4fad37b49c9da7aca3b3a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal\" (UID: \"0e99f115db4fad37b49c9da7aca3b3a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.233179 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.233150    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:39.252522 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.252497    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e17d0a2e08bf110a6a814f4cf093cda-config\") pod \"kube-apiserver-proxy-ip-10-0-143-76.ec2.internal\" (UID: \"0e17d0a2e08bf110a6a814f4cf093cda\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.252612 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.252528    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e99f115db4fad37b49c9da7aca3b3a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal\" (UID: \"0e99f115db4fad37b49c9da7aca3b3a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.252612 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.252544    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e99f115db4fad37b49c9da7aca3b3a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal\" (UID: \"0e99f115db4fad37b49c9da7aca3b3a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.252612 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.252592    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e99f115db4fad37b49c9da7aca3b3a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal\" (UID: \"0e99f115db4fad37b49c9da7aca3b3a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.252612 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.252592    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e99f115db4fad37b49c9da7aca3b3a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal\" (UID: \"0e99f115db4fad37b49c9da7aca3b3a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.252746 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.252592    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e17d0a2e08bf110a6a814f4cf093cda-config\") pod \"kube-apiserver-proxy-ip-10-0-143-76.ec2.internal\" (UID: \"0e17d0a2e08bf110a6a814f4cf093cda\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.333873 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.333807    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:39.434301 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.434271    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:39.439420 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.439402    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.443368 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.443348    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:39.534771 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.534724    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:39.635208 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.635120    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:39.735615 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.735588    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:39.773242 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.773212    2533 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 19:01:39.791031 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.791002    2533 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 05 19:01:39.791165 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.791145    2533 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 19:01:39.791220 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.791186    2533 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 19:01:39.836346 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.836312    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:39.863203 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.863159    2533 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 18:56:38 +0000 UTC" deadline="2028-04-27 08:20:41.786644544 +0000 UTC"
Aug 05 19:01:39.863203 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:39.863190    2533 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15133h19m1.923457491s"
Aug 05 19:01:39.937489 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:39.937412    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:40.037891 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:40.037862    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:40.134415 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:40.134386    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e17d0a2e08bf110a6a814f4cf093cda.slice/crio-f2d90bf6170de744fc27cdce1325ee2177fc7ca7e5ce0ff225ee68dddbcd8094 WatchSource:0}: Error finding container f2d90bf6170de744fc27cdce1325ee2177fc7ca7e5ce0ff225ee68dddbcd8094: Status 404 returned error can't find the container with id f2d90bf6170de744fc27cdce1325ee2177fc7ca7e5ce0ff225ee68dddbcd8094
Aug 05 19:01:40.138133 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:40.138115    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:40.138214 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.138202    2533 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 19:01:40.239075 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:40.238967    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:40.277525 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.277503    2533 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 19:01:40.339270 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:40.339242    2533 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-76.ec2.internal\" not found"
Aug 05 19:01:40.422536 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.422515    2533 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 19:01:40.450193 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.450161    2533 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:40.459443 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.459418    2533 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 19:01:40.460282 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.460268    2533 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-76.ec2.internal"
Aug 05 19:01:40.465474 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.465456    2533 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 19:01:40.829732 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.829702    2533 apiserver.go:52] "Watching apiserver"
Aug 05 19:01:40.839188 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.838942    2533 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 05 19:01:40.839855 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.839827    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-c4tcz","openshift-image-registry/node-ca-v4hx2","openshift-multus/multus-additional-cni-plugins-lvkrx","openshift-multus/multus-sjmnf","kube-system/konnectivity-agent-sgtkr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp","openshift-cluster-node-tuning-operator/tuned-8mlsb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal","openshift-multus/network-metrics-daemon-8cs9j","openshift-network-diagnostics/network-check-target-xtqbt","openshift-network-operator/iptables-alerter-wb8hb","openshift-ovn-kubernetes/ovnkube-node-9jxwj","kube-system/global-pull-secret-syncer-v8kzz","kube-system/kube-apiserver-proxy-ip-10-0-143-76.ec2.internal"]
Aug 05 19:01:40.842193 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.842171    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.843294 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.843271    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:40.843389 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:40.843368    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:01:40.844879 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.844568    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.845069 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.844923    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sxvw8\""
Aug 05 19:01:40.845667 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.845643    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.846417 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.846400    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 05 19:01:40.846501 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.846461    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 05 19:01:40.847049 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.846688    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sgtkr"
Aug 05 19:01:40.847711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.847165    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2n98z\""
Aug 05 19:01:40.847711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.847200    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 05 19:01:40.847711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.847213    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 05 19:01:40.847711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.847267    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 05 19:01:40.847711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.847358    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 05 19:01:40.847711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.847575    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 05 19:01:40.847711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.847650    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.849027 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.848647    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mnk9t\""
Aug 05 19:01:40.849027 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.848838    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 05 19:01:40.849027 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.849014    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:40.849206 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:40.849097    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:01:40.849734 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.849710    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c4tcz"
Aug 05 19:01:40.850124 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.850023    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 05 19:01:40.850124 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.850065    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 05 19:01:40.850295 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.850232    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 05 19:01:40.850295 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.850238    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m78n9\""
Aug 05 19:01:40.850295 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.850271    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 05 19:01:40.850436 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.850241    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 05 19:01:40.850587 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.850520    2533 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 05 19:01:40.850670 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.850519    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5jlf2\""
Aug 05 19:01:40.851178 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.851161    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v4hx2"
Aug 05 19:01:40.851762 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.851670    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 05 19:01:40.852250 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.852234    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 05 19:01:40.852336 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.852288    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j6ftm\""
Aug 05 19:01:40.852936 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.852881    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 05 19:01:40.853153 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.853137    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 05 19:01:40.853228 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.853189    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 05 19:01:40.853281 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.853259    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:40.853327 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.853277    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2zlrq\""
Aug 05 19:01:40.853327 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:40.853313    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:01:40.855033 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.855015    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wb8hb"
Aug 05 19:01:40.856303 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.856285    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.856785 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.856768    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 05 19:01:40.857267 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.857249    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-72gss\""
Aug 05 19:01:40.857365 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.857350    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 05 19:01:40.857701 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.857602    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 05 19:01:40.858085 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.858061    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 05 19:01:40.858162 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.858120    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 05 19:01:40.858659 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.858635    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 05 19:01:40.858732 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.858697    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 05 19:01:40.859641 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.859151    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tdfrg\""
Aug 05 19:01:40.859641 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.859630    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-sysctl-d\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.860020 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.859975    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 05 19:01:40.860485 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.860466    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-tuned\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.860609 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.860592    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 05 19:01:40.860609 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.860514    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-os-release\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.860709 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.860630    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-multus-conf-dir\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.860709 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.860658    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-etc-kubernetes\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.860709 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.860686    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-sys-fs\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.860826 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.860712    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.860826 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.860740    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2vhz\" (UniqueName: \"kubernetes.io/projected/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-kube-api-access-d2vhz\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.860909 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.860761    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.860909 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.860883    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-multus-socket-dir-parent\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.861011 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.860909    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-run-k8s-cni-cncf-io\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.861011 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.860936    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9ce70d1-ff19-419b-b790-31ac421f34b4-multus-daemon-config\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.861011 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.860972    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcj8s\" (UniqueName: \"kubernetes.io/projected/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-kube-api-access-kcj8s\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.861136 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861012    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:40.861136 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861065    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57786922-3d3a-4eeb-abb5-b881fdfaef95-konnectivity-ca\") pod \"konnectivity-agent-sgtkr\" (UID: \"57786922-3d3a-4eeb-abb5-b881fdfaef95\") " pod="kube-system/konnectivity-agent-sgtkr"
Aug 05 19:01:40.861136 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861102    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-run\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.861252 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861129    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-socket-dir\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.861252 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861176    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-registration-dir\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.861252 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861200    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7937abcf-c98b-4662-9da4-8e84d7dc8b94-serviceca\") pod \"node-ca-v4hx2\" (UID: \"7937abcf-c98b-4662-9da4-8e84d7dc8b94\") " pod="openshift-image-registry/node-ca-v4hx2"
Aug 05 19:01:40.861252 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861228    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-kubernetes\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.861419 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861255    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-system-cni-dir\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.861419 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861284    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-os-release\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.861419 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861312    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-var-lib-cni-multus\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.861419 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861339    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5kl6\" (UniqueName: \"kubernetes.io/projected/60631309-4b82-4c9b-b14f-adba832c976d-kube-api-access-k5kl6\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.861419 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861364    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-sysctl-conf\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.861419 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861390    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-var-lib-kubelet\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.861419 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861414    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-multus-cni-dir\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.862280 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.861779    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-run-multus-certs\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.862359 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862309    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tg28\" (UniqueName: \"kubernetes.io/projected/b9ce70d1-ff19-419b-b790-31ac421f34b4-kube-api-access-8tg28\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.862359 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862352    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-sysconfig\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.862441 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862378    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-systemd\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.862441 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862420    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18fb966a-8487-474e-93c3-9834adaeaf49-tmp-dir\") pod \"node-resolver-c4tcz\" (UID: \"18fb966a-8487-474e-93c3-9834adaeaf49\") " pod="openshift-dns/node-resolver-c4tcz"
Aug 05 19:01:40.862523 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862467    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9nmt\" (UniqueName: \"kubernetes.io/projected/18fb966a-8487-474e-93c3-9834adaeaf49-kube-api-access-k9nmt\") pod \"node-resolver-c4tcz\" (UID: \"18fb966a-8487-474e-93c3-9834adaeaf49\") " pod="openshift-dns/node-resolver-c4tcz"
Aug 05 19:01:40.862523 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862498    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-sys\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.862600 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862544    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.862600 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862574    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08234163-7160-44d4-a86f-6af179f3a5bc-kubelet-config\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:40.862600 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862595    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.862766 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862619    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08234163-7160-44d4-a86f-6af179f3a5bc-dbus\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:40.862766 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862668    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh9hh\" (UniqueName: \"kubernetes.io/projected/10538719-040a-4cf2-b3df-26bf6b4c077e-kube-api-access-zh9hh\") pod \"network-metrics-daemon-8cs9j\" (UID: \"10538719-040a-4cf2-b3df-26bf6b4c077e\") " pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:40.862766 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862695    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-cnibin\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.862766 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862722    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-lib-modules\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.862766 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862749    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-tmp\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.862996 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862774    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7937abcf-c98b-4662-9da4-8e84d7dc8b94-host\") pod \"node-ca-v4hx2\" (UID: \"7937abcf-c98b-4662-9da4-8e84d7dc8b94\") " pod="openshift-image-registry/node-ca-v4hx2"
Aug 05 19:01:40.863431 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.862799    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-run-netns\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.863513 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863448    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs\") pod \"network-metrics-daemon-8cs9j\" (UID: \"10538719-040a-4cf2-b3df-26bf6b4c077e\") " pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:40.863564 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863516    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96bv8\" (UniqueName: \"kubernetes.io/projected/7937abcf-c98b-4662-9da4-8e84d7dc8b94-kube-api-access-96bv8\") pod \"node-ca-v4hx2\" (UID: \"7937abcf-c98b-4662-9da4-8e84d7dc8b94\") " pod="openshift-image-registry/node-ca-v4hx2"
Aug 05 19:01:40.863564 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863541    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-cnibin\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.863654 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863565    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.863654 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863583    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9ce70d1-ff19-419b-b790-31ac421f34b4-cni-binary-copy\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.863854 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863759    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-var-lib-kubelet\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.863854 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863802    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-hostroot\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.863854 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863825    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57786922-3d3a-4eeb-abb5-b881fdfaef95-agent-certs\") pod \"konnectivity-agent-sgtkr\" (UID: \"57786922-3d3a-4eeb-abb5-b881fdfaef95\") " pod="kube-system/konnectivity-agent-sgtkr"
Aug 05 19:01:40.863854 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863846    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-device-dir\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.864061 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863866    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-host\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.864061 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863893    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-var-lib-cni-bin\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.864061 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863913    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/18fb966a-8487-474e-93c3-9834adaeaf49-hosts-file\") pod \"node-resolver-c4tcz\" (UID: \"18fb966a-8487-474e-93c3-9834adaeaf49\") " pod="openshift-dns/node-resolver-c4tcz"
Aug 05 19:01:40.864061 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863933    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-modprobe-d\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.864061 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.863968    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-etc-selinux\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.864061 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.864048    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-system-cni-dir\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.864383 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.864359    2533 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 19:01:40.883242 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.883217    2533 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zmxpr"
Aug 05 19:01:40.890152 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.890125    2533 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zmxpr"
Aug 05 19:01:40.951747 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.951719    2533 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 05 19:01:40.964389 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964363    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47a1830f-7219-4a86-8878-fef94ec412e9-ovn-node-metrics-cert\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.964545 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964400    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcj8s\" (UniqueName: \"kubernetes.io/projected/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-kube-api-access-kcj8s\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.964545 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964427    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:40.964545 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964512    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-slash\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.964545 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:40.964529    2533 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:40.964740 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964555    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-cni-bin\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.964740 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:40.964604    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret podName:08234163-7160-44d4-a86f-6af179f3a5bc nodeName:}" failed. No retries permitted until 2026-08-05 19:01:41.464562217 +0000 UTC m=+2.954497267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret") pod "global-pull-secret-syncer-v8kzz" (UID: "08234163-7160-44d4-a86f-6af179f3a5bc") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:40.964740 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964638    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47a1830f-7219-4a86-8878-fef94ec412e9-env-overrides\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.964740 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964665    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57786922-3d3a-4eeb-abb5-b881fdfaef95-konnectivity-ca\") pod \"konnectivity-agent-sgtkr\" (UID: \"57786922-3d3a-4eeb-abb5-b881fdfaef95\") " pod="kube-system/konnectivity-agent-sgtkr"
Aug 05 19:01:40.964740 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964730    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-run\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.964966 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964800    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-socket-dir\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.964966 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964827    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-registration-dir\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.964966 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964852    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7937abcf-c98b-4662-9da4-8e84d7dc8b94-serviceca\") pod \"node-ca-v4hx2\" (UID: \"7937abcf-c98b-4662-9da4-8e84d7dc8b94\") " pod="openshift-image-registry/node-ca-v4hx2"
Aug 05 19:01:40.964966 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964870    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-run\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.964966 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964892    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47a1830f-7219-4a86-8878-fef94ec412e9-ovnkube-script-lib\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.964966 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964919    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-socket-dir\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.964966 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964933    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qf7w\" (UniqueName: \"kubernetes.io/projected/47a1830f-7219-4a86-8878-fef94ec412e9-kube-api-access-5qf7w\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.964966 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.964928    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-registration-dir\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965046    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-kubernetes\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965070    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-system-cni-dir\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965097    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-os-release\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965121    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-var-lib-cni-multus\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965125    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-kubernetes\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965146    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5kl6\" (UniqueName: \"kubernetes.io/projected/60631309-4b82-4c9b-b14f-adba832c976d-kube-api-access-k5kl6\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965170    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47a1830f-7219-4a86-8878-fef94ec412e9-ovnkube-config\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965191    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-os-release\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965198    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a-iptables-alerter-script\") pod \"iptables-alerter-wb8hb\" (UID: \"0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a\") " pod="openshift-network-operator/iptables-alerter-wb8hb"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965222    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgzhf\" (UniqueName: \"kubernetes.io/projected/0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a-kube-api-access-zgzhf\") pod \"iptables-alerter-wb8hb\" (UID: \"0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a\") " pod="openshift-network-operator/iptables-alerter-wb8hb"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965227    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-system-cni-dir\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965250    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57786922-3d3a-4eeb-abb5-b881fdfaef95-konnectivity-ca\") pod \"konnectivity-agent-sgtkr\" (UID: \"57786922-3d3a-4eeb-abb5-b881fdfaef95\") " pod="kube-system/konnectivity-agent-sgtkr"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965250    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-sysctl-conf\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965286    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-var-lib-kubelet\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965310    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-multus-cni-dir\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965320    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-var-lib-cni-multus\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.965346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965333    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-run-multus-certs\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965354    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7937abcf-c98b-4662-9da4-8e84d7dc8b94-serviceca\") pod \"node-ca-v4hx2\" (UID: \"7937abcf-c98b-4662-9da4-8e84d7dc8b94\") " pod="openshift-image-registry/node-ca-v4hx2"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965356    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tg28\" (UniqueName: \"kubernetes.io/projected/b9ce70d1-ff19-419b-b790-31ac421f34b4-kube-api-access-8tg28\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965397    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-run-multus-certs\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965423    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-kubelet\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965450    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-run-openvswitch\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965456    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-var-lib-kubelet\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965469    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-sysconfig\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965481    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-multus-cni-dir\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965493    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-systemd\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965505    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-sysconfig\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965516    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18fb966a-8487-474e-93c3-9834adaeaf49-tmp-dir\") pod \"node-resolver-c4tcz\" (UID: \"18fb966a-8487-474e-93c3-9834adaeaf49\") " pod="openshift-dns/node-resolver-c4tcz"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965483    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-sysctl-conf\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965547    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-systemd\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965539    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9nmt\" (UniqueName: \"kubernetes.io/projected/18fb966a-8487-474e-93c3-9834adaeaf49-kube-api-access-k9nmt\") pod \"node-resolver-c4tcz\" (UID: \"18fb966a-8487-474e-93c3-9834adaeaf49\") " pod="openshift-dns/node-resolver-c4tcz"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965620    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-sys\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965647    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965674    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08234163-7160-44d4-a86f-6af179f3a5bc-kubelet-config\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:40.966072 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965717    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-sys\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965728    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08234163-7160-44d4-a86f-6af179f3a5bc-kubelet-config\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965777    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965807    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18fb966a-8487-474e-93c3-9834adaeaf49-tmp-dir\") pod \"node-resolver-c4tcz\" (UID: \"18fb966a-8487-474e-93c3-9834adaeaf49\") " pod="openshift-dns/node-resolver-c4tcz"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965814    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-systemd-units\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965838    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08234163-7160-44d4-a86f-6af179f3a5bc-dbus\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965865    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh9hh\" (UniqueName: \"kubernetes.io/projected/10538719-040a-4cf2-b3df-26bf6b4c077e-kube-api-access-zh9hh\") pod \"network-metrics-daemon-8cs9j\" (UID: \"10538719-040a-4cf2-b3df-26bf6b4c077e\") " pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965868    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965908    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-cnibin\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965920    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08234163-7160-44d4-a86f-6af179f3a5bc-dbus\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965932    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-lib-modules\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.965961    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-tmp\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966004    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7937abcf-c98b-4662-9da4-8e84d7dc8b94-host\") pod \"node-ca-v4hx2\" (UID: \"7937abcf-c98b-4662-9da4-8e84d7dc8b94\") " pod="openshift-image-registry/node-ca-v4hx2"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966024    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-cnibin\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966055    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-node-log\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966056    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-lib-modules\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966082    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-run-netns\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966122    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs\") pod \"network-metrics-daemon-8cs9j\" (UID: \"10538719-040a-4cf2-b3df-26bf6b4c077e\") " pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:40.966861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966128    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-run-netns\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966153    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96bv8\" (UniqueName: \"kubernetes.io/projected/7937abcf-c98b-4662-9da4-8e84d7dc8b94-kube-api-access-96bv8\") pod \"node-ca-v4hx2\" (UID: \"7937abcf-c98b-4662-9da4-8e84d7dc8b94\") " pod="openshift-image-registry/node-ca-v4hx2"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966178    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:40.966207    2533 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966210    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966225    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtm5z\" (UniqueName: \"kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z\") pod \"network-check-target-xtqbt\" (UID: \"cb1815f8-79fb-4205-baf6-fdbe79cdcddf\") " pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966257    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-cnibin\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:40.966305    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs podName:10538719-040a-4cf2-b3df-26bf6b4c077e nodeName:}" failed. No retries permitted until 2026-08-05 19:01:41.466265197 +0000 UTC m=+2.956200251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs") pod "network-metrics-daemon-8cs9j" (UID: "10538719-040a-4cf2-b3df-26bf6b4c077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966304    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-cnibin\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966316    2533 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966341    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966350    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7937abcf-c98b-4662-9da4-8e84d7dc8b94-host\") pod \"node-ca-v4hx2\" (UID: \"7937abcf-c98b-4662-9da4-8e84d7dc8b94\") " pod="openshift-image-registry/node-ca-v4hx2"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966366    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9ce70d1-ff19-419b-b790-31ac421f34b4-cni-binary-copy\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966391    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-var-lib-kubelet\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966413    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-hostroot\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966443    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57786922-3d3a-4eeb-abb5-b881fdfaef95-agent-certs\") pod \"konnectivity-agent-sgtkr\" (UID: \"57786922-3d3a-4eeb-abb5-b881fdfaef95\") " pod="kube-system/konnectivity-agent-sgtkr"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966462    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-hostroot\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.967655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966465    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-device-dir\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966506    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-device-dir\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966518    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-run-netns\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966542    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-var-lib-kubelet\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966544    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-host\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966574    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-var-lib-cni-bin\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966580    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-host\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966597    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/18fb966a-8487-474e-93c3-9834adaeaf49-hosts-file\") pod \"node-resolver-c4tcz\" (UID: \"18fb966a-8487-474e-93c3-9834adaeaf49\") " pod="openshift-dns/node-resolver-c4tcz"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966616    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-var-lib-cni-bin\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966622    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-etc-openvswitch\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966655    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-run-ovn\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966677    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-cni-netd\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966698    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a-host-slash\") pod \"iptables-alerter-wb8hb\" (UID: \"0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a\") " pod="openshift-network-operator/iptables-alerter-wb8hb"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966725    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-modprobe-d\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966746    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-etc-selinux\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966769    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-var-lib-openvswitch\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966780    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.968275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966806    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-log-socket\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966870    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/18fb966a-8487-474e-93c3-9834adaeaf49-hosts-file\") pod \"node-resolver-c4tcz\" (UID: \"18fb966a-8487-474e-93c3-9834adaeaf49\") " pod="openshift-dns/node-resolver-c4tcz"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966938    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-modprobe-d\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966926    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9ce70d1-ff19-419b-b790-31ac421f34b4-cni-binary-copy\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.966964    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-etc-selinux\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967011    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-system-cni-dir\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967059    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-run-systemd\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967107    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-system-cni-dir\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967096    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967143    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-sysctl-d\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967185    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-tuned\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967207    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-os-release\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967227    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-multus-conf-dir\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967251    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-etc-kubernetes\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967279    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-sysctl-d\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967271    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-sys-fs\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967322    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967346    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2vhz\" (UniqueName: \"kubernetes.io/projected/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-kube-api-access-d2vhz\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.968963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967363    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-os-release\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967369    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967400    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-multus-socket-dir-parent\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967421    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-run-k8s-cni-cncf-io\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967458    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9ce70d1-ff19-419b-b790-31ac421f34b4-multus-daemon-config\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967323    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-multus-conf-dir\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967674    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-multus-socket-dir-parent\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967766    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-host-run-k8s-cni-cncf-io\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967771    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967795    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967822    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60631309-4b82-4c9b-b14f-adba832c976d-sys-fs\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.967897    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9ce70d1-ff19-419b-b790-31ac421f34b4-etc-kubernetes\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.968038    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9ce70d1-ff19-419b-b790-31ac421f34b4-multus-daemon-config\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.969707    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-tmp\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.969739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.969735    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-etc-tuned\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.970326 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.969898    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57786922-3d3a-4eeb-abb5-b881fdfaef95-agent-certs\") pod \"konnectivity-agent-sgtkr\" (UID: \"57786922-3d3a-4eeb-abb5-b881fdfaef95\") " pod="kube-system/konnectivity-agent-sgtkr"
Aug 05 19:01:40.973461 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.973431    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcj8s\" (UniqueName: \"kubernetes.io/projected/fa9c3e9b-a23e-4e44-b821-be5a1c36fda5-kube-api-access-kcj8s\") pod \"multus-additional-cni-plugins-lvkrx\" (UID: \"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5\") " pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:40.974514 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.974481    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh9hh\" (UniqueName: \"kubernetes.io/projected/10538719-040a-4cf2-b3df-26bf6b4c077e-kube-api-access-zh9hh\") pod \"network-metrics-daemon-8cs9j\" (UID: \"10538719-040a-4cf2-b3df-26bf6b4c077e\") " pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:40.974830 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.974807    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9nmt\" (UniqueName: \"kubernetes.io/projected/18fb966a-8487-474e-93c3-9834adaeaf49-kube-api-access-k9nmt\") pod \"node-resolver-c4tcz\" (UID: \"18fb966a-8487-474e-93c3-9834adaeaf49\") " pod="openshift-dns/node-resolver-c4tcz"
Aug 05 19:01:40.975205 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.975183    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2vhz\" (UniqueName: \"kubernetes.io/projected/60082a82-cd9c-4c41-9008-7e0b5a8d35e7-kube-api-access-d2vhz\") pod \"tuned-8mlsb\" (UID: \"60082a82-cd9c-4c41-9008-7e0b5a8d35e7\") " pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:40.975299 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.975247    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96bv8\" (UniqueName: \"kubernetes.io/projected/7937abcf-c98b-4662-9da4-8e84d7dc8b94-kube-api-access-96bv8\") pod \"node-ca-v4hx2\" (UID: \"7937abcf-c98b-4662-9da4-8e84d7dc8b94\") " pod="openshift-image-registry/node-ca-v4hx2"
Aug 05 19:01:40.975353 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.975295    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tg28\" (UniqueName: \"kubernetes.io/projected/b9ce70d1-ff19-419b-b790-31ac421f34b4-kube-api-access-8tg28\") pod \"multus-sjmnf\" (UID: \"b9ce70d1-ff19-419b-b790-31ac421f34b4\") " pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:40.975878 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:40.975863    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5kl6\" (UniqueName: \"kubernetes.io/projected/60631309-4b82-4c9b-b14f-adba832c976d-kube-api-access-k5kl6\") pod \"aws-ebs-csi-driver-node-q4rmp\" (UID: \"60631309-4b82-4c9b-b14f-adba832c976d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:41.011093 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.011048    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-76.ec2.internal" event={"ID":"0e17d0a2e08bf110a6a814f4cf093cda","Type":"ContainerStarted","Data":"f2d90bf6170de744fc27cdce1325ee2177fc7ca7e5ce0ff225ee68dddbcd8094"}
Aug 05 19:01:41.068406 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068372    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068406 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068408    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtm5z\" (UniqueName: \"kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z\") pod \"network-check-target-xtqbt\" (UID: \"cb1815f8-79fb-4205-baf6-fdbe79cdcddf\") " pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:41.068619 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068471    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068619 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068521    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-run-netns\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068619 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068555    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-etc-openvswitch\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068619 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068576    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-run-ovn\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068619 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068596    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-etc-openvswitch\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068619 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068598    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-cni-netd\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068615    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-run-netns\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068632    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-cni-netd\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068623    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a-host-slash\") pod \"iptables-alerter-wb8hb\" (UID: \"0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a\") " pod="openshift-network-operator/iptables-alerter-wb8hb"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068671    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-var-lib-openvswitch\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068675    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-run-ovn\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068641    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a-host-slash\") pod \"iptables-alerter-wb8hb\" (UID: \"0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a\") " pod="openshift-network-operator/iptables-alerter-wb8hb"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068710    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-var-lib-openvswitch\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068732    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-log-socket\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068748    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-log-socket\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068758    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-run-systemd\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068780    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068797    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-run-systemd\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068820    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47a1830f-7219-4a86-8878-fef94ec412e9-ovn-node-metrics-cert\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068833    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068853    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-slash\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068874    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-cni-bin\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.068887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068894    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47a1830f-7219-4a86-8878-fef94ec412e9-env-overrides\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068932    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-slash\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068921    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47a1830f-7219-4a86-8878-fef94ec412e9-ovnkube-script-lib\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068962    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-cni-bin\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.068969    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qf7w\" (UniqueName: \"kubernetes.io/projected/47a1830f-7219-4a86-8878-fef94ec412e9-kube-api-access-5qf7w\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.069023    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47a1830f-7219-4a86-8878-fef94ec412e9-ovnkube-config\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.069045    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a-iptables-alerter-script\") pod \"iptables-alerter-wb8hb\" (UID: \"0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a\") " pod="openshift-network-operator/iptables-alerter-wb8hb"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.069069    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgzhf\" (UniqueName: \"kubernetes.io/projected/0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a-kube-api-access-zgzhf\") pod \"iptables-alerter-wb8hb\" (UID: \"0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a\") " pod="openshift-network-operator/iptables-alerter-wb8hb"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.069098    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-kubelet\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.069120    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-run-openvswitch\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.069160    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-systemd-units\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.069195    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-node-log\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.069266    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-node-log\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.069312    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-systemd-units\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.069324    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-host-kubelet\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.069689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.069345    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47a1830f-7219-4a86-8878-fef94ec412e9-run-openvswitch\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.070239 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.069793    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47a1830f-7219-4a86-8878-fef94ec412e9-env-overrides\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.070239 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.069868    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a-iptables-alerter-script\") pod \"iptables-alerter-wb8hb\" (UID: \"0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a\") " pod="openshift-network-operator/iptables-alerter-wb8hb"
Aug 05 19:01:41.070328 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.070273    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47a1830f-7219-4a86-8878-fef94ec412e9-ovnkube-config\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.070551 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.070529    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47a1830f-7219-4a86-8878-fef94ec412e9-ovnkube-script-lib\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.071244 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.071224    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47a1830f-7219-4a86-8878-fef94ec412e9-ovn-node-metrics-cert\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.077573 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:41.077547    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:01:41.077573 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:41.077570    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:01:41.077573 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:41.077581    2533 projected.go:196] Error preparing data for projected volume kube-api-access-xtm5z for pod openshift-network-diagnostics/network-check-target-xtqbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:41.077773 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:41.077633    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z podName:cb1815f8-79fb-4205-baf6-fdbe79cdcddf nodeName:}" failed. No retries permitted until 2026-08-05 19:01:41.577619838 +0000 UTC m=+3.067554888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xtm5z" (UniqueName: "kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z") pod "network-check-target-xtqbt" (UID: "cb1815f8-79fb-4205-baf6-fdbe79cdcddf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:41.080023 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.079946    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qf7w\" (UniqueName: \"kubernetes.io/projected/47a1830f-7219-4a86-8878-fef94ec412e9-kube-api-access-5qf7w\") pod \"ovnkube-node-9jxwj\" (UID: \"47a1830f-7219-4a86-8878-fef94ec412e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.080023 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.079953    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgzhf\" (UniqueName: \"kubernetes.io/projected/0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a-kube-api-access-zgzhf\") pod \"iptables-alerter-wb8hb\" (UID: \"0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a\") " pod="openshift-network-operator/iptables-alerter-wb8hb"
Aug 05 19:01:41.155049 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.155023    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8mlsb"
Aug 05 19:01:41.163934 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.163900    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lvkrx"
Aug 05 19:01:41.173103 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.173080    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sjmnf"
Aug 05 19:01:41.179111 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.179087    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sgtkr"
Aug 05 19:01:41.185967 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.185939    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp"
Aug 05 19:01:41.193785 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.193762    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c4tcz"
Aug 05 19:01:41.200273 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.200254    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v4hx2"
Aug 05 19:01:41.209242 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.209214    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wb8hb"
Aug 05 19:01:41.215457 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.215436    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:01:41.260386 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.260352    2533 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 19:01:41.472898 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.472815    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs\") pod \"network-metrics-daemon-8cs9j\" (UID: \"10538719-040a-4cf2-b3df-26bf6b4c077e\") " pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:41.472898 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.472889    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:41.473118 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:41.473006    2533 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:41.473118 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:41.473070    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret podName:08234163-7160-44d4-a86f-6af179f3a5bc nodeName:}" failed. No retries permitted until 2026-08-05 19:01:42.473053379 +0000 UTC m=+3.962988447 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret") pod "global-pull-secret-syncer-v8kzz" (UID: "08234163-7160-44d4-a86f-6af179f3a5bc") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:41.473247 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:41.473006    2533 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:41.473294 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:41.473287    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs podName:10538719-040a-4cf2-b3df-26bf6b4c077e nodeName:}" failed. No retries permitted until 2026-08-05 19:01:42.473273402 +0000 UTC m=+3.963208463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs") pod "network-metrics-daemon-8cs9j" (UID: "10538719-040a-4cf2-b3df-26bf6b4c077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:41.668515 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:41.668481    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60631309_4b82_4c9b_b14f_adba832c976d.slice/crio-f9b415d137547a77b0bc2ddbce78a9696e36349076275b78d552f9a422b1ea29 WatchSource:0}: Error finding container f9b415d137547a77b0bc2ddbce78a9696e36349076275b78d552f9a422b1ea29: Status 404 returned error can't find the container with id f9b415d137547a77b0bc2ddbce78a9696e36349076275b78d552f9a422b1ea29
Aug 05 19:01:41.669767 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:41.669734    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57786922_3d3a_4eeb_abb5_b881fdfaef95.slice/crio-5426c75ca5a8a674f692e09ca4294826d98a372251c6741ae4bfb9f65bf1eb22 WatchSource:0}: Error finding container 5426c75ca5a8a674f692e09ca4294826d98a372251c6741ae4bfb9f65bf1eb22: Status 404 returned error can't find the container with id 5426c75ca5a8a674f692e09ca4294826d98a372251c6741ae4bfb9f65bf1eb22
Aug 05 19:01:41.674119 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.674066    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtm5z\" (UniqueName: \"kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z\") pod \"network-check-target-xtqbt\" (UID: \"cb1815f8-79fb-4205-baf6-fdbe79cdcddf\") " pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:41.674224 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:41.674205    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:01:41.674279 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:41.674226    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:01:41.674279 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:41.674237    2533 projected.go:196] Error preparing data for projected volume kube-api-access-xtm5z for pod openshift-network-diagnostics/network-check-target-xtqbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:41.674399 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:41.674286    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z podName:cb1815f8-79fb-4205-baf6-fdbe79cdcddf nodeName:}" failed. No retries permitted until 2026-08-05 19:01:42.674270393 +0000 UTC m=+4.164205457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtm5z" (UniqueName: "kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z") pod "network-check-target-xtqbt" (UID: "cb1815f8-79fb-4205-baf6-fdbe79cdcddf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:41.679145 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:41.679123    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18fb966a_8487_474e_93c3_9834adaeaf49.slice/crio-af3a505f5d0dfdd71a1a712efb48e7b25b57d01eff8ad5b955903c5814890141 WatchSource:0}: Error finding container af3a505f5d0dfdd71a1a712efb48e7b25b57d01eff8ad5b955903c5814890141: Status 404 returned error can't find the container with id af3a505f5d0dfdd71a1a712efb48e7b25b57d01eff8ad5b955903c5814890141
Aug 05 19:01:41.680788 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:41.680765    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9c3e9b_a23e_4e44_b821_be5a1c36fda5.slice/crio-286fb0d97656e72bf9fd52ade5d548d449e3aaa2182f6a33e73d4f19e452db31 WatchSource:0}: Error finding container 286fb0d97656e72bf9fd52ade5d548d449e3aaa2182f6a33e73d4f19e452db31: Status 404 returned error can't find the container with id 286fb0d97656e72bf9fd52ade5d548d449e3aaa2182f6a33e73d4f19e452db31
Aug 05 19:01:41.682600 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:41.682581    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8d974f_80d2_4fdb_ae73_e14bc5d0e95a.slice/crio-c39b399ad96efc7cdbc357014206d9fcf4a04b586c9b59ac46976a7f53adf03a WatchSource:0}: Error finding container c39b399ad96efc7cdbc357014206d9fcf4a04b586c9b59ac46976a7f53adf03a: Status 404 returned error can't find the container with id c39b399ad96efc7cdbc357014206d9fcf4a04b586c9b59ac46976a7f53adf03a
Aug 05 19:01:41.683329 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:41.683297    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7937abcf_c98b_4662_9da4_8e84d7dc8b94.slice/crio-aeb4cd85d0bb5cccb23af0534fcdd1e45ec5fbb6591b0cec2b62b3d873640ec4 WatchSource:0}: Error finding container aeb4cd85d0bb5cccb23af0534fcdd1e45ec5fbb6591b0cec2b62b3d873640ec4: Status 404 returned error can't find the container with id aeb4cd85d0bb5cccb23af0534fcdd1e45ec5fbb6591b0cec2b62b3d873640ec4
Aug 05 19:01:41.684385 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:41.684359    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a1830f_7219_4a86_8878_fef94ec412e9.slice/crio-d956605ff84b483811d1f3e1a14734c3150c219ab2fe6ecec7b1a16adf84c9b7 WatchSource:0}: Error finding container d956605ff84b483811d1f3e1a14734c3150c219ab2fe6ecec7b1a16adf84c9b7: Status 404 returned error can't find the container with id d956605ff84b483811d1f3e1a14734c3150c219ab2fe6ecec7b1a16adf84c9b7
Aug 05 19:01:41.685860 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:41.685841    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ce70d1_ff19_419b_b790_31ac421f34b4.slice/crio-4bf7fc830a103b46cbd79000df177f599d2ad9b880a057211583923705751b6e WatchSource:0}: Error finding container 4bf7fc830a103b46cbd79000df177f599d2ad9b880a057211583923705751b6e: Status 404 returned error can't find the container with id 4bf7fc830a103b46cbd79000df177f599d2ad9b880a057211583923705751b6e
Aug 05 19:01:41.687689 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:41.687667    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60082a82_cd9c_4c41_9008_7e0b5a8d35e7.slice/crio-7fa8956e44225223b82f8c280ab5509358c68299069395c81a77f710f10f8e27 WatchSource:0}: Error finding container 7fa8956e44225223b82f8c280ab5509358c68299069395c81a77f710f10f8e27: Status 404 returned error can't find the container with id 7fa8956e44225223b82f8c280ab5509358c68299069395c81a77f710f10f8e27
Aug 05 19:01:41.693969 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:01:41.693945    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e99f115db4fad37b49c9da7aca3b3a6.slice/crio-b30e454c35df4eb3a207a04a5df04074ccea56bf1959e26c36b0bcbc4c508922 WatchSource:0}: Error finding container b30e454c35df4eb3a207a04a5df04074ccea56bf1959e26c36b0bcbc4c508922: Status 404 returned error can't find the container with id b30e454c35df4eb3a207a04a5df04074ccea56bf1959e26c36b0bcbc4c508922
Aug 05 19:01:41.891822 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.891781    2533 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 18:56:40 +0000 UTC" deadline="2028-03-23 00:17:25.839921208 +0000 UTC"
Aug 05 19:01:41.891822 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:41.891813    2533 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14285h15m43.948110864s"
Aug 05 19:01:42.007221 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.007139    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:42.007349 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:42.007250    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:01:42.013404 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.013374    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal" event={"ID":"0e99f115db4fad37b49c9da7aca3b3a6","Type":"ContainerStarted","Data":"b30e454c35df4eb3a207a04a5df04074ccea56bf1959e26c36b0bcbc4c508922"}
Aug 05 19:01:42.016802 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.016762    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sjmnf" event={"ID":"b9ce70d1-ff19-419b-b790-31ac421f34b4","Type":"ContainerStarted","Data":"4bf7fc830a103b46cbd79000df177f599d2ad9b880a057211583923705751b6e"}
Aug 05 19:01:42.017795 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.017769    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvkrx" event={"ID":"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5","Type":"ContainerStarted","Data":"286fb0d97656e72bf9fd52ade5d548d449e3aaa2182f6a33e73d4f19e452db31"}
Aug 05 19:01:42.018887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.018868    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wb8hb" event={"ID":"0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a","Type":"ContainerStarted","Data":"c39b399ad96efc7cdbc357014206d9fcf4a04b586c9b59ac46976a7f53adf03a"}
Aug 05 19:01:42.019795 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.019778    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp" event={"ID":"60631309-4b82-4c9b-b14f-adba832c976d","Type":"ContainerStarted","Data":"f9b415d137547a77b0bc2ddbce78a9696e36349076275b78d552f9a422b1ea29"}
Aug 05 19:01:42.021405 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.021389    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-76.ec2.internal" event={"ID":"0e17d0a2e08bf110a6a814f4cf093cda","Type":"ContainerStarted","Data":"399096ef9c2f10bdebd1dd0c68fdc59d2edb4c585feb3235f11bf09cdf8b6522"}
Aug 05 19:01:42.022270 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.022249    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8mlsb" event={"ID":"60082a82-cd9c-4c41-9008-7e0b5a8d35e7","Type":"ContainerStarted","Data":"7fa8956e44225223b82f8c280ab5509358c68299069395c81a77f710f10f8e27"}
Aug 05 19:01:42.023153 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.023136    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj" event={"ID":"47a1830f-7219-4a86-8878-fef94ec412e9","Type":"ContainerStarted","Data":"d956605ff84b483811d1f3e1a14734c3150c219ab2fe6ecec7b1a16adf84c9b7"}
Aug 05 19:01:42.024024 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.024004    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v4hx2" event={"ID":"7937abcf-c98b-4662-9da4-8e84d7dc8b94","Type":"ContainerStarted","Data":"aeb4cd85d0bb5cccb23af0534fcdd1e45ec5fbb6591b0cec2b62b3d873640ec4"}
Aug 05 19:01:42.024869 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.024848    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c4tcz" event={"ID":"18fb966a-8487-474e-93c3-9834adaeaf49","Type":"ContainerStarted","Data":"af3a505f5d0dfdd71a1a712efb48e7b25b57d01eff8ad5b955903c5814890141"}
Aug 05 19:01:42.025655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.025640    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sgtkr" event={"ID":"57786922-3d3a-4eeb-abb5-b881fdfaef95","Type":"ContainerStarted","Data":"5426c75ca5a8a674f692e09ca4294826d98a372251c6741ae4bfb9f65bf1eb22"}
Aug 05 19:01:42.032847 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.032811    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-76.ec2.internal" podStartSLOduration=2.032799929 podStartE2EDuration="2.032799929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:42.032518044 +0000 UTC m=+3.522453127" watchObservedRunningTime="2026-08-05 19:01:42.032799929 +0000 UTC m=+3.522734999"
Aug 05 19:01:42.325463 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.325378    2533 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 19:01:42.479895 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.479403    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs\") pod \"network-metrics-daemon-8cs9j\" (UID: \"10538719-040a-4cf2-b3df-26bf6b4c077e\") " pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:42.479895 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:42.479625    2533 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:42.479895 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:42.479693    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs podName:10538719-040a-4cf2-b3df-26bf6b4c077e nodeName:}" failed. No retries permitted until 2026-08-05 19:01:44.479674608 +0000 UTC m=+5.969609671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs") pod "network-metrics-daemon-8cs9j" (UID: "10538719-040a-4cf2-b3df-26bf6b4c077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:42.479895 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.479718    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:42.479895 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:42.479834    2533 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:42.479895 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:42.479868    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret podName:08234163-7160-44d4-a86f-6af179f3a5bc nodeName:}" failed. No retries permitted until 2026-08-05 19:01:44.479857149 +0000 UTC m=+5.969792213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret") pod "global-pull-secret-syncer-v8kzz" (UID: "08234163-7160-44d4-a86f-6af179f3a5bc") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:42.681952 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.681368    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtm5z\" (UniqueName: \"kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z\") pod \"network-check-target-xtqbt\" (UID: \"cb1815f8-79fb-4205-baf6-fdbe79cdcddf\") " pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:42.681952 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:42.681517    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:01:42.681952 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:42.681534    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:01:42.681952 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:42.681548    2533 projected.go:196] Error preparing data for projected volume kube-api-access-xtm5z for pod openshift-network-diagnostics/network-check-target-xtqbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:42.681952 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:42.681600    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z podName:cb1815f8-79fb-4205-baf6-fdbe79cdcddf nodeName:}" failed. No retries permitted until 2026-08-05 19:01:44.681583794 +0000 UTC m=+6.171518854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtm5z" (UniqueName: "kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z") pod "network-check-target-xtqbt" (UID: "cb1815f8-79fb-4205-baf6-fdbe79cdcddf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:42.892635 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.892487    2533 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 18:56:40 +0000 UTC" deadline="2028-05-08 00:18:44.974898192 +0000 UTC"
Aug 05 19:01:42.892635 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:42.892543    2533 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15389h17m2.082359728s"
Aug 05 19:01:43.010036 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:43.009927    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:43.010205 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:43.010071    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:01:43.010205 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:43.010138    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:43.010324 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:43.010237    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:01:44.006549 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:44.006513    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:44.007072 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:44.006655    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:01:44.497907 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:44.497779    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs\") pod \"network-metrics-daemon-8cs9j\" (UID: \"10538719-040a-4cf2-b3df-26bf6b4c077e\") " pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:44.497907 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:44.497865    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:44.498129 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:44.498023    2533 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:44.498129 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:44.498084    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret podName:08234163-7160-44d4-a86f-6af179f3a5bc nodeName:}" failed. No retries permitted until 2026-08-05 19:01:48.498067009 +0000 UTC m=+9.988002074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret") pod "global-pull-secret-syncer-v8kzz" (UID: "08234163-7160-44d4-a86f-6af179f3a5bc") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:44.498470 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:44.498349    2533 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:44.498470 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:44.498422    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs podName:10538719-040a-4cf2-b3df-26bf6b4c077e nodeName:}" failed. No retries permitted until 2026-08-05 19:01:48.498405344 +0000 UTC m=+9.988340419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs") pod "network-metrics-daemon-8cs9j" (UID: "10538719-040a-4cf2-b3df-26bf6b4c077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:44.699693 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:44.699657    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtm5z\" (UniqueName: \"kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z\") pod \"network-check-target-xtqbt\" (UID: \"cb1815f8-79fb-4205-baf6-fdbe79cdcddf\") " pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:44.699880 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:44.699837    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:01:44.699880 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:44.699857    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:01:44.699880 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:44.699872    2533 projected.go:196] Error preparing data for projected volume kube-api-access-xtm5z for pod openshift-network-diagnostics/network-check-target-xtqbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:44.700075 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:44.699934    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z podName:cb1815f8-79fb-4205-baf6-fdbe79cdcddf nodeName:}" failed. No retries permitted until 2026-08-05 19:01:48.699916231 +0000 UTC m=+10.189851308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtm5z" (UniqueName: "kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z") pod "network-check-target-xtqbt" (UID: "cb1815f8-79fb-4205-baf6-fdbe79cdcddf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:45.007163 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:45.007097    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:45.007710 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:45.007101    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:45.007710 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:45.007247    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:01:45.007710 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:45.007311    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:01:46.006799 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:46.006703    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:46.006969 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:46.006923    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:01:47.007369 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:47.007332    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:47.007842 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:47.007468    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:01:47.007976 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:47.007957    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:47.008114 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:47.008091    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:01:48.006766 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:48.006734    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:48.006962 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:48.006868    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:01:48.531467 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:48.531209    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:48.531467 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:48.531286    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs\") pod \"network-metrics-daemon-8cs9j\" (UID: \"10538719-040a-4cf2-b3df-26bf6b4c077e\") " pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:48.531467 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:48.531385    2533 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:48.531467 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:48.531411    2533 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:48.531467 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:48.531457    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret podName:08234163-7160-44d4-a86f-6af179f3a5bc nodeName:}" failed. No retries permitted until 2026-08-05 19:01:56.531439541 +0000 UTC m=+18.021374606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret") pod "global-pull-secret-syncer-v8kzz" (UID: "08234163-7160-44d4-a86f-6af179f3a5bc") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:48.531467 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:48.531474    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs podName:10538719-040a-4cf2-b3df-26bf6b4c077e nodeName:}" failed. No retries permitted until 2026-08-05 19:01:56.531466924 +0000 UTC m=+18.021401978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs") pod "network-metrics-daemon-8cs9j" (UID: "10538719-040a-4cf2-b3df-26bf6b4c077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:48.733619 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:48.733575    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtm5z\" (UniqueName: \"kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z\") pod \"network-check-target-xtqbt\" (UID: \"cb1815f8-79fb-4205-baf6-fdbe79cdcddf\") " pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:48.733849 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:48.733829    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:01:48.733930 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:48.733858    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:01:48.733930 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:48.733871    2533 projected.go:196] Error preparing data for projected volume kube-api-access-xtm5z for pod openshift-network-diagnostics/network-check-target-xtqbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:48.734053 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:48.733931    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z podName:cb1815f8-79fb-4205-baf6-fdbe79cdcddf nodeName:}" failed. No retries permitted until 2026-08-05 19:01:56.733911988 +0000 UTC m=+18.223847056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtm5z" (UniqueName: "kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z") pod "network-check-target-xtqbt" (UID: "cb1815f8-79fb-4205-baf6-fdbe79cdcddf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:49.007398 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:49.007314    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:49.007553 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:49.007432    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:01:49.007553 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:49.007484    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:49.007669 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:49.007610    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:01:50.007389 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:50.007355    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:50.007890 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:50.007511    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:01:51.006963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:51.006888    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:51.006963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:51.006915    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:51.007218 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:51.007077    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:01:51.007218 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:51.007168    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:01:52.006731 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:52.006699    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:52.007189 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:52.006817    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:01:53.007056 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:53.007013    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:53.007499 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:53.007024    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:53.007499 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:53.007164    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:01:53.007499 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:53.007220    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:01:54.007279 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:54.007240    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:54.007662 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:54.007382    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:01:55.007204 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:55.007164    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:55.007389 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:55.007300    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:01:55.007389 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:55.007361    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:55.007762 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:55.007462    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:01:56.006825 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:56.006790    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:56.007004 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:56.006900    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:01:56.591899 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:56.591852    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs\") pod \"network-metrics-daemon-8cs9j\" (UID: \"10538719-040a-4cf2-b3df-26bf6b4c077e\") " pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:56.592313 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:56.591912    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:56.592313 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:56.592014    2533 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:56.592313 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:56.592015    2533 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:56.592313 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:56.592066    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret podName:08234163-7160-44d4-a86f-6af179f3a5bc nodeName:}" failed. No retries permitted until 2026-08-05 19:02:12.592052601 +0000 UTC m=+34.081987653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret") pod "global-pull-secret-syncer-v8kzz" (UID: "08234163-7160-44d4-a86f-6af179f3a5bc") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:01:56.592313 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:56.592080    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs podName:10538719-040a-4cf2-b3df-26bf6b4c077e nodeName:}" failed. No retries permitted until 2026-08-05 19:02:12.592073738 +0000 UTC m=+34.082008790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs") pod "network-metrics-daemon-8cs9j" (UID: "10538719-040a-4cf2-b3df-26bf6b4c077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:01:56.792770 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:56.792684    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtm5z\" (UniqueName: \"kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z\") pod \"network-check-target-xtqbt\" (UID: \"cb1815f8-79fb-4205-baf6-fdbe79cdcddf\") " pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:56.792908 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:56.792870    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:01:56.792908 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:56.792900    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:01:56.793020 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:56.792915    2533 projected.go:196] Error preparing data for projected volume kube-api-access-xtm5z for pod openshift-network-diagnostics/network-check-target-xtqbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:56.793067 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:56.793019    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z podName:cb1815f8-79fb-4205-baf6-fdbe79cdcddf nodeName:}" failed. No retries permitted until 2026-08-05 19:02:12.793003519 +0000 UTC m=+34.282938591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtm5z" (UniqueName: "kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z") pod "network-check-target-xtqbt" (UID: "cb1815f8-79fb-4205-baf6-fdbe79cdcddf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:01:57.006735 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:57.006705    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:57.006919 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:57.006830    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:01:57.006919 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:57.006904    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:57.007064 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:57.007032    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:01:58.007330 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:58.007292    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:01:58.007756 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:58.007434    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:01:59.008273 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:59.008232    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:01:59.008742 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:59.008349    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:01:59.008742 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:01:59.008414    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:01:59.008742 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:01:59.008546    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:00.007064 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:00.007020    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:00.007272 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:00.007162    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:01.006537 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:01.006512    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:01.006837 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:01.006644    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:01.006837 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:01.006788    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:01.006919 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:01.006890    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:01.071845 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:01.071803    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8mlsb" event={"ID":"60082a82-cd9c-4c41-9008-7e0b5a8d35e7","Type":"ContainerStarted","Data":"2a6b53f0ca77c59b75354b72e5f394ab870b5eb8000d82afb86d2b414f5af14c"}
Aug 05 19:02:01.075095 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:01.074646    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj" event={"ID":"47a1830f-7219-4a86-8878-fef94ec412e9","Type":"ContainerStarted","Data":"132fd97780dc1bd9c26e7cec0fb064522f227ef0725b184691da400f51963aa4"}
Aug 05 19:02:02.007270 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.006871    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:02.008093 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:02.007395    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:02.078102 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.078067    2533 generic.go:356] "Generic (PLEG): container finished" podID="0e99f115db4fad37b49c9da7aca3b3a6" containerID="0bfc3d432f01b1ac16cac3582eafecba4e238f75b35752689031bbba20cba582" exitCode=0
Aug 05 19:02:02.078275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.078148    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal" event={"ID":"0e99f115db4fad37b49c9da7aca3b3a6","Type":"ContainerDied","Data":"0bfc3d432f01b1ac16cac3582eafecba4e238f75b35752689031bbba20cba582"}
Aug 05 19:02:02.079747 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.079715    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sjmnf" event={"ID":"b9ce70d1-ff19-419b-b790-31ac421f34b4","Type":"ContainerStarted","Data":"3b4ef30e1868a372ff52fbd0e057e9811024c90413ce47d28c23cb06fab56a85"}
Aug 05 19:02:02.081215 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.081185    2533 generic.go:356] "Generic (PLEG): container finished" podID="fa9c3e9b-a23e-4e44-b821-be5a1c36fda5" containerID="e89c696e0bf858ea8f94a331f9df73b664323fb41c9e8e7aa982245e1ef665d8" exitCode=0
Aug 05 19:02:02.081326 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.081273    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvkrx" event={"ID":"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5","Type":"ContainerDied","Data":"e89c696e0bf858ea8f94a331f9df73b664323fb41c9e8e7aa982245e1ef665d8"}
Aug 05 19:02:02.083034 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.082972    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wb8hb" event={"ID":"0e8d974f-80d2-4fdb-ae73-e14bc5d0e95a","Type":"ContainerStarted","Data":"6465f544252ad34ba02271576e5d12b969f97b3c4839daf6c93dc8363a7484a4"}
Aug 05 19:02:02.084576 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.084553    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp" event={"ID":"60631309-4b82-4c9b-b14f-adba832c976d","Type":"ContainerStarted","Data":"10e395d86b9b776576e43718d01e534e00ec33c70d5829d71b9d12f0e6147d4f"}
Aug 05 19:02:02.087509 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.087487    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj" event={"ID":"47a1830f-7219-4a86-8878-fef94ec412e9","Type":"ContainerStarted","Data":"c2b1e219a6e0a9ac850cf9ca9b6efbfffc90b51768d067ed23bb5be3c7d0d2f2"}
Aug 05 19:02:02.087592 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.087544    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj" event={"ID":"47a1830f-7219-4a86-8878-fef94ec412e9","Type":"ContainerStarted","Data":"ce8882a30be4c4a41125cd40a08fb4b924e00867dd4e0ef5c885653ed327030c"}
Aug 05 19:02:02.087592 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.087586    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj" event={"ID":"47a1830f-7219-4a86-8878-fef94ec412e9","Type":"ContainerStarted","Data":"0489843e4995de96ee0a91c5416a1d28eabcf042ab1f432deb1908399155c506"}
Aug 05 19:02:02.087680 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.087630    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj" event={"ID":"47a1830f-7219-4a86-8878-fef94ec412e9","Type":"ContainerStarted","Data":"377924b6a2b49cc3505b4daee6b00065b48b927ff1c95de9339d616ddf201c27"}
Aug 05 19:02:02.087680 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.087658    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj" event={"ID":"47a1830f-7219-4a86-8878-fef94ec412e9","Type":"ContainerStarted","Data":"7610def8a6b65372308ea008c67fc6f21a1520f684e201d22584303d7e092f01"}
Aug 05 19:02:02.088767 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.088746    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v4hx2" event={"ID":"7937abcf-c98b-4662-9da4-8e84d7dc8b94","Type":"ContainerStarted","Data":"f7ca7efa696464db79654d486f0663bc37282d3a963c205a8a997d00e3cf6aac"}
Aug 05 19:02:02.090003 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.089963    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c4tcz" event={"ID":"18fb966a-8487-474e-93c3-9834adaeaf49","Type":"ContainerStarted","Data":"107b21af22b8030adebf9194b1e535ef4f06890b280c4d3c68240e75d558aee9"}
Aug 05 19:02:02.091202 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.091182    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sgtkr" event={"ID":"57786922-3d3a-4eeb-abb5-b881fdfaef95","Type":"ContainerStarted","Data":"43bdc8a772b2260f1410ce2408fb2d4d028ebef22c921ca2a1b66966357eedfa"}
Aug 05 19:02:02.094619 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.094580    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8mlsb" podStartSLOduration=5.075423441 podStartE2EDuration="24.094567399s" totalImagesPullingTime="19.019143958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:01.091184022 +0000 UTC m=+22.581119097" watchObservedRunningTime="2026-08-05 19:02:02.094567399 +0000 UTC m=+23.584502472"
Aug 05 19:02:02.128135 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.128086    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sgtkr" podStartSLOduration=9.334081476 podStartE2EDuration="24.128065639s" totalImagesPullingTime="14.793984163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:02.127681997 +0000 UTC m=+23.617617073" watchObservedRunningTime="2026-08-05 19:02:02.128065639 +0000 UTC m=+23.618000714"
Aug 05 19:02:02.147297 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.147252    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c4tcz" podStartSLOduration=5.119313856 podStartE2EDuration="24.147233832s" totalImagesPullingTime="19.027919976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:02.146772483 +0000 UTC m=+23.636707557" watchObservedRunningTime="2026-08-05 19:02:02.147233832 +0000 UTC m=+23.637168906"
Aug 05 19:02:02.160802 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.160745    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wb8hb" podStartSLOduration=5.13811638 podStartE2EDuration="24.160724198s" totalImagesPullingTime="19.022607818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:02.160318668 +0000 UTC m=+23.650253742" watchObservedRunningTime="2026-08-05 19:02:02.160724198 +0000 UTC m=+23.650659273"
Aug 05 19:02:02.176473 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.176431    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sjmnf" podStartSLOduration=4.821805698 podStartE2EDuration="24.176415765s" totalImagesPullingTime="19.354610067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:02.176076183 +0000 UTC m=+23.666011258" watchObservedRunningTime="2026-08-05 19:02:02.176415765 +0000 UTC m=+23.666350839"
Aug 05 19:02:02.189174 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.189135    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v4hx2" podStartSLOduration=5.167866492 podStartE2EDuration="24.189117699s" totalImagesPullingTime="19.021251207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:02.188892443 +0000 UTC m=+23.678827529" watchObservedRunningTime="2026-08-05 19:02:02.189117699 +0000 UTC m=+23.679052773"
Aug 05 19:02:02.409136 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.409108    2533 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 05 19:02:02.919711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.919563    2533 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T19:02:02.409127439Z","UUID":"bedb7f4c-e713-4a9f-be55-37fa53712632","Handler":null,"Name":"","Endpoint":""}
Aug 05 19:02:02.921330 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.921301    2533 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 05 19:02:02.921475 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:02.921340    2533 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 05 19:02:03.007033 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:03.007000    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:03.007331 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:03.007006    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:03.007331 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:03.007153    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:03.007331 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:03.007265    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:03.096522 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:03.096485    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal" event={"ID":"0e99f115db4fad37b49c9da7aca3b3a6","Type":"ContainerStarted","Data":"97b2a0f783d552be10d1fedf0435f4343d40db287563eae775228374550d610f"}
Aug 05 19:02:03.099380 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:03.099343    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp" event={"ID":"60631309-4b82-4c9b-b14f-adba832c976d","Type":"ContainerStarted","Data":"52dc8df7a3295019a579aff30d39dd7af9fc017e6bb0fef2d42a6032aef9e48f"}
Aug 05 19:02:03.112069 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:03.112011    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-76.ec2.internal" podStartSLOduration=23.111972949 podStartE2EDuration="23.111972949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:03.11116221 +0000 UTC m=+24.601097282" watchObservedRunningTime="2026-08-05 19:02:03.111972949 +0000 UTC m=+24.601908023"
Aug 05 19:02:03.988497 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:03.988462    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sgtkr"
Aug 05 19:02:03.989157 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:03.989136    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sgtkr"
Aug 05 19:02:04.006479 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:04.006445    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:04.006668 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:04.006614    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:04.103465 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:04.103431    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp" event={"ID":"60631309-4b82-4c9b-b14f-adba832c976d","Type":"ContainerStarted","Data":"bf8b3fbbbe0b672bde6e7e250ff8524407ba46f4fbe9f0d9828409a67abcd414"}
Aug 05 19:02:04.106595 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:04.106562    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj" event={"ID":"47a1830f-7219-4a86-8878-fef94ec412e9","Type":"ContainerStarted","Data":"d35b88ae0698098a5259300c8ce3a336cf5d12f14ad7a16199fe57640b4a0ab3"}
Aug 05 19:02:04.106945 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:04.106927    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sgtkr"
Aug 05 19:02:04.107440 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:04.107424    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sgtkr"
Aug 05 19:02:04.120113 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:04.120071    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q4rmp" podStartSLOduration=4.656669723 podStartE2EDuration="26.120055805s" totalImagesPullingTime="21.463386082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:04.119877762 +0000 UTC m=+25.609812856" watchObservedRunningTime="2026-08-05 19:02:04.120055805 +0000 UTC m=+25.609990879"
Aug 05 19:02:05.006715 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:05.006679    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:05.006888 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:05.006830    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:05.006973 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:05.006907    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:05.007093 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:05.007053    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:06.006675 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:06.006641    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:06.007183 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:06.006770    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:06.650500 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:06.650464    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c4tcz_18fb966a-8487-474e-93c3-9834adaeaf49/dns-node-resolver/0.log"
Aug 05 19:02:07.006881 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:07.006653    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:07.007383 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:07.006683    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:07.007383 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:07.007025    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:07.007383 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:07.007074    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:08.006783 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:08.006749    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:08.006955 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:08.006854    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:08.030132 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:08.030110    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v4hx2_7937abcf-c98b-4662-9da4-8e84d7dc8b94/node-ca/0.log"
Aug 05 19:02:08.119403 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:08.119361    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj" event={"ID":"47a1830f-7219-4a86-8878-fef94ec412e9","Type":"ContainerStarted","Data":"f32ece1f5149306c5b1972af739990924d187f3b44d0f25f98aa9546bf16fecc"}
Aug 05 19:02:08.119627 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:08.119611    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:02:08.121206 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:08.121179    2533 generic.go:356] "Generic (PLEG): container finished" podID="fa9c3e9b-a23e-4e44-b821-be5a1c36fda5" containerID="6218ddfb3072560518c67dc4eed6baec326d0bcfc49220f917206be53aed2665" exitCode=0
Aug 05 19:02:08.121363 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:08.121217    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvkrx" event={"ID":"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5","Type":"ContainerDied","Data":"6218ddfb3072560518c67dc4eed6baec326d0bcfc49220f917206be53aed2665"}
Aug 05 19:02:08.136191 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:08.136164    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:02:08.152264 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:08.152210    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj" podStartSLOduration=11.109371077 podStartE2EDuration="30.152194685s" totalImagesPullingTime="19.042823608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:08.152062085 +0000 UTC m=+29.641997181" watchObservedRunningTime="2026-08-05 19:02:08.152194685 +0000 UTC m=+29.642129758"
Aug 05 19:02:09.008007 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:09.007806    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:09.008488 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:09.007856    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:09.008488 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:09.008096    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:09.008488 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:09.008168    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:09.123864 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:09.123838    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:02:09.123999 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:09.123929    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:02:09.139876 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:09.139848    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:02:09.221155 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:09.221122    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v8kzz"]
Aug 05 19:02:09.221362 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:09.221257    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:09.221462 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:09.221436    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:09.221850 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:09.221816    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xtqbt"]
Aug 05 19:02:09.221951 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:09.221904    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:09.222039 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:09.222017    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:09.222436 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:09.222411    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8cs9j"]
Aug 05 19:02:09.222516 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:09.222485    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:09.222568 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:09.222552    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:10.128058 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:10.128008    2533 generic.go:356] "Generic (PLEG): container finished" podID="fa9c3e9b-a23e-4e44-b821-be5a1c36fda5" containerID="c56acaae29e57bacd7bba124d4babbff25cfb654fd801320113f6e71d1dd3e80" exitCode=0
Aug 05 19:02:10.128625 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:10.128094    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvkrx" event={"ID":"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5","Type":"ContainerDied","Data":"c56acaae29e57bacd7bba124d4babbff25cfb654fd801320113f6e71d1dd3e80"}
Aug 05 19:02:11.006580 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:11.006541    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:11.006580 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:11.006571    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:11.006834 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:11.006541    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:11.006834 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:11.006676    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:11.006834 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:11.006746    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:11.006972 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:11.006827    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:12.134722 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:12.134684    2533 generic.go:356] "Generic (PLEG): container finished" podID="fa9c3e9b-a23e-4e44-b821-be5a1c36fda5" containerID="6a0176346132f865c09822043418f9ac8fa74add9182cc5a954f10fc1a94fb5d" exitCode=0
Aug 05 19:02:12.134722 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:12.134713    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvkrx" event={"ID":"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5","Type":"ContainerDied","Data":"6a0176346132f865c09822043418f9ac8fa74add9182cc5a954f10fc1a94fb5d"}
Aug 05 19:02:12.612044 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:12.612007    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:12.612218 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:12.612058    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs\") pod \"network-metrics-daemon-8cs9j\" (UID: \"10538719-040a-4cf2-b3df-26bf6b4c077e\") " pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:12.612218 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:12.612155    2533 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 19:02:12.612218 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:12.612212    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret podName:08234163-7160-44d4-a86f-6af179f3a5bc nodeName:}" failed. No retries permitted until 2026-08-05 19:02:44.612197252 +0000 UTC m=+66.102132304 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret") pod "global-pull-secret-syncer-v8kzz" (UID: "08234163-7160-44d4-a86f-6af179f3a5bc") : object "kube-system"/"original-pull-secret" not registered
Aug 05 19:02:12.612218 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:12.612212    2533 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:02:12.612423 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:12.612236    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs podName:10538719-040a-4cf2-b3df-26bf6b4c077e nodeName:}" failed. No retries permitted until 2026-08-05 19:02:44.612230707 +0000 UTC m=+66.102165758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs") pod "network-metrics-daemon-8cs9j" (UID: "10538719-040a-4cf2-b3df-26bf6b4c077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 19:02:12.813809 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:12.813759    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtm5z\" (UniqueName: \"kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z\") pod \"network-check-target-xtqbt\" (UID: \"cb1815f8-79fb-4205-baf6-fdbe79cdcddf\") " pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:12.814009 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:12.813928    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 19:02:12.814009 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:12.813948    2533 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 19:02:12.814009 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:12.813959    2533 projected.go:196] Error preparing data for projected volume kube-api-access-xtm5z for pod openshift-network-diagnostics/network-check-target-xtqbt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:02:12.814129 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:12.814030    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z podName:cb1815f8-79fb-4205-baf6-fdbe79cdcddf nodeName:}" failed. No retries permitted until 2026-08-05 19:02:44.814012886 +0000 UTC m=+66.303947956 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtm5z" (UniqueName: "kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z") pod "network-check-target-xtqbt" (UID: "cb1815f8-79fb-4205-baf6-fdbe79cdcddf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 19:02:13.007244 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:13.007211    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:13.007455 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:13.007214    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:13.007455 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:13.007339    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:13.007455 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:13.007214    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:13.007455 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:13.007408    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:13.007620 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:13.007472    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:15.007276 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:15.007052    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:15.007276 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:15.007104    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:15.007276 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:15.007052    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:15.007276 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:15.007210    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:15.007276 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:15.007278    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:15.007909 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:15.007403    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:17.006621 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:17.006582    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:17.006621 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:17.006619    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:17.007198 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:17.006582    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:17.007198 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:17.006715    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:17.007198 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:17.006762    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:17.007198 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:17.006867    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:18.152899 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:18.152807    2533 generic.go:356] "Generic (PLEG): container finished" podID="fa9c3e9b-a23e-4e44-b821-be5a1c36fda5" containerID="9f687f58528fabf915dc0daa7150c0a51986abd29bb948c8302f515711f74e80" exitCode=0
Aug 05 19:02:18.152899 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:18.152858    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvkrx" event={"ID":"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5","Type":"ContainerDied","Data":"9f687f58528fabf915dc0daa7150c0a51986abd29bb948c8302f515711f74e80"}
Aug 05 19:02:19.007762 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:19.007725    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:19.007949 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:19.007821    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:19.007949 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:19.007856    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:19.007949 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:19.007856    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:19.008073 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:19.007961    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:19.008073 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:19.008024    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:19.158343 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:19.158249    2533 generic.go:356] "Generic (PLEG): container finished" podID="fa9c3e9b-a23e-4e44-b821-be5a1c36fda5" containerID="007ccbbff27eb7f3cfad21e49cefb355b17bc73d6d9a9e7097d314f79b96ad26" exitCode=0
Aug 05 19:02:19.158343 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:19.158316    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvkrx" event={"ID":"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5","Type":"ContainerDied","Data":"007ccbbff27eb7f3cfad21e49cefb355b17bc73d6d9a9e7097d314f79b96ad26"}
Aug 05 19:02:20.163802 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:20.163766    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvkrx" event={"ID":"fa9c3e9b-a23e-4e44-b821-be5a1c36fda5","Type":"ContainerStarted","Data":"560972deb4c2575554b880295b6b9535ad55181705156b4ed0ebc370c12d2dc6"}
Aug 05 19:02:20.184920 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:20.184863    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lvkrx" podStartSLOduration=9.60151054 podStartE2EDuration="42.184848746s" totalImagesPullingTime="32.583338206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:20.184332922 +0000 UTC m=+41.674268004" watchObservedRunningTime="2026-08-05 19:02:20.184848746 +0000 UTC m=+41.674783820"
Aug 05 19:02:21.006648 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:21.006612    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:21.006820 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:21.006612    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:21.006820 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:21.006718    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:21.006888 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:21.006830    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:21.006888 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:21.006629    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:21.006953 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:21.006941    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:23.007067 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:23.007027    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:23.007486 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:23.007042    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:23.007486 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:23.007142    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:23.007486 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:23.007215    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:23.007486 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:23.007042    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:23.007486 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:23.007284    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:25.007020 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:25.006965    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:25.007504 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:25.006965    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:25.007504 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:25.007123    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:25.007504 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:25.006984    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:25.007504 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:25.007192    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:25.007504 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:25.007242    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:27.006769 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:27.006735    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:27.007324 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:27.006734    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:27.007324 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:27.006843    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:27.007324 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:27.006742    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:27.007324 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:27.006908    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:27.007324 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:27.007041    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:29.007450 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:29.007416    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:29.007859 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:29.007502    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtqbt" podUID="cb1815f8-79fb-4205-baf6-fdbe79cdcddf"
Aug 05 19:02:29.007859 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:29.007537    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:29.007859 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:29.007547    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:29.007859 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:29.007638    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8cs9j" podUID="10538719-040a-4cf2-b3df-26bf6b4c077e"
Aug 05 19:02:29.007859 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:29.007675    2533 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v8kzz" podUID="08234163-7160-44d4-a86f-6af179f3a5bc"
Aug 05 19:02:30.830685 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.830611    2533 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-76.ec2.internal" event="NodeReady"
Aug 05 19:02:30.831050 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.830736    2533 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 05 19:02:30.864252 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.864155    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7558ddcfb6-v5r4d"]
Aug 05 19:02:30.876899 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.876871    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:30.879300 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.879276    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 05 19:02:30.879427 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.879365    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 05 19:02:30.879427 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.879378    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 05 19:02:30.879427 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.879395    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zb2vm\""
Aug 05 19:02:30.880948 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.880924    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7558ddcfb6-v5r4d"]
Aug 05 19:02:30.884418 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.884390    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-njvk4"]
Aug 05 19:02:30.885777 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.885755    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 05 19:02:30.906926 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.906899    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5vj47"]
Aug 05 19:02:30.907087 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.907042    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:30.909351 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.909323    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z6qmv\""
Aug 05 19:02:30.909545 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.909531    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 05 19:02:30.909801 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.909778    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 05 19:02:30.930907 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.930877    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-njvk4"]
Aug 05 19:02:30.931074 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.930921    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5vj47"]
Aug 05 19:02:30.931074 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.931022    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:30.933285 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.933265    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 05 19:02:30.933483 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.933467    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 05 19:02:30.933557 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.933484    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 05 19:02:30.933557 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.933514    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 05 19:02:30.933750 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.933735    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gsd7c\""
Aug 05 19:02:30.984243 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:30.984210    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l8x57"]
Aug 05 19:02:31.004950 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.004906    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l8x57"]
Aug 05 19:02:31.005142 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.005057    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l8x57"
Aug 05 19:02:31.006403 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.006378    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:31.006403 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.006402    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:31.006602 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.006589    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:31.007480 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.007457    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s6kl2\""
Aug 05 19:02:31.007598 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.007498    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 05 19:02:31.007598 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.007511    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 05 19:02:31.007598 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.007515    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 05 19:02:31.008447 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.008405    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 19:02:31.009004 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.008963    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 19:02:31.009221 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.009201    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7thz\""
Aug 05 19:02:31.009321 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.009206    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wk5vf\""
Aug 05 19:02:31.009379 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.009329    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 19:02:31.009735 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.009620    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 19:02:31.040702 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.040674    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-registry-certificates\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.040824 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.040705    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dwzl\" (UniqueName: \"kubernetes.io/projected/aee2bbb0-35b0-42e9-9848-e04c19ca2529-kube-api-access-4dwzl\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.040824 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.040747    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-image-registry-private-configuration\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.040824 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.040765    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-registry-tls\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.040824 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.040780    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-ca-trust-extracted\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.040824 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.040797    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-installation-pull-secrets\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.040979 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.040829    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aee2bbb0-35b0-42e9-9848-e04c19ca2529-data-volume\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.040979 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.040851    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz2p5\" (UniqueName: \"kubernetes.io/projected/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-kube-api-access-vz2p5\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.040979 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.040869    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-trusted-ca\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.040979 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.040909    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f21c40a0-143e-40b7-b52d-e9ddbc050f7b-metrics-tls\") pod \"dns-default-njvk4\" (UID: \"f21c40a0-143e-40b7-b52d-e9ddbc050f7b\") " pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:31.040979 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.040931    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aee2bbb0-35b0-42e9-9848-e04c19ca2529-crio-socket\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.040979 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.040952    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f21c40a0-143e-40b7-b52d-e9ddbc050f7b-config-volume\") pod \"dns-default-njvk4\" (UID: \"f21c40a0-143e-40b7-b52d-e9ddbc050f7b\") " pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:31.041167 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.040983    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-bound-sa-token\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.041167 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.041032    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aee2bbb0-35b0-42e9-9848-e04c19ca2529-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.041167 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.041059    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6blsl\" (UniqueName: \"kubernetes.io/projected/f21c40a0-143e-40b7-b52d-e9ddbc050f7b-kube-api-access-6blsl\") pod \"dns-default-njvk4\" (UID: \"f21c40a0-143e-40b7-b52d-e9ddbc050f7b\") " pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:31.041167 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.041088    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f21c40a0-143e-40b7-b52d-e9ddbc050f7b-tmp-dir\") pod \"dns-default-njvk4\" (UID: \"f21c40a0-143e-40b7-b52d-e9ddbc050f7b\") " pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:31.041167 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.041105    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aee2bbb0-35b0-42e9-9848-e04c19ca2529-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.141798 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.141711    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-registry-certificates\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.141798 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.141750    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dwzl\" (UniqueName: \"kubernetes.io/projected/aee2bbb0-35b0-42e9-9848-e04c19ca2529-kube-api-access-4dwzl\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.141798 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.141770    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-image-registry-private-configuration\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.141798 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.141788    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-registry-tls\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.142146 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.141808    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-ca-trust-extracted\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.142146 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.141851    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-installation-pull-secrets\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.142146 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142044    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aee2bbb0-35b0-42e9-9848-e04c19ca2529-data-volume\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.142146 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142099    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz2p5\" (UniqueName: \"kubernetes.io/projected/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-kube-api-access-vz2p5\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.142344 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142146    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-trusted-ca\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.142344 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142189    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f21c40a0-143e-40b7-b52d-e9ddbc050f7b-metrics-tls\") pod \"dns-default-njvk4\" (UID: \"f21c40a0-143e-40b7-b52d-e9ddbc050f7b\") " pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:31.142344 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142217    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aee2bbb0-35b0-42e9-9848-e04c19ca2529-crio-socket\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.142344 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142245    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f35de057-ffe9-4ebc-a73a-a31142eb1084-cert\") pod \"ingress-canary-l8x57\" (UID: \"f35de057-ffe9-4ebc-a73a-a31142eb1084\") " pod="openshift-ingress-canary/ingress-canary-l8x57"
Aug 05 19:02:31.142344 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142275    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f21c40a0-143e-40b7-b52d-e9ddbc050f7b-config-volume\") pod \"dns-default-njvk4\" (UID: \"f21c40a0-143e-40b7-b52d-e9ddbc050f7b\") " pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:31.142344 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142303    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-bound-sa-token\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.142617 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142426    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aee2bbb0-35b0-42e9-9848-e04c19ca2529-data-volume\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.142617 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142483    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aee2bbb0-35b0-42e9-9848-e04c19ca2529-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.142617 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142515    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r74sm\" (UniqueName: \"kubernetes.io/projected/f35de057-ffe9-4ebc-a73a-a31142eb1084-kube-api-access-r74sm\") pod \"ingress-canary-l8x57\" (UID: \"f35de057-ffe9-4ebc-a73a-a31142eb1084\") " pod="openshift-ingress-canary/ingress-canary-l8x57"
Aug 05 19:02:31.142617 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142552    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6blsl\" (UniqueName: \"kubernetes.io/projected/f21c40a0-143e-40b7-b52d-e9ddbc050f7b-kube-api-access-6blsl\") pod \"dns-default-njvk4\" (UID: \"f21c40a0-143e-40b7-b52d-e9ddbc050f7b\") " pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:31.142617 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142595    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f21c40a0-143e-40b7-b52d-e9ddbc050f7b-tmp-dir\") pod \"dns-default-njvk4\" (UID: \"f21c40a0-143e-40b7-b52d-e9ddbc050f7b\") " pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:31.142842 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142622    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aee2bbb0-35b0-42e9-9848-e04c19ca2529-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.142842 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142632    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aee2bbb0-35b0-42e9-9848-e04c19ca2529-crio-socket\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.142842 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142645    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-registry-certificates\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.142842 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.142652    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-ca-trust-extracted\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.143048 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.143018    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f21c40a0-143e-40b7-b52d-e9ddbc050f7b-tmp-dir\") pod \"dns-default-njvk4\" (UID: \"f21c40a0-143e-40b7-b52d-e9ddbc050f7b\") " pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:31.143195 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.143172    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aee2bbb0-35b0-42e9-9848-e04c19ca2529-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.143547 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.143524    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f21c40a0-143e-40b7-b52d-e9ddbc050f7b-config-volume\") pod \"dns-default-njvk4\" (UID: \"f21c40a0-143e-40b7-b52d-e9ddbc050f7b\") " pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:31.143633 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.143545    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-trusted-ca\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.146400 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.146370    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f21c40a0-143e-40b7-b52d-e9ddbc050f7b-metrics-tls\") pod \"dns-default-njvk4\" (UID: \"f21c40a0-143e-40b7-b52d-e9ddbc050f7b\") " pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:31.146492 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.146437    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aee2bbb0-35b0-42e9-9848-e04c19ca2529-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.146492 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.146456    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-registry-tls\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.146567 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.146500    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-installation-pull-secrets\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.146676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.146661    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-image-registry-private-configuration\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.149599 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.149574    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dwzl\" (UniqueName: \"kubernetes.io/projected/aee2bbb0-35b0-42e9-9848-e04c19ca2529-kube-api-access-4dwzl\") pod \"insights-runtime-extractor-5vj47\" (UID: \"aee2bbb0-35b0-42e9-9848-e04c19ca2529\") " pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.149695 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.149670    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz2p5\" (UniqueName: \"kubernetes.io/projected/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-kube-api-access-vz2p5\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.150106 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.150086    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a1b21ef-4184-458c-96a8-b6ae51c4aabf-bound-sa-token\") pod \"image-registry-7558ddcfb6-v5r4d\" (UID: \"0a1b21ef-4184-458c-96a8-b6ae51c4aabf\") " pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.150159 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.150144    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6blsl\" (UniqueName: \"kubernetes.io/projected/f21c40a0-143e-40b7-b52d-e9ddbc050f7b-kube-api-access-6blsl\") pod \"dns-default-njvk4\" (UID: \"f21c40a0-143e-40b7-b52d-e9ddbc050f7b\") " pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:31.187485 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.187456    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:31.215753 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.215717    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:31.240117 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.240086    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5vj47"
Aug 05 19:02:31.243326 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.243300    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f35de057-ffe9-4ebc-a73a-a31142eb1084-cert\") pod \"ingress-canary-l8x57\" (UID: \"f35de057-ffe9-4ebc-a73a-a31142eb1084\") " pod="openshift-ingress-canary/ingress-canary-l8x57"
Aug 05 19:02:31.243452 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.243357    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r74sm\" (UniqueName: \"kubernetes.io/projected/f35de057-ffe9-4ebc-a73a-a31142eb1084-kube-api-access-r74sm\") pod \"ingress-canary-l8x57\" (UID: \"f35de057-ffe9-4ebc-a73a-a31142eb1084\") " pod="openshift-ingress-canary/ingress-canary-l8x57"
Aug 05 19:02:31.245855 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.245829    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f35de057-ffe9-4ebc-a73a-a31142eb1084-cert\") pod \"ingress-canary-l8x57\" (UID: \"f35de057-ffe9-4ebc-a73a-a31142eb1084\") " pod="openshift-ingress-canary/ingress-canary-l8x57"
Aug 05 19:02:31.251081 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.251048    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r74sm\" (UniqueName: \"kubernetes.io/projected/f35de057-ffe9-4ebc-a73a-a31142eb1084-kube-api-access-r74sm\") pod \"ingress-canary-l8x57\" (UID: \"f35de057-ffe9-4ebc-a73a-a31142eb1084\") " pod="openshift-ingress-canary/ingress-canary-l8x57"
Aug 05 19:02:31.326498 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.325673    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l8x57"
Aug 05 19:02:31.421382 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.421354    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7558ddcfb6-v5r4d"]
Aug 05 19:02:31.424834 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:02:31.424804    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1b21ef_4184_458c_96a8_b6ae51c4aabf.slice/crio-2806fe45236d9046f9febadc0bb93764f7abdaa8ef426c93f267eebe25b27ab1 WatchSource:0}: Error finding container 2806fe45236d9046f9febadc0bb93764f7abdaa8ef426c93f267eebe25b27ab1: Status 404 returned error can't find the container with id 2806fe45236d9046f9febadc0bb93764f7abdaa8ef426c93f267eebe25b27ab1
Aug 05 19:02:31.486726 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.486689    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l8x57"]
Aug 05 19:02:31.491001 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:02:31.490945    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35de057_ffe9_4ebc_a73a_a31142eb1084.slice/crio-c73bc0d77d16fd11e05dd360c847a33259a34736475c187868439b263dbbe57d WatchSource:0}: Error finding container c73bc0d77d16fd11e05dd360c847a33259a34736475c187868439b263dbbe57d: Status 404 returned error can't find the container with id c73bc0d77d16fd11e05dd360c847a33259a34736475c187868439b263dbbe57d
Aug 05 19:02:31.638422 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.638384    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5vj47"]
Aug 05 19:02:31.641107 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:31.641081    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-njvk4"]
Aug 05 19:02:31.641687 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:02:31.641653    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee2bbb0_35b0_42e9_9848_e04c19ca2529.slice/crio-be3e5746ae292a372e537403c6ab7b839366642d79a32957ed08974337c196b5 WatchSource:0}: Error finding container be3e5746ae292a372e537403c6ab7b839366642d79a32957ed08974337c196b5: Status 404 returned error can't find the container with id be3e5746ae292a372e537403c6ab7b839366642d79a32957ed08974337c196b5
Aug 05 19:02:31.644520 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:02:31.644493    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf21c40a0_143e_40b7_b52d_e9ddbc050f7b.slice/crio-62f8dfa658da1d0e22b3b001cf2c53622c43762f385d2812bcb0fa92ab424cd9 WatchSource:0}: Error finding container 62f8dfa658da1d0e22b3b001cf2c53622c43762f385d2812bcb0fa92ab424cd9: Status 404 returned error can't find the container with id 62f8dfa658da1d0e22b3b001cf2c53622c43762f385d2812bcb0fa92ab424cd9
Aug 05 19:02:32.193374 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:32.193254    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njvk4" event={"ID":"f21c40a0-143e-40b7-b52d-e9ddbc050f7b","Type":"ContainerStarted","Data":"62f8dfa658da1d0e22b3b001cf2c53622c43762f385d2812bcb0fa92ab424cd9"}
Aug 05 19:02:32.194783 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:32.194747    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l8x57" event={"ID":"f35de057-ffe9-4ebc-a73a-a31142eb1084","Type":"ContainerStarted","Data":"c73bc0d77d16fd11e05dd360c847a33259a34736475c187868439b263dbbe57d"}
Aug 05 19:02:32.196935 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:32.196900    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5vj47" event={"ID":"aee2bbb0-35b0-42e9-9848-e04c19ca2529","Type":"ContainerStarted","Data":"5f194df434bae319f34e51bd95f2541841b1c475c5815ec9577ec4f71f3a8eab"}
Aug 05 19:02:32.197088 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:32.196964    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5vj47" event={"ID":"aee2bbb0-35b0-42e9-9848-e04c19ca2529","Type":"ContainerStarted","Data":"be3e5746ae292a372e537403c6ab7b839366642d79a32957ed08974337c196b5"}
Aug 05 19:02:32.198806 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:32.198777    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d" event={"ID":"0a1b21ef-4184-458c-96a8-b6ae51c4aabf","Type":"ContainerStarted","Data":"60f1b92ddb514b8d1356b737828d1c43db6ada516f60020778d5a1ae0666fce8"}
Aug 05 19:02:32.198933 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:32.198813    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d" event={"ID":"0a1b21ef-4184-458c-96a8-b6ae51c4aabf","Type":"ContainerStarted","Data":"2806fe45236d9046f9febadc0bb93764f7abdaa8ef426c93f267eebe25b27ab1"}
Aug 05 19:02:32.199014 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:32.198983    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:32.217741 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:32.217682    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d" podStartSLOduration=3.21766621 podStartE2EDuration="3.21766621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:32.216833125 +0000 UTC m=+53.706768190" watchObservedRunningTime="2026-08-05 19:02:32.21766621 +0000 UTC m=+53.707601284"
Aug 05 19:02:35.211895 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:35.211853    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l8x57" event={"ID":"f35de057-ffe9-4ebc-a73a-a31142eb1084","Type":"ContainerStarted","Data":"43b1b3dd89c0f59c5d9e0c165398aafa1a2cb51ac0e707dd87ee62b046398e79"}
Aug 05 19:02:35.213555 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:35.213522    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5vj47" event={"ID":"aee2bbb0-35b0-42e9-9848-e04c19ca2529","Type":"ContainerStarted","Data":"5cfd4b292beefd68c3bd0f2dd73ad8e27a2f1fcea454b74f86747a7e70415f49"}
Aug 05 19:02:35.215089 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:35.215057    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njvk4" event={"ID":"f21c40a0-143e-40b7-b52d-e9ddbc050f7b","Type":"ContainerStarted","Data":"acc10171022b1969ac1b4d7af68ba7a47dacd7ef594ccd00c08174f56ec713a4"}
Aug 05 19:02:35.215193 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:35.215106    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njvk4" event={"ID":"f21c40a0-143e-40b7-b52d-e9ddbc050f7b","Type":"ContainerStarted","Data":"6be5806e6acb21fb278365e8feb34d745d1a72dab0758030f21473be64b8a48a"}
Aug 05 19:02:35.215266 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:35.215254    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:35.226836 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:35.226775    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l8x57" podStartSLOduration=2.5556974500000003 podStartE2EDuration="5.226758675s" totalImagesPullingTime="2.671061225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:35.226649551 +0000 UTC m=+56.716584627" watchObservedRunningTime="2026-08-05 19:02:35.226758675 +0000 UTC m=+56.716693749"
Aug 05 19:02:35.241569 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:35.241520    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-njvk4" podStartSLOduration=2.725252475 podStartE2EDuration="5.241503319s" totalImagesPullingTime="2.516250844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:35.24122669 +0000 UTC m=+56.731161790" watchObservedRunningTime="2026-08-05 19:02:35.241503319 +0000 UTC m=+56.731438393"
Aug 05 19:02:37.223762 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:37.223725    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5vj47" event={"ID":"aee2bbb0-35b0-42e9-9848-e04c19ca2529","Type":"ContainerStarted","Data":"89b7e1ec69e19584a06c6a2846268b5d0a0e438976b9ed78f990475b6a68ee7a"}
Aug 05 19:02:41.140851 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:41.140813    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9jxwj"
Aug 05 19:02:41.166138 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:41.166086    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5vj47" podStartSLOduration=7.623073406 podStartE2EDuration="11.166066581s" totalImagesPullingTime="3.542993175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:02:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:37.253510757 +0000 UTC m=+58.743445830" watchObservedRunningTime="2026-08-05 19:02:41.166066581 +0000 UTC m=+62.656001653"
Aug 05 19:02:44.644914 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.644870    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:44.645347 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.644931    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs\") pod \"network-metrics-daemon-8cs9j\" (UID: \"10538719-040a-4cf2-b3df-26bf6b4c077e\") " pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:44.647145 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.647121    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 19:02:44.647272 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.647253    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 19:02:44.658250 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.658226    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10538719-040a-4cf2-b3df-26bf6b4c077e-metrics-certs\") pod \"network-metrics-daemon-8cs9j\" (UID: \"10538719-040a-4cf2-b3df-26bf6b4c077e\") " pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:44.658357 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.658252    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08234163-7160-44d4-a86f-6af179f3a5bc-original-pull-secret\") pod \"global-pull-secret-syncer-v8kzz\" (UID: \"08234163-7160-44d4-a86f-6af179f3a5bc\") " pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:44.825483 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.825446    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v8kzz"
Aug 05 19:02:44.834661 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.834639    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wk5vf\""
Aug 05 19:02:44.842553 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.842522    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8cs9j"
Aug 05 19:02:44.846080 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.846046    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtm5z\" (UniqueName: \"kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z\") pod \"network-check-target-xtqbt\" (UID: \"cb1815f8-79fb-4205-baf6-fdbe79cdcddf\") " pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:44.848319 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.848297    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 19:02:44.859216 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.859189    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 19:02:44.871490 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.871430    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtm5z\" (UniqueName: \"kubernetes.io/projected/cb1815f8-79fb-4205-baf6-fdbe79cdcddf-kube-api-access-xtm5z\") pod \"network-check-target-xtqbt\" (UID: \"cb1815f8-79fb-4205-baf6-fdbe79cdcddf\") " pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:44.964752 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.964717    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v8kzz"]
Aug 05 19:02:44.967547 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:02:44.967512    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08234163_7160_44d4_a86f_6af179f3a5bc.slice/crio-81108be1f7de2ba5fbb9199ff7640a95752d1c832b3c41bf6711e84c0635648d WatchSource:0}: Error finding container 81108be1f7de2ba5fbb9199ff7640a95752d1c832b3c41bf6711e84c0635648d: Status 404 returned error can't find the container with id 81108be1f7de2ba5fbb9199ff7640a95752d1c832b3c41bf6711e84c0635648d
Aug 05 19:02:44.980391 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:44.980357    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8cs9j"]
Aug 05 19:02:44.983920 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:02:44.983890    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10538719_040a_4cf2_b3df_26bf6b4c077e.slice/crio-d74fbabb8fa598faf494cc6d0b88cecfeeaa329a564992e74467c457028b06ff WatchSource:0}: Error finding container d74fbabb8fa598faf494cc6d0b88cecfeeaa329a564992e74467c457028b06ff: Status 404 returned error can't find the container with id d74fbabb8fa598faf494cc6d0b88cecfeeaa329a564992e74467c457028b06ff
Aug 05 19:02:45.129501 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:45.129472    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7thz\""
Aug 05 19:02:45.138261 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:45.138242    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:45.221093 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:45.221060    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-njvk4"
Aug 05 19:02:45.251099 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:45.251058    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v8kzz" event={"ID":"08234163-7160-44d4-a86f-6af179f3a5bc","Type":"ContainerStarted","Data":"81108be1f7de2ba5fbb9199ff7640a95752d1c832b3c41bf6711e84c0635648d"}
Aug 05 19:02:45.252590 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:45.252550    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8cs9j" event={"ID":"10538719-040a-4cf2-b3df-26bf6b4c077e","Type":"ContainerStarted","Data":"d74fbabb8fa598faf494cc6d0b88cecfeeaa329a564992e74467c457028b06ff"}
Aug 05 19:02:45.264373 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:45.264342    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xtqbt"]
Aug 05 19:02:45.267606 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:02:45.267580    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1815f8_79fb_4205_baf6_fdbe79cdcddf.slice/crio-f785e787254176e26a56fc13d84f19a2c09469e979d355f42176a3759e7df280 WatchSource:0}: Error finding container f785e787254176e26a56fc13d84f19a2c09469e979d355f42176a3759e7df280: Status 404 returned error can't find the container with id f785e787254176e26a56fc13d84f19a2c09469e979d355f42176a3759e7df280
Aug 05 19:02:46.258123 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:46.258033    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xtqbt" event={"ID":"cb1815f8-79fb-4205-baf6-fdbe79cdcddf","Type":"ContainerStarted","Data":"f785e787254176e26a56fc13d84f19a2c09469e979d355f42176a3759e7df280"}
Aug 05 19:02:46.261748 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:46.261679    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8cs9j" event={"ID":"10538719-040a-4cf2-b3df-26bf6b4c077e","Type":"ContainerStarted","Data":"3a63d7fa73cfbfe48af90cdd3be26907feb99601fc0873680ad163f1637c53bc"}
Aug 05 19:02:47.267872 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:47.267828    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8cs9j" event={"ID":"10538719-040a-4cf2-b3df-26bf6b4c077e","Type":"ContainerStarted","Data":"f98f19b31024e9d57a476cdadcca328e6eeceee1461140653b09b823a6554874"}
Aug 05 19:02:47.288576 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:47.288418    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8cs9j" podStartSLOduration=68.15214201 podStartE2EDuration="1m9.288392731s" totalImagesPullingTime="1.136250721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:47.287189269 +0000 UTC m=+68.777124366" watchObservedRunningTime="2026-08-05 19:02:47.288392731 +0000 UTC m=+68.778327806"
Aug 05 19:02:48.306400 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.306355    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l757c"]
Aug 05 19:02:48.308572 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.308551    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.311420 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.311395    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 05 19:02:48.311568 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.311449    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 05 19:02:48.312244 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.312217    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 05 19:02:48.312244 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.312238    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-47nns\""
Aug 05 19:02:48.312407 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.312244    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 05 19:02:48.312407 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.312223    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 05 19:02:48.312407 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.312315    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 05 19:02:48.371062 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.371015    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-tls\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.371235 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.371123    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.371235 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.371176    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-root\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.371235 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.371204    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-textfile\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.371235 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.371229    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-wtmp\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.371457 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.371251    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfxxp\" (UniqueName: \"kubernetes.io/projected/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-kube-api-access-gfxxp\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.371457 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.371279    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-accelerators-collector-config\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.371457 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.371297    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-sys\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.371457 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.371418    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-metrics-client-ca\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.471946 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.471887    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-textfile\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.471946 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.471925    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-wtmp\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.471946 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.471943    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfxxp\" (UniqueName: \"kubernetes.io/projected/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-kube-api-access-gfxxp\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.472303 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.471963    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-accelerators-collector-config\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.472303 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.472010    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-sys\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.472303 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.472130    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-wtmp\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.472303 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.472151    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-metrics-client-ca\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.472303 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.472224    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-tls\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.472303 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.472261    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.472303 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.472305    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-root\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.472645 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.472331    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-textfile\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.472645 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.472402    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-root\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.472645 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.472465    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-sys\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.472831 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.472674    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-accelerators-collector-config\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.472831 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.472795    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-metrics-client-ca\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.474773 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.474753    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.475031 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.475012    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-node-exporter-tls\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.479346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.479325    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfxxp\" (UniqueName: \"kubernetes.io/projected/d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf-kube-api-access-gfxxp\") pod \"node-exporter-l757c\" (UID: \"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf\") " pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:48.623000 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:48.622902    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l757c"
Aug 05 19:02:49.384232 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.384202    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 19:02:49.386617 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.386597    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.388855 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.388798    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-drdcn\""
Aug 05 19:02:49.388855 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.388798    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 05 19:02:49.389136 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.388871    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 05 19:02:49.389136 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.388969    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 05 19:02:49.389136 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.389067    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 05 19:02:49.389296 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.389279    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 05 19:02:49.389378 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.389359    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 05 19:02:49.389605 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.389584    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 05 19:02:49.389605 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.389601    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 05 19:02:49.389766 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.389624    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 05 19:02:49.403956 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.403910    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 19:02:49.480271 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.480243    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-config-volume\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.480271 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.480281    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.480517 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.480306    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.480517 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.480333    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-web-config\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.480517 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.480399    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c05055a7-33c6-4e79-a2e6-c82ca2807e26-config-out\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.480517 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.480433    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5rq7\" (UniqueName: \"kubernetes.io/projected/c05055a7-33c6-4e79-a2e6-c82ca2807e26-kube-api-access-h5rq7\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.480517 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.480488    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c05055a7-33c6-4e79-a2e6-c82ca2807e26-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.480733 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.480528    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c05055a7-33c6-4e79-a2e6-c82ca2807e26-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.480733 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.480583    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.480733 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.480609    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.480733 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.480649    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.480733 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.480682    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05055a7-33c6-4e79-a2e6-c82ca2807e26-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.480733 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.480717    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c05055a7-33c6-4e79-a2e6-c82ca2807e26-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.581274 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.581231    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.581274 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.581287    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.581522 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.581320    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.581522 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.581353    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05055a7-33c6-4e79-a2e6-c82ca2807e26-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.581522 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.581384    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c05055a7-33c6-4e79-a2e6-c82ca2807e26-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.581522 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.581420    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-config-volume\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.581522 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.581446    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.581522 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.581473    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.581522 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.581501    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-web-config\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.581855 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.581535    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c05055a7-33c6-4e79-a2e6-c82ca2807e26-config-out\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.581855 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.581561    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5rq7\" (UniqueName: \"kubernetes.io/projected/c05055a7-33c6-4e79-a2e6-c82ca2807e26-kube-api-access-h5rq7\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.581855 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.581584    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c05055a7-33c6-4e79-a2e6-c82ca2807e26-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.581855 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.581605    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c05055a7-33c6-4e79-a2e6-c82ca2807e26-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.582423 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.582374    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c05055a7-33c6-4e79-a2e6-c82ca2807e26-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.583125 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.583080    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c05055a7-33c6-4e79-a2e6-c82ca2807e26-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.583396 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.583326    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c05055a7-33c6-4e79-a2e6-c82ca2807e26-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.585017 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.584627    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.585017 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.584836    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-web-config\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.586481 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.586460    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.586602 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.586473    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c05055a7-33c6-4e79-a2e6-c82ca2807e26-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.586748 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.586731    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-config-volume\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.586831 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.586812    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.586895 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.586865    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.586895 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.586868    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c05055a7-33c6-4e79-a2e6-c82ca2807e26-config-out\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.586895 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.586870    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c05055a7-33c6-4e79-a2e6-c82ca2807e26-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.591015 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.590970    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5rq7\" (UniqueName: \"kubernetes.io/projected/c05055a7-33c6-4e79-a2e6-c82ca2807e26-kube-api-access-h5rq7\") pod \"alertmanager-main-0\" (UID: \"c05055a7-33c6-4e79-a2e6-c82ca2807e26\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:49.697563 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:49.697520    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 05 19:02:50.167930 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:02:50.167737    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92ef6f4_8ad4_40b7_8157_fe5ee6525bbf.slice/crio-f956dc27e7099c258d99b3aeeed838d586ba6312bd70f708e5d13f89e159afb1 WatchSource:0}: Error finding container f956dc27e7099c258d99b3aeeed838d586ba6312bd70f708e5d13f89e159afb1: Status 404 returned error can't find the container with id f956dc27e7099c258d99b3aeeed838d586ba6312bd70f708e5d13f89e159afb1
Aug 05 19:02:50.281584 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:50.281489    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xtqbt" event={"ID":"cb1815f8-79fb-4205-baf6-fdbe79cdcddf","Type":"ContainerStarted","Data":"f5e19e84d1672d3e38a944c80714d7f88fe85b03192d1c2c45e8b00eeec7eb5d"}
Aug 05 19:02:50.281915 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:50.281862    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:02:50.282903 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:50.282874    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l757c" event={"ID":"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf","Type":"ContainerStarted","Data":"f956dc27e7099c258d99b3aeeed838d586ba6312bd70f708e5d13f89e159afb1"}
Aug 05 19:02:50.319380 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:50.319334    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xtqbt" podStartSLOduration=67.420361982 podStartE2EDuration="1m12.319319147s" totalImagesPullingTime="4.898957165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:50.296166305 +0000 UTC m=+71.786101401" watchObservedRunningTime="2026-08-05 19:02:50.319319147 +0000 UTC m=+71.809254234"
Aug 05 19:02:50.320376 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:50.320127    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 05 19:02:50.324625 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:02:50.324601    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc05055a7_33c6_4e79_a2e6_c82ca2807e26.slice/crio-7364770f5c5ff7d08a54d1c3f5be04d3e3c68358241b0950eb8f75bdd77e2ed8 WatchSource:0}: Error finding container 7364770f5c5ff7d08a54d1c3f5be04d3e3c68358241b0950eb8f75bdd77e2ed8: Status 404 returned error can't find the container with id 7364770f5c5ff7d08a54d1c3f5be04d3e3c68358241b0950eb8f75bdd77e2ed8
Aug 05 19:02:51.287888 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.287852    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v8kzz" event={"ID":"08234163-7160-44d4-a86f-6af179f3a5bc","Type":"ContainerStarted","Data":"90e86794cd4c8674f88845341f9e9af0f5bbf2c8a9cf6165dbb68d11e849797f"}
Aug 05 19:02:51.289202 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.289178    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c05055a7-33c6-4e79-a2e6-c82ca2807e26","Type":"ContainerStarted","Data":"7364770f5c5ff7d08a54d1c3f5be04d3e3c68358241b0950eb8f75bdd77e2ed8"}
Aug 05 19:02:51.298498 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.298474    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5798d99c8d-gvznv"]
Aug 05 19:02:51.307379 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.307332    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v8kzz" podStartSLOduration=68.095935009 podStartE2EDuration="1m13.307273276s" totalImagesPullingTime="5.211338267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:51.306734994 +0000 UTC m=+72.796670071" watchObservedRunningTime="2026-08-05 19:02:51.307273276 +0000 UTC m=+72.797208349"
Aug 05 19:02:51.308824 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.308803    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.311133 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.311059    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-efo1ildvq2r0a\""
Aug 05 19:02:51.311133 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.311124    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Aug 05 19:02:51.311488 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.311468    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Aug 05 19:02:51.311488 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.311482    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-mkl9x\""
Aug 05 19:02:51.311644 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.311487    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Aug 05 19:02:51.311845 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.311801    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Aug 05 19:02:51.312105 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.312089    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Aug 05 19:02:51.320534 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.320508    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5798d99c8d-gvznv"]
Aug 05 19:02:51.397750 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.397712    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-tls\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.397934 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.397780    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj7mv\" (UniqueName: \"kubernetes.io/projected/f60d1f65-ddfa-4810-9215-843e6602a683-kube-api-access-bj7mv\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.397934 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.397851    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.397934 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.397888    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-grpc-tls\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.397934 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.397924    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.398181 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.398016    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.398181 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.398043    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.398181 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.398098    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f60d1f65-ddfa-4810-9215-843e6602a683-metrics-client-ca\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.499483 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.499400    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.499483 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.499440    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.499714 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.499484    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f60d1f65-ddfa-4810-9215-843e6602a683-metrics-client-ca\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.499714 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.499528    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-tls\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.499918 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.499893    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj7mv\" (UniqueName: \"kubernetes.io/projected/f60d1f65-ddfa-4810-9215-843e6602a683-kube-api-access-bj7mv\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.500033 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.499942    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.500033 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.499976    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-grpc-tls\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.500172 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.500058    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.500704 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.500646    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f60d1f65-ddfa-4810-9215-843e6602a683-metrics-client-ca\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.502625 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.502571    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.502746 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.502665    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.503003 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.502964    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-grpc-tls\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.503149 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.503129    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.503308 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.503291    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-tls\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.503505 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.503485    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f60d1f65-ddfa-4810-9215-843e6602a683-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.508261 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.508235    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj7mv\" (UniqueName: \"kubernetes.io/projected/f60d1f65-ddfa-4810-9215-843e6602a683-kube-api-access-bj7mv\") pod \"thanos-querier-5798d99c8d-gvznv\" (UID: \"f60d1f65-ddfa-4810-9215-843e6602a683\") " pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:51.619400 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:51.619363    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:52.051438 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.051416    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5798d99c8d-gvznv"]
Aug 05 19:02:52.052808 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:02:52.052779    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60d1f65_ddfa_4810_9215_843e6602a683.slice/crio-ffa1f1ee25cfeb4e57478227d88a93e7583eb39167212dd404301d90ce57c207 WatchSource:0}: Error finding container ffa1f1ee25cfeb4e57478227d88a93e7583eb39167212dd404301d90ce57c207: Status 404 returned error can't find the container with id ffa1f1ee25cfeb4e57478227d88a93e7583eb39167212dd404301d90ce57c207
Aug 05 19:02:52.294398 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.294369    2533 generic.go:356] "Generic (PLEG): container finished" podID="d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf" containerID="5379c5a357fe2f86177860d99ef8d99ab9e83f3cc3d15ac3aa9b866ea0cec21d" exitCode=0
Aug 05 19:02:52.294766 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.294474    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l757c" event={"ID":"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf","Type":"ContainerDied","Data":"5379c5a357fe2f86177860d99ef8d99ab9e83f3cc3d15ac3aa9b866ea0cec21d"}
Aug 05 19:02:52.296124 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.296098    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv" event={"ID":"f60d1f65-ddfa-4810-9215-843e6602a683","Type":"ContainerStarted","Data":"ffa1f1ee25cfeb4e57478227d88a93e7583eb39167212dd404301d90ce57c207"}
Aug 05 19:02:52.600755 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.600674    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-77c8865575-g2tf2"]
Aug 05 19:02:52.603489 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.603466    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.606055 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.606032    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vdkdx\""
Aug 05 19:02:52.606203 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.606093    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Aug 05 19:02:52.606203 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.606180    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7fus4ub2pjk4h\""
Aug 05 19:02:52.606311 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.606298    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Aug 05 19:02:52.606462 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.606445    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Aug 05 19:02:52.606508 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.606462    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 05 19:02:52.612075 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.612052    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77c8865575-g2tf2"]
Aug 05 19:02:52.709969 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.709932    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4ee769fd-8df1-481f-a1ee-3ad260167f81-metrics-server-audit-profiles\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.709969 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.709968    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4ee769fd-8df1-481f-a1ee-3ad260167f81-secret-metrics-server-tls\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.710200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.710016    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ee769fd-8df1-481f-a1ee-3ad260167f81-client-ca-bundle\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.710200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.710035    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4ee769fd-8df1-481f-a1ee-3ad260167f81-secret-metrics-server-client-certs\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.710200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.710103    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee769fd-8df1-481f-a1ee-3ad260167f81-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.710200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.710175    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l74j6\" (UniqueName: \"kubernetes.io/projected/4ee769fd-8df1-481f-a1ee-3ad260167f81-kube-api-access-l74j6\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.710324 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.710206    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4ee769fd-8df1-481f-a1ee-3ad260167f81-audit-log\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.811398 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.811358    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4ee769fd-8df1-481f-a1ee-3ad260167f81-audit-log\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.811567 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.811417    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4ee769fd-8df1-481f-a1ee-3ad260167f81-metrics-server-audit-profiles\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.811567 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.811440    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4ee769fd-8df1-481f-a1ee-3ad260167f81-secret-metrics-server-tls\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.811567 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.811463    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ee769fd-8df1-481f-a1ee-3ad260167f81-client-ca-bundle\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.811567 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.811482    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4ee769fd-8df1-481f-a1ee-3ad260167f81-secret-metrics-server-client-certs\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.811567 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.811514    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee769fd-8df1-481f-a1ee-3ad260167f81-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.811567 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.811550    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l74j6\" (UniqueName: \"kubernetes.io/projected/4ee769fd-8df1-481f-a1ee-3ad260167f81-kube-api-access-l74j6\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.811853 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.811789    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4ee769fd-8df1-481f-a1ee-3ad260167f81-audit-log\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.812270 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.812239    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee769fd-8df1-481f-a1ee-3ad260167f81-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.812671 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.812647    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4ee769fd-8df1-481f-a1ee-3ad260167f81-metrics-server-audit-profiles\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.814128 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.814104    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ee769fd-8df1-481f-a1ee-3ad260167f81-client-ca-bundle\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.814208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.814131    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4ee769fd-8df1-481f-a1ee-3ad260167f81-secret-metrics-server-tls\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.814246 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.814203    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4ee769fd-8df1-481f-a1ee-3ad260167f81-secret-metrics-server-client-certs\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.820271 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.820251    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l74j6\" (UniqueName: \"kubernetes.io/projected/4ee769fd-8df1-481f-a1ee-3ad260167f81-kube-api-access-l74j6\") pod \"metrics-server-77c8865575-g2tf2\" (UID: \"4ee769fd-8df1-481f-a1ee-3ad260167f81\") " pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:52.913599 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:52.913506    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:02:53.046509 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.046479    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77c8865575-g2tf2"]
Aug 05 19:02:53.049408 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:02:53.049372    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee769fd_8df1_481f_a1ee_3ad260167f81.slice/crio-4169aeb673e043cc5fcb8fe1cdacf230ce3043b10522e9e6a9f1753139a406fb WatchSource:0}: Error finding container 4169aeb673e043cc5fcb8fe1cdacf230ce3043b10522e9e6a9f1753139a406fb: Status 404 returned error can't find the container with id 4169aeb673e043cc5fcb8fe1cdacf230ce3043b10522e9e6a9f1753139a406fb
Aug 05 19:02:53.080530 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.080495    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"]
Aug 05 19:02:53.084125 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.084096    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"
Aug 05 19:02:53.086234 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.086211    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Aug 05 19:02:53.086321 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.086243    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fcs45\""
Aug 05 19:02:53.091803 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.091758    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"]
Aug 05 19:02:53.114517 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.114479    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c60d3387-71ac-49f8-a8a0-1cba2b327338-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8sm6t\" (UID: \"c60d3387-71ac-49f8-a8a0-1cba2b327338\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"
Aug 05 19:02:53.114686 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.114565    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkstt\" (UniqueName: \"kubernetes.io/projected/c60d3387-71ac-49f8-a8a0-1cba2b327338-kube-api-access-dkstt\") pod \"monitoring-plugin-6dffbbd67-8sm6t\" (UID: \"c60d3387-71ac-49f8-a8a0-1cba2b327338\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"
Aug 05 19:02:53.206279 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.206249    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7558ddcfb6-v5r4d"
Aug 05 19:02:53.214933 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.214907    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkstt\" (UniqueName: \"kubernetes.io/projected/c60d3387-71ac-49f8-a8a0-1cba2b327338-kube-api-access-dkstt\") pod \"monitoring-plugin-6dffbbd67-8sm6t\" (UID: \"c60d3387-71ac-49f8-a8a0-1cba2b327338\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"
Aug 05 19:02:53.215156 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.214965    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c60d3387-71ac-49f8-a8a0-1cba2b327338-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8sm6t\" (UID: \"c60d3387-71ac-49f8-a8a0-1cba2b327338\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"
Aug 05 19:02:53.215156 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:53.215077    2533 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Aug 05 19:02:53.215156 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:02:53.215126    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60d3387-71ac-49f8-a8a0-1cba2b327338-monitoring-plugin-cert podName:c60d3387-71ac-49f8-a8a0-1cba2b327338 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:53.715111165 +0000 UTC m=+75.205046217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c60d3387-71ac-49f8-a8a0-1cba2b327338-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-8sm6t" (UID: "c60d3387-71ac-49f8-a8a0-1cba2b327338") : secret "monitoring-plugin-cert" not found
Aug 05 19:02:53.225860 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.225835    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkstt\" (UniqueName: \"kubernetes.io/projected/c60d3387-71ac-49f8-a8a0-1cba2b327338-kube-api-access-dkstt\") pod \"monitoring-plugin-6dffbbd67-8sm6t\" (UID: \"c60d3387-71ac-49f8-a8a0-1cba2b327338\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"
Aug 05 19:02:53.302240 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.302207    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l757c" event={"ID":"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf","Type":"ContainerStarted","Data":"d4c6be8f0b6efd98fcc9b7d2a901aa80dd15293955da82113db427ac04a4a916"}
Aug 05 19:02:53.302703 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.302268    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l757c" event={"ID":"d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf","Type":"ContainerStarted","Data":"0164c6b1e106d51d9d1c1e44598cd5713bd2f7c2e13b4d1cbcb3e0613d613e8b"}
Aug 05 19:02:53.304202 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.304167    2533 generic.go:356] "Generic (PLEG): container finished" podID="c05055a7-33c6-4e79-a2e6-c82ca2807e26" containerID="ed3625fbed618cd2c4b1d361531df13553ef2570b117e7c480096a64033a5ce9" exitCode=0
Aug 05 19:02:53.304334 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.304248    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c05055a7-33c6-4e79-a2e6-c82ca2807e26","Type":"ContainerDied","Data":"ed3625fbed618cd2c4b1d361531df13553ef2570b117e7c480096a64033a5ce9"}
Aug 05 19:02:53.305626 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.305570    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77c8865575-g2tf2" event={"ID":"4ee769fd-8df1-481f-a1ee-3ad260167f81","Type":"ContainerStarted","Data":"4169aeb673e043cc5fcb8fe1cdacf230ce3043b10522e9e6a9f1753139a406fb"}
Aug 05 19:02:53.324243 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.324110    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l757c" podStartSLOduration=4.171205976 podStartE2EDuration="5.324091875s" totalImagesPullingTime="1.06561482s" totalInitContainerRuntime="87.271079ms" isStatefulPod=true podCreationTimestamp="2026-08-05 19:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:53.323594685 +0000 UTC m=+74.813529783" watchObservedRunningTime="2026-08-05 19:02:53.324091875 +0000 UTC m=+74.814026928"
Aug 05 19:02:53.720913 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.720830    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c60d3387-71ac-49f8-a8a0-1cba2b327338-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8sm6t\" (UID: \"c60d3387-71ac-49f8-a8a0-1cba2b327338\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"
Aug 05 19:02:53.724166 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.724127    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c60d3387-71ac-49f8-a8a0-1cba2b327338-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8sm6t\" (UID: \"c60d3387-71ac-49f8-a8a0-1cba2b327338\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"
Aug 05 19:02:53.997275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:53.997187    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"
Aug 05 19:02:55.248385 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:55.248347    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"]
Aug 05 19:02:55.252537 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:02:55.252503    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60d3387_71ac_49f8_a8a0_1cba2b327338.slice/crio-e3c560bba695c658034164063ef410bb8b2d487cd947899ec0b48e9bf208bcc7 WatchSource:0}: Error finding container e3c560bba695c658034164063ef410bb8b2d487cd947899ec0b48e9bf208bcc7: Status 404 returned error can't find the container with id e3c560bba695c658034164063ef410bb8b2d487cd947899ec0b48e9bf208bcc7
Aug 05 19:02:55.317547 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:55.317516    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t" event={"ID":"c60d3387-71ac-49f8-a8a0-1cba2b327338","Type":"ContainerStarted","Data":"e3c560bba695c658034164063ef410bb8b2d487cd947899ec0b48e9bf208bcc7"}
Aug 05 19:02:55.319951 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:55.319924    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77c8865575-g2tf2" event={"ID":"4ee769fd-8df1-481f-a1ee-3ad260167f81","Type":"ContainerStarted","Data":"a3d03ac09b5a507c48699399aa5170d5ccaf405f053f2879d5bc11299e1d5ec4"}
Aug 05 19:02:55.322448 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:55.322424    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c05055a7-33c6-4e79-a2e6-c82ca2807e26","Type":"ContainerStarted","Data":"9a83ad65ed0f7ce59302e7c61e0c0a8a75acec5f58cd8634718ca4d3409e3575"}
Aug 05 19:02:55.322564 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:55.322481    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c05055a7-33c6-4e79-a2e6-c82ca2807e26","Type":"ContainerStarted","Data":"6e34fb7fb853ca5b7bfefaa6ed29c5d0ac86353a82c8cb4e481c66f0bacbf66c"}
Aug 05 19:02:55.324633 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:55.324575    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv" event={"ID":"f60d1f65-ddfa-4810-9215-843e6602a683","Type":"ContainerStarted","Data":"97d40fe407b76541a74b0e78b944c61f88226f3357c19db2cfd77661eebdf566"}
Aug 05 19:02:55.324713 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:55.324643    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv" event={"ID":"f60d1f65-ddfa-4810-9215-843e6602a683","Type":"ContainerStarted","Data":"5fae79141c9b54fdb125b1b40375a1ae5bb73b6aeab6c311f485502979bd3332"}
Aug 05 19:02:55.338471 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:55.338377    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-77c8865575-g2tf2" podStartSLOduration=1.2910788420000001 podStartE2EDuration="3.338327192s" totalImagesPullingTime="2.04724835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:55.338114337 +0000 UTC m=+76.828049433" watchObservedRunningTime="2026-08-05 19:02:55.338327192 +0000 UTC m=+76.828262266"
Aug 05 19:02:56.333760 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:56.333716    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c05055a7-33c6-4e79-a2e6-c82ca2807e26","Type":"ContainerStarted","Data":"fe15fa13c0d834c06a7d07cfced07734944578f49cc44281d5c1d727f29e4e7c"}
Aug 05 19:02:56.334261 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:56.333811    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c05055a7-33c6-4e79-a2e6-c82ca2807e26","Type":"ContainerStarted","Data":"4b46909aa38ff09c6520d91b575fac539b567d3a76caa60a71df6fdd7413df31"}
Aug 05 19:02:56.334261 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:56.333849    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c05055a7-33c6-4e79-a2e6-c82ca2807e26","Type":"ContainerStarted","Data":"7ee869e560857ba723f7048152f581aa5e22a8029be03feca45941bd1b69e8e9"}
Aug 05 19:02:56.336434 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:56.336382    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv" event={"ID":"f60d1f65-ddfa-4810-9215-843e6602a683","Type":"ContainerStarted","Data":"24c03a36d9d03e4288ba549001756e1319f327bc35a4d1cb20a13c6d808afee0"}
Aug 05 19:02:57.343099 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:57.343051    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c05055a7-33c6-4e79-a2e6-c82ca2807e26","Type":"ContainerStarted","Data":"f4d86b98ad08a5b083d4d7463ad1360a5f21b644a47e15aa6b0a51750c1e4999"}
Aug 05 19:02:57.345781 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:57.345755    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv" event={"ID":"f60d1f65-ddfa-4810-9215-843e6602a683","Type":"ContainerStarted","Data":"27c25c9e43b3b9a3728dfc0d157619b00f59f37016dfe3fda66d1aeb6416c505"}
Aug 05 19:02:57.345919 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:57.345823    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv" event={"ID":"f60d1f65-ddfa-4810-9215-843e6602a683","Type":"ContainerStarted","Data":"ea6431a68bf2b1dcb0bb175c1fec4a9dce1fba5947805511fff878b647f1aec9"}
Aug 05 19:02:57.345919 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:57.345875    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:02:57.345919 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:57.345915    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv" event={"ID":"f60d1f65-ddfa-4810-9215-843e6602a683","Type":"ContainerStarted","Data":"e7d1cd25eeeda7282ee6a90753f353085acff66b44481b5e9e1c4be67f1bc096"}
Aug 05 19:02:57.347266 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:57.347240    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t" event={"ID":"c60d3387-71ac-49f8-a8a0-1cba2b327338","Type":"ContainerStarted","Data":"7587d72efc627a7abdd404081fe644363d35d8a6196e22f967dd524deacba283"}
Aug 05 19:02:57.347467 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:57.347444    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"
Aug 05 19:02:57.352104 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:57.352078    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t"
Aug 05 19:02:57.367901 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:57.367848    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.595998604 podStartE2EDuration="8.367830303s" totalImagesPullingTime="4.766124114s" totalInitContainerRuntime="5.707585ms" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:57.366394488 +0000 UTC m=+78.856329585" watchObservedRunningTime="2026-08-05 19:02:57.367830303 +0000 UTC m=+78.857765376"
Aug 05 19:02:57.387969 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:57.387903    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv" podStartSLOduration=2.187159554 podStartE2EDuration="6.38787954s" totalImagesPullingTime="4.200719986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:57.386098294 +0000 UTC m=+78.876033397" watchObservedRunningTime="2026-08-05 19:02:57.38787954 +0000 UTC m=+78.877814616"
Aug 05 19:02:57.400651 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:02:57.400600    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8sm6t" podStartSLOduration=3.164273964 podStartE2EDuration="4.400581887s" totalImagesPullingTime="1.236307923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:57.399642168 +0000 UTC m=+78.889577243" watchObservedRunningTime="2026-08-05 19:02:57.400581887 +0000 UTC m=+78.890516961"
Aug 05 19:03:03.357581 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:03:03.357474    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5798d99c8d-gvznv"
Aug 05 19:03:12.913926 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:03:12.913885    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:03:12.914352 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:03:12.913948    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:03:21.292006 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:03:21.291961    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xtqbt"
Aug 05 19:03:26.352883 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:03:26.352856    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l8x57_f35de057-ffe9-4ebc-a73a-a31142eb1084/serve-healthcheck-canary/0.log"
Aug 05 19:03:32.919300 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:03:32.919270    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:03:32.923143 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:03:32.923117    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-77c8865575-g2tf2"
Aug 05 19:04:12.573573 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.573533    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-79c7486775-c8zcn"]
Aug 05 19:04:12.576086 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.576063    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.578277 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.578256    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Aug 05 19:04:12.578389 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.578281    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Aug 05 19:04:12.578569 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.578551    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Aug 05 19:04:12.578649 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.578558    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Aug 05 19:04:12.578738 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.578645    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Aug 05 19:04:12.578738 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.578648    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9l92x\""
Aug 05 19:04:12.582457 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.582438    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Aug 05 19:04:12.588238 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.588213    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79c7486775-c8zcn"]
Aug 05 19:04:12.638707 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.638667    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-metrics-client-ca\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.638707 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.638706    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-serving-certs-ca-bundle\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.638912 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.638730    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-telemeter-client-tls\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.638912 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.638811    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.638912 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.638840    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-federate-client-tls\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.638912 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.638885    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v7hb\" (UniqueName: \"kubernetes.io/projected/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-kube-api-access-6v7hb\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.639075 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.638915    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.639075 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.639014    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-secret-telemeter-client\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.739828 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.739788    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.740032 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.739841    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-secret-telemeter-client\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.740032 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.739871    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-metrics-client-ca\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.740032 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.739898    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-serving-certs-ca-bundle\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.740032 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.739931    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-telemeter-client-tls\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.740032 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.739971    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.740032 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.740018    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-federate-client-tls\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.740381 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.740064    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v7hb\" (UniqueName: \"kubernetes.io/projected/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-kube-api-access-6v7hb\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.740846 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.740773    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-metrics-client-ca\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.740964 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.740925    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-serving-certs-ca-bundle\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.741068 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.741043    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.742862 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.742838    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-federate-client-tls\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.743006 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.742961    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.743105 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.743085    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-secret-telemeter-client\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.743143 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.743106    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-telemeter-client-tls\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.748200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.748179    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v7hb\" (UniqueName: \"kubernetes.io/projected/5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153-kube-api-access-6v7hb\") pod \"telemeter-client-79c7486775-c8zcn\" (UID: \"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153\") " pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:12.885816 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:12.885728    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn"
Aug 05 19:04:13.018111 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:13.018087    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79c7486775-c8zcn"]
Aug 05 19:04:13.020132 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:04:13.020105    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1050b2_aeae_4b2c_ac0e_8b8e9e7d3153.slice/crio-c5fa860965c039b4663038ede73e3639a2e6a54bd7df07e4adc0ecfad0e51b5f WatchSource:0}: Error finding container c5fa860965c039b4663038ede73e3639a2e6a54bd7df07e4adc0ecfad0e51b5f: Status 404 returned error can't find the container with id c5fa860965c039b4663038ede73e3639a2e6a54bd7df07e4adc0ecfad0e51b5f
Aug 05 19:04:13.628281 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:13.628242    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn" event={"ID":"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153","Type":"ContainerStarted","Data":"c5fa860965c039b4663038ede73e3639a2e6a54bd7df07e4adc0ecfad0e51b5f"}
Aug 05 19:04:15.636980 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:15.636944    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn" event={"ID":"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153","Type":"ContainerStarted","Data":"820816c4d80df80eb4f5ddae47dbfc3b10a847abcb2d03ef6a81231336af7bbd"}
Aug 05 19:04:15.637439 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:15.637013    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn" event={"ID":"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153","Type":"ContainerStarted","Data":"73f1dd8c50c26fcac8986c18ea2138dc1aa7350478905dcb91bcb2c028949760"}
Aug 05 19:04:15.637439 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:15.637039    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn" event={"ID":"5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153","Type":"ContainerStarted","Data":"99b1091b831b08ac1ad19300b84b747e1b90a519a9d5e775622588f8e524e7f0"}
Aug 05 19:04:15.660159 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:04:15.660059    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-79c7486775-c8zcn" podStartSLOduration=2.103129373 podStartE2EDuration="3.660036754s" totalImagesPullingTime="1.556907381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:04:15.658520993 +0000 UTC m=+157.148456068" watchObservedRunningTime="2026-08-05 19:04:15.660036754 +0000 UTC m=+157.149971823"
Aug 05 19:05:14.173532 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.173498    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"]
Aug 05 19:05:14.175818 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.175801    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"
Aug 05 19:05:14.178136 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.178114    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k7vqm\""
Aug 05 19:05:14.178136 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.178123    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 19:05:14.178853 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.178838    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 19:05:14.186927 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.186903    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"]
Aug 05 19:05:14.228172 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.228135    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx4lh\" (UniqueName: \"kubernetes.io/projected/6f943f75-3e00-4719-aef2-2f6cb35dd329-kube-api-access-hx4lh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx\" (UID: \"6f943f75-3e00-4719-aef2-2f6cb35dd329\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"
Aug 05 19:05:14.228338 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.228215    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f943f75-3e00-4719-aef2-2f6cb35dd329-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx\" (UID: \"6f943f75-3e00-4719-aef2-2f6cb35dd329\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"
Aug 05 19:05:14.228338 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.228260    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f943f75-3e00-4719-aef2-2f6cb35dd329-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx\" (UID: \"6f943f75-3e00-4719-aef2-2f6cb35dd329\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"
Aug 05 19:05:14.329596 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.329556    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f943f75-3e00-4719-aef2-2f6cb35dd329-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx\" (UID: \"6f943f75-3e00-4719-aef2-2f6cb35dd329\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"
Aug 05 19:05:14.329758 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.329610    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx4lh\" (UniqueName: \"kubernetes.io/projected/6f943f75-3e00-4719-aef2-2f6cb35dd329-kube-api-access-hx4lh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx\" (UID: \"6f943f75-3e00-4719-aef2-2f6cb35dd329\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"
Aug 05 19:05:14.329758 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.329652    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f943f75-3e00-4719-aef2-2f6cb35dd329-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx\" (UID: \"6f943f75-3e00-4719-aef2-2f6cb35dd329\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"
Aug 05 19:05:14.329966 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.329948    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f943f75-3e00-4719-aef2-2f6cb35dd329-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx\" (UID: \"6f943f75-3e00-4719-aef2-2f6cb35dd329\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"
Aug 05 19:05:14.330036 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.329974    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f943f75-3e00-4719-aef2-2f6cb35dd329-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx\" (UID: \"6f943f75-3e00-4719-aef2-2f6cb35dd329\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"
Aug 05 19:05:14.337684 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.337661    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx4lh\" (UniqueName: \"kubernetes.io/projected/6f943f75-3e00-4719-aef2-2f6cb35dd329-kube-api-access-hx4lh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx\" (UID: \"6f943f75-3e00-4719-aef2-2f6cb35dd329\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"
Aug 05 19:05:14.484538 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.484430    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"
Aug 05 19:05:14.612511 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.612473    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"]
Aug 05 19:05:14.616776 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:05:14.616741    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f943f75_3e00_4719_aef2_2f6cb35dd329.slice/crio-a8efe2b9647302aeb5a80b77778a2d69a0a942396a9583ba086cdf84307eff47 WatchSource:0}: Error finding container a8efe2b9647302aeb5a80b77778a2d69a0a942396a9583ba086cdf84307eff47: Status 404 returned error can't find the container with id a8efe2b9647302aeb5a80b77778a2d69a0a942396a9583ba086cdf84307eff47
Aug 05 19:05:14.851406 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:14.851315    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx" event={"ID":"6f943f75-3e00-4719-aef2-2f6cb35dd329","Type":"ContainerStarted","Data":"a8efe2b9647302aeb5a80b77778a2d69a0a942396a9583ba086cdf84307eff47"}
Aug 05 19:05:22.883359 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:22.883314    2533 generic.go:356] "Generic (PLEG): container finished" podID="6f943f75-3e00-4719-aef2-2f6cb35dd329" containerID="8ff8b62344f244fe59fb1eeba5881e6ba757b35e715199da7385c78687a7ee31" exitCode=0
Aug 05 19:05:22.883825 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:22.883372    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx" event={"ID":"6f943f75-3e00-4719-aef2-2f6cb35dd329","Type":"ContainerDied","Data":"8ff8b62344f244fe59fb1eeba5881e6ba757b35e715199da7385c78687a7ee31"}
Aug 05 19:05:25.895725 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:25.895687    2533 generic.go:356] "Generic (PLEG): container finished" podID="6f943f75-3e00-4719-aef2-2f6cb35dd329" containerID="541d4ea1c0b504e50e7788aa93af2325cce9b286aea1e0a1f9b2c83f7e4284ca" exitCode=0
Aug 05 19:05:25.896124 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:25.895772    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx" event={"ID":"6f943f75-3e00-4719-aef2-2f6cb35dd329","Type":"ContainerDied","Data":"541d4ea1c0b504e50e7788aa93af2325cce9b286aea1e0a1f9b2c83f7e4284ca"}
Aug 05 19:05:32.933799 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:32.933760    2533 generic.go:356] "Generic (PLEG): container finished" podID="6f943f75-3e00-4719-aef2-2f6cb35dd329" containerID="0641cb8f5b65ae4483f586214365356f4387344b022b164d51284f2535cba874" exitCode=0
Aug 05 19:05:32.934177 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:32.933820    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx" event={"ID":"6f943f75-3e00-4719-aef2-2f6cb35dd329","Type":"ContainerDied","Data":"0641cb8f5b65ae4483f586214365356f4387344b022b164d51284f2535cba874"}
Aug 05 19:05:34.062490 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:34.062465    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"
Aug 05 19:05:34.208896 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:34.208802    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f943f75-3e00-4719-aef2-2f6cb35dd329-bundle\") pod \"6f943f75-3e00-4719-aef2-2f6cb35dd329\" (UID: \"6f943f75-3e00-4719-aef2-2f6cb35dd329\") "
Aug 05 19:05:34.208896 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:34.208845    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx4lh\" (UniqueName: \"kubernetes.io/projected/6f943f75-3e00-4719-aef2-2f6cb35dd329-kube-api-access-hx4lh\") pod \"6f943f75-3e00-4719-aef2-2f6cb35dd329\" (UID: \"6f943f75-3e00-4719-aef2-2f6cb35dd329\") "
Aug 05 19:05:34.208896 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:34.208862    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f943f75-3e00-4719-aef2-2f6cb35dd329-util\") pod \"6f943f75-3e00-4719-aef2-2f6cb35dd329\" (UID: \"6f943f75-3e00-4719-aef2-2f6cb35dd329\") "
Aug 05 19:05:34.209591 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:34.209564    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f943f75-3e00-4719-aef2-2f6cb35dd329-bundle" (OuterVolumeSpecName: "bundle") pod "6f943f75-3e00-4719-aef2-2f6cb35dd329" (UID: "6f943f75-3e00-4719-aef2-2f6cb35dd329"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:05:34.211094 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:34.211067    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f943f75-3e00-4719-aef2-2f6cb35dd329-kube-api-access-hx4lh" (OuterVolumeSpecName: "kube-api-access-hx4lh") pod "6f943f75-3e00-4719-aef2-2f6cb35dd329" (UID: "6f943f75-3e00-4719-aef2-2f6cb35dd329"). InnerVolumeSpecName "kube-api-access-hx4lh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:05:34.214439 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:34.214412    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f943f75-3e00-4719-aef2-2f6cb35dd329-util" (OuterVolumeSpecName: "util") pod "6f943f75-3e00-4719-aef2-2f6cb35dd329" (UID: "6f943f75-3e00-4719-aef2-2f6cb35dd329"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:05:34.309343 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:34.309302    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx4lh\" (UniqueName: \"kubernetes.io/projected/6f943f75-3e00-4719-aef2-2f6cb35dd329-kube-api-access-hx4lh\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:05:34.309343 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:34.309333    2533 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f943f75-3e00-4719-aef2-2f6cb35dd329-util\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:05:34.309343 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:34.309342    2533 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f943f75-3e00-4719-aef2-2f6cb35dd329-bundle\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:05:34.942313 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:34.942275    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx" event={"ID":"6f943f75-3e00-4719-aef2-2f6cb35dd329","Type":"ContainerDied","Data":"a8efe2b9647302aeb5a80b77778a2d69a0a942396a9583ba086cdf84307eff47"}
Aug 05 19:05:34.942313 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:34.942301    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404xkgx"
Aug 05 19:05:34.942508 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:34.942323    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8efe2b9647302aeb5a80b77778a2d69a0a942396a9583ba086cdf84307eff47"
Aug 05 19:05:42.089971 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.089931    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9"]
Aug 05 19:05:42.090469 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.090371    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f943f75-3e00-4719-aef2-2f6cb35dd329" containerName="pull"
Aug 05 19:05:42.090469 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.090388    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f943f75-3e00-4719-aef2-2f6cb35dd329" containerName="pull"
Aug 05 19:05:42.090469 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.090413    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f943f75-3e00-4719-aef2-2f6cb35dd329" containerName="extract"
Aug 05 19:05:42.090469 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.090420    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f943f75-3e00-4719-aef2-2f6cb35dd329" containerName="extract"
Aug 05 19:05:42.090469 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.090433    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f943f75-3e00-4719-aef2-2f6cb35dd329" containerName="util"
Aug 05 19:05:42.090469 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.090441    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f943f75-3e00-4719-aef2-2f6cb35dd329" containerName="util"
Aug 05 19:05:42.090758 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.090506    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f943f75-3e00-4719-aef2-2f6cb35dd329" containerName="extract"
Aug 05 19:05:42.094200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.094180    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9"
Aug 05 19:05:42.096828 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.096802    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hgc4q\""
Aug 05 19:05:42.096949 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.096814    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Aug 05 19:05:42.097064 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.097042    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Aug 05 19:05:42.105935 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.105909    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9"]
Aug 05 19:05:42.169339 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.169299    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bce6a2ab-90f2-47ae-91c2-946d63e5ca83-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dclc9\" (UID: \"bce6a2ab-90f2-47ae-91c2-946d63e5ca83\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9"
Aug 05 19:05:42.169520 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.169348    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jc65\" (UniqueName: \"kubernetes.io/projected/bce6a2ab-90f2-47ae-91c2-946d63e5ca83-kube-api-access-5jc65\") pod \"cert-manager-operator-controller-manager-55c444bf86-dclc9\" (UID: \"bce6a2ab-90f2-47ae-91c2-946d63e5ca83\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9"
Aug 05 19:05:42.270347 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.270297    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jc65\" (UniqueName: \"kubernetes.io/projected/bce6a2ab-90f2-47ae-91c2-946d63e5ca83-kube-api-access-5jc65\") pod \"cert-manager-operator-controller-manager-55c444bf86-dclc9\" (UID: \"bce6a2ab-90f2-47ae-91c2-946d63e5ca83\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9"
Aug 05 19:05:42.270569 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.270398    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bce6a2ab-90f2-47ae-91c2-946d63e5ca83-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dclc9\" (UID: \"bce6a2ab-90f2-47ae-91c2-946d63e5ca83\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9"
Aug 05 19:05:42.270721 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.270702    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bce6a2ab-90f2-47ae-91c2-946d63e5ca83-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dclc9\" (UID: \"bce6a2ab-90f2-47ae-91c2-946d63e5ca83\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9"
Aug 05 19:05:42.278755 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.278714    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jc65\" (UniqueName: \"kubernetes.io/projected/bce6a2ab-90f2-47ae-91c2-946d63e5ca83-kube-api-access-5jc65\") pod \"cert-manager-operator-controller-manager-55c444bf86-dclc9\" (UID: \"bce6a2ab-90f2-47ae-91c2-946d63e5ca83\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9"
Aug 05 19:05:42.403328 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.403223    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9"
Aug 05 19:05:42.546055 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.546019    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9"]
Aug 05 19:05:42.551517 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:05:42.551489    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce6a2ab_90f2_47ae_91c2_946d63e5ca83.slice/crio-0693fe60747b1d8836e9afb5609c29a47549341df2b10374fe6911522bff322e WatchSource:0}: Error finding container 0693fe60747b1d8836e9afb5609c29a47549341df2b10374fe6911522bff322e: Status 404 returned error can't find the container with id 0693fe60747b1d8836e9afb5609c29a47549341df2b10374fe6911522bff322e
Aug 05 19:05:42.971727 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:42.971691    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9" event={"ID":"bce6a2ab-90f2-47ae-91c2-946d63e5ca83","Type":"ContainerStarted","Data":"0693fe60747b1d8836e9afb5609c29a47549341df2b10374fe6911522bff322e"}
Aug 05 19:05:44.982580 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:44.982471    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9" event={"ID":"bce6a2ab-90f2-47ae-91c2-946d63e5ca83","Type":"ContainerStarted","Data":"0390dd169031a3df9fc9f2f916fa4da310a523fe7e5a1e8a5f8235ad4014ee35"}
Aug 05 19:05:45.002139 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:45.002079    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dclc9" podStartSLOduration=0.879712567 podStartE2EDuration="3.00205763s" totalImagesPullingTime="2.122345063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:05:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:05:45.000585224 +0000 UTC m=+246.490520334" watchObservedRunningTime="2026-08-05 19:05:45.00205763 +0000 UTC m=+246.491992703"
Aug 05 19:05:46.225333 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.225300    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"]
Aug 05 19:05:46.227715 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.227695    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"
Aug 05 19:05:46.230103 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.230083    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 19:05:46.230816 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.230790    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 19:05:46.230898 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.230822    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k7vqm\""
Aug 05 19:05:46.240611 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.240585    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"]
Aug 05 19:05:46.266573 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.266541    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l4qpr"]
Aug 05 19:05:46.268636 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.268610    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l4qpr"
Aug 05 19:05:46.270908 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.270890    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 05 19:05:46.271061 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.270926    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 05 19:05:46.271133 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.271080    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xvhr7\""
Aug 05 19:05:46.277922 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.277898    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l4qpr"]
Aug 05 19:05:46.304297 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.304266    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0abee298-032f-4079-9450-e1965c2124c3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl\" (UID: \"0abee298-032f-4079-9450-e1965c2124c3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"
Aug 05 19:05:46.304297 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.304309    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlzkz\" (UniqueName: \"kubernetes.io/projected/38bbab20-3829-43b0-bfae-a7ef4e09f743-kube-api-access-jlzkz\") pod \"cert-manager-webhook-6486ffd997-l4qpr\" (UID: \"38bbab20-3829-43b0-bfae-a7ef4e09f743\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l4qpr"
Aug 05 19:05:46.304508 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.304341    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38bbab20-3829-43b0-bfae-a7ef4e09f743-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l4qpr\" (UID: \"38bbab20-3829-43b0-bfae-a7ef4e09f743\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l4qpr"
Aug 05 19:05:46.304508 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.304407    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0abee298-032f-4079-9450-e1965c2124c3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl\" (UID: \"0abee298-032f-4079-9450-e1965c2124c3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"
Aug 05 19:05:46.304508 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.304427    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bsvk\" (UniqueName: \"kubernetes.io/projected/0abee298-032f-4079-9450-e1965c2124c3-kube-api-access-7bsvk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl\" (UID: \"0abee298-032f-4079-9450-e1965c2124c3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"
Aug 05 19:05:46.405125 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.405081    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0abee298-032f-4079-9450-e1965c2124c3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl\" (UID: \"0abee298-032f-4079-9450-e1965c2124c3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"
Aug 05 19:05:46.405125 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.405131    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bsvk\" (UniqueName: \"kubernetes.io/projected/0abee298-032f-4079-9450-e1965c2124c3-kube-api-access-7bsvk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl\" (UID: \"0abee298-032f-4079-9450-e1965c2124c3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"
Aug 05 19:05:46.405382 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.405168    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0abee298-032f-4079-9450-e1965c2124c3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl\" (UID: \"0abee298-032f-4079-9450-e1965c2124c3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"
Aug 05 19:05:46.405382 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.405205    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlzkz\" (UniqueName: \"kubernetes.io/projected/38bbab20-3829-43b0-bfae-a7ef4e09f743-kube-api-access-jlzkz\") pod \"cert-manager-webhook-6486ffd997-l4qpr\" (UID: \"38bbab20-3829-43b0-bfae-a7ef4e09f743\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l4qpr"
Aug 05 19:05:46.405382 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.405244    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38bbab20-3829-43b0-bfae-a7ef4e09f743-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l4qpr\" (UID: \"38bbab20-3829-43b0-bfae-a7ef4e09f743\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l4qpr"
Aug 05 19:05:46.405560 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.405538    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0abee298-032f-4079-9450-e1965c2124c3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl\" (UID: \"0abee298-032f-4079-9450-e1965c2124c3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"
Aug 05 19:05:46.405598 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.405562    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0abee298-032f-4079-9450-e1965c2124c3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl\" (UID: \"0abee298-032f-4079-9450-e1965c2124c3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"
Aug 05 19:05:46.417129 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.417087    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38bbab20-3829-43b0-bfae-a7ef4e09f743-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l4qpr\" (UID: \"38bbab20-3829-43b0-bfae-a7ef4e09f743\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l4qpr"
Aug 05 19:05:46.417431 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.417409    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlzkz\" (UniqueName: \"kubernetes.io/projected/38bbab20-3829-43b0-bfae-a7ef4e09f743-kube-api-access-jlzkz\") pod \"cert-manager-webhook-6486ffd997-l4qpr\" (UID: \"38bbab20-3829-43b0-bfae-a7ef4e09f743\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l4qpr"
Aug 05 19:05:46.418055 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.418037    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bsvk\" (UniqueName: \"kubernetes.io/projected/0abee298-032f-4079-9450-e1965c2124c3-kube-api-access-7bsvk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl\" (UID: \"0abee298-032f-4079-9450-e1965c2124c3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"
Aug 05 19:05:46.537287 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.537175    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"
Aug 05 19:05:46.588242 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.588217    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l4qpr"
Aug 05 19:05:46.676563 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.676534    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"]
Aug 05 19:05:46.678821 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:05:46.678777    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0abee298_032f_4079_9450_e1965c2124c3.slice/crio-901a281f864aa4690f550426050ad6284d6892e789bc1d8088afdeda98808e48 WatchSource:0}: Error finding container 901a281f864aa4690f550426050ad6284d6892e789bc1d8088afdeda98808e48: Status 404 returned error can't find the container with id 901a281f864aa4690f550426050ad6284d6892e789bc1d8088afdeda98808e48
Aug 05 19:05:46.730954 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.730919    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l4qpr"]
Aug 05 19:05:46.734590 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:05:46.734561    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38bbab20_3829_43b0_bfae_a7ef4e09f743.slice/crio-19534a0a18e3654104a82d16f32cf17374e40e7e195c904cc6fe8c49ae250238 WatchSource:0}: Error finding container 19534a0a18e3654104a82d16f32cf17374e40e7e195c904cc6fe8c49ae250238: Status 404 returned error can't find the container with id 19534a0a18e3654104a82d16f32cf17374e40e7e195c904cc6fe8c49ae250238
Aug 05 19:05:46.996727 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.996696    2533 generic.go:356] "Generic (PLEG): container finished" podID="0abee298-032f-4079-9450-e1965c2124c3" containerID="c9acdea15e6566473e580fe03707a7c3f93a16c5876259287d636a1c62d38234" exitCode=0
Aug 05 19:05:46.996920 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.996790    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl" event={"ID":"0abee298-032f-4079-9450-e1965c2124c3","Type":"ContainerDied","Data":"c9acdea15e6566473e580fe03707a7c3f93a16c5876259287d636a1c62d38234"}
Aug 05 19:05:46.996920 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.996844    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl" event={"ID":"0abee298-032f-4079-9450-e1965c2124c3","Type":"ContainerStarted","Data":"901a281f864aa4690f550426050ad6284d6892e789bc1d8088afdeda98808e48"}
Aug 05 19:05:46.998122 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:46.998097    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l4qpr" event={"ID":"38bbab20-3829-43b0-bfae-a7ef4e09f743","Type":"ContainerStarted","Data":"19534a0a18e3654104a82d16f32cf17374e40e7e195c904cc6fe8c49ae250238"}
Aug 05 19:05:51.031699 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:51.031656    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l4qpr" event={"ID":"38bbab20-3829-43b0-bfae-a7ef4e09f743","Type":"ContainerStarted","Data":"f403d2a1eef562d923ef89a0f7a19f236bca1cfc4b1d7197fd6c3b44fa1bcd81"}
Aug 05 19:05:51.032215 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:51.031717    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l4qpr"
Aug 05 19:05:51.033500 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:51.033472    2533 generic.go:356] "Generic (PLEG): container finished" podID="0abee298-032f-4079-9450-e1965c2124c3" containerID="bd92a618d934923b3f10f138ea71f2624816320cf941e1f2294e817fe6ee83e1" exitCode=0
Aug 05 19:05:51.033623 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:51.033511    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl" event={"ID":"0abee298-032f-4079-9450-e1965c2124c3","Type":"ContainerDied","Data":"bd92a618d934923b3f10f138ea71f2624816320cf941e1f2294e817fe6ee83e1"}
Aug 05 19:05:51.049592 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:51.049530    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-l4qpr" podStartSLOduration=1.769017491 podStartE2EDuration="5.049508213s" totalImagesPullingTime="3.280490722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:05:51.048029148 +0000 UTC m=+252.537964223" watchObservedRunningTime="2026-08-05 19:05:51.049508213 +0000 UTC m=+252.539443289"
Aug 05 19:05:52.039752 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:52.039713    2533 generic.go:356] "Generic (PLEG): container finished" podID="0abee298-032f-4079-9450-e1965c2124c3" containerID="2059656f845a93e55a2ca092b8fee8f2e96dc43f74f9f13cd4868438e4cc9820" exitCode=0
Aug 05 19:05:52.040227 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:52.039787    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl" event={"ID":"0abee298-032f-4079-9450-e1965c2124c3","Type":"ContainerDied","Data":"2059656f845a93e55a2ca092b8fee8f2e96dc43f74f9f13cd4868438e4cc9820"}
Aug 05 19:05:53.168319 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:53.168292    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"
Aug 05 19:05:53.264297 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:53.264258    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bsvk\" (UniqueName: \"kubernetes.io/projected/0abee298-032f-4079-9450-e1965c2124c3-kube-api-access-7bsvk\") pod \"0abee298-032f-4079-9450-e1965c2124c3\" (UID: \"0abee298-032f-4079-9450-e1965c2124c3\") "
Aug 05 19:05:53.264470 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:53.264315    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0abee298-032f-4079-9450-e1965c2124c3-bundle\") pod \"0abee298-032f-4079-9450-e1965c2124c3\" (UID: \"0abee298-032f-4079-9450-e1965c2124c3\") "
Aug 05 19:05:53.264470 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:53.264355    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0abee298-032f-4079-9450-e1965c2124c3-util\") pod \"0abee298-032f-4079-9450-e1965c2124c3\" (UID: \"0abee298-032f-4079-9450-e1965c2124c3\") "
Aug 05 19:05:53.264778 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:53.264744    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0abee298-032f-4079-9450-e1965c2124c3-bundle" (OuterVolumeSpecName: "bundle") pod "0abee298-032f-4079-9450-e1965c2124c3" (UID: "0abee298-032f-4079-9450-e1965c2124c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:05:53.266504 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:53.266482    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0abee298-032f-4079-9450-e1965c2124c3-kube-api-access-7bsvk" (OuterVolumeSpecName: "kube-api-access-7bsvk") pod "0abee298-032f-4079-9450-e1965c2124c3" (UID: "0abee298-032f-4079-9450-e1965c2124c3"). InnerVolumeSpecName "kube-api-access-7bsvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:05:53.270831 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:53.270804    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0abee298-032f-4079-9450-e1965c2124c3-util" (OuterVolumeSpecName: "util") pod "0abee298-032f-4079-9450-e1965c2124c3" (UID: "0abee298-032f-4079-9450-e1965c2124c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:05:53.365503 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:53.365411    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bsvk\" (UniqueName: \"kubernetes.io/projected/0abee298-032f-4079-9450-e1965c2124c3-kube-api-access-7bsvk\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:05:53.365503 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:53.365444    2533 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0abee298-032f-4079-9450-e1965c2124c3-bundle\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:05:53.365503 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:53.365454    2533 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0abee298-032f-4079-9450-e1965c2124c3-util\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:05:54.049982 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:54.049940    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl" event={"ID":"0abee298-032f-4079-9450-e1965c2124c3","Type":"ContainerDied","Data":"901a281f864aa4690f550426050ad6284d6892e789bc1d8088afdeda98808e48"}
Aug 05 19:05:54.049982 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:54.049978    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjbzl"
Aug 05 19:05:54.050212 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:54.050011    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="901a281f864aa4690f550426050ad6284d6892e789bc1d8088afdeda98808e48"
Aug 05 19:05:56.049008 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.048947    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d6xkx"]
Aug 05 19:05:56.049491 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.049422    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0abee298-032f-4079-9450-e1965c2124c3" containerName="pull"
Aug 05 19:05:56.049491 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.049441    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="0abee298-032f-4079-9450-e1965c2124c3" containerName="pull"
Aug 05 19:05:56.049491 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.049452    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0abee298-032f-4079-9450-e1965c2124c3" containerName="extract"
Aug 05 19:05:56.049491 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.049459    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="0abee298-032f-4079-9450-e1965c2124c3" containerName="extract"
Aug 05 19:05:56.049491 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.049473    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0abee298-032f-4079-9450-e1965c2124c3" containerName="util"
Aug 05 19:05:56.049491 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.049480    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="0abee298-032f-4079-9450-e1965c2124c3" containerName="util"
Aug 05 19:05:56.049770 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.049558    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="0abee298-032f-4079-9450-e1965c2124c3" containerName="extract"
Aug 05 19:05:56.051538 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.051517    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d6xkx"
Aug 05 19:05:56.053579 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.053560    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-njzwk\""
Aug 05 19:05:56.063472 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.060381    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d6xkx"]
Aug 05 19:05:56.089815 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.089779    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkw8c\" (UniqueName: \"kubernetes.io/projected/7b538c57-c4fe-412c-9537-8bd5188c7ee1-kube-api-access-dkw8c\") pod \"cert-manager-55b4d954d5-d6xkx\" (UID: \"7b538c57-c4fe-412c-9537-8bd5188c7ee1\") " pod="cert-manager/cert-manager-55b4d954d5-d6xkx"
Aug 05 19:05:56.089815 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.089822    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b538c57-c4fe-412c-9537-8bd5188c7ee1-bound-sa-token\") pod \"cert-manager-55b4d954d5-d6xkx\" (UID: \"7b538c57-c4fe-412c-9537-8bd5188c7ee1\") " pod="cert-manager/cert-manager-55b4d954d5-d6xkx"
Aug 05 19:05:56.191259 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.191218    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkw8c\" (UniqueName: \"kubernetes.io/projected/7b538c57-c4fe-412c-9537-8bd5188c7ee1-kube-api-access-dkw8c\") pod \"cert-manager-55b4d954d5-d6xkx\" (UID: \"7b538c57-c4fe-412c-9537-8bd5188c7ee1\") " pod="cert-manager/cert-manager-55b4d954d5-d6xkx"
Aug 05 19:05:56.191259 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.191266    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b538c57-c4fe-412c-9537-8bd5188c7ee1-bound-sa-token\") pod \"cert-manager-55b4d954d5-d6xkx\" (UID: \"7b538c57-c4fe-412c-9537-8bd5188c7ee1\") " pod="cert-manager/cert-manager-55b4d954d5-d6xkx"
Aug 05 19:05:56.199966 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.199935    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b538c57-c4fe-412c-9537-8bd5188c7ee1-bound-sa-token\") pod \"cert-manager-55b4d954d5-d6xkx\" (UID: \"7b538c57-c4fe-412c-9537-8bd5188c7ee1\") " pod="cert-manager/cert-manager-55b4d954d5-d6xkx"
Aug 05 19:05:56.200274 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.200252    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkw8c\" (UniqueName: \"kubernetes.io/projected/7b538c57-c4fe-412c-9537-8bd5188c7ee1-kube-api-access-dkw8c\") pod \"cert-manager-55b4d954d5-d6xkx\" (UID: \"7b538c57-c4fe-412c-9537-8bd5188c7ee1\") " pod="cert-manager/cert-manager-55b4d954d5-d6xkx"
Aug 05 19:05:56.366281 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.366183    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-d6xkx"
Aug 05 19:05:56.496023 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:56.495969    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-d6xkx"]
Aug 05 19:05:56.498132 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:05:56.498105    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b538c57_c4fe_412c_9537_8bd5188c7ee1.slice/crio-2d6b355e845f2655faf5974dde3a48782c095b342165353f2c047c3263997e67 WatchSource:0}: Error finding container 2d6b355e845f2655faf5974dde3a48782c095b342165353f2c047c3263997e67: Status 404 returned error can't find the container with id 2d6b355e845f2655faf5974dde3a48782c095b342165353f2c047c3263997e67
Aug 05 19:05:57.042246 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:57.042213    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l4qpr"
Aug 05 19:05:57.065635 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:57.065597    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d6xkx" event={"ID":"7b538c57-c4fe-412c-9537-8bd5188c7ee1","Type":"ContainerStarted","Data":"c056bd0c15ec5fcd9fa122cd1a33bae998e454ed8144d6408a06dcdc84e1f252"}
Aug 05 19:05:57.065635 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:57.065641    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-d6xkx" event={"ID":"7b538c57-c4fe-412c-9537-8bd5188c7ee1","Type":"ContainerStarted","Data":"2d6b355e845f2655faf5974dde3a48782c095b342165353f2c047c3263997e67"}
Aug 05 19:05:57.081039 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:05:57.080963    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-d6xkx" podStartSLOduration=1.080945432 podStartE2EDuration="1.080945432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:05:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:05:57.080148244 +0000 UTC m=+258.570083320" watchObservedRunningTime="2026-08-05 19:05:57.080945432 +0000 UTC m=+258.570880506"
Aug 05 19:06:11.851082 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:11.850979    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"]
Aug 05 19:06:11.855653 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:11.855632    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"
Aug 05 19:06:11.857854 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:11.857826    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 19:06:11.858024 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:11.857872    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 19:06:11.858024 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:11.857842    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k7vqm\""
Aug 05 19:06:11.862397 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:11.862372    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"]
Aug 05 19:06:11.922866 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:11.922824    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fb05c4c-c520-4402-bd80-2f1cfecb9358-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm\" (UID: \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"
Aug 05 19:06:11.922866 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:11.922873    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhvm2\" (UniqueName: \"kubernetes.io/projected/6fb05c4c-c520-4402-bd80-2f1cfecb9358-kube-api-access-lhvm2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm\" (UID: \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"
Aug 05 19:06:11.923125 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:11.922952    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fb05c4c-c520-4402-bd80-2f1cfecb9358-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm\" (UID: \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"
Aug 05 19:06:12.023550 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:12.023507    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fb05c4c-c520-4402-bd80-2f1cfecb9358-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm\" (UID: \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"
Aug 05 19:06:12.023550 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:12.023553    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhvm2\" (UniqueName: \"kubernetes.io/projected/6fb05c4c-c520-4402-bd80-2f1cfecb9358-kube-api-access-lhvm2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm\" (UID: \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"
Aug 05 19:06:12.023757 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:12.023582    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fb05c4c-c520-4402-bd80-2f1cfecb9358-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm\" (UID: \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"
Aug 05 19:06:12.023895 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:12.023876    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fb05c4c-c520-4402-bd80-2f1cfecb9358-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm\" (UID: \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"
Aug 05 19:06:12.023957 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:12.023940    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fb05c4c-c520-4402-bd80-2f1cfecb9358-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm\" (UID: \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"
Aug 05 19:06:12.031143 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:12.031116    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhvm2\" (UniqueName: \"kubernetes.io/projected/6fb05c4c-c520-4402-bd80-2f1cfecb9358-kube-api-access-lhvm2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm\" (UID: \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"
Aug 05 19:06:12.165930 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:12.165841    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"
Aug 05 19:06:12.292552 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:12.292524    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"]
Aug 05 19:06:12.295224 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:06:12.295193    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb05c4c_c520_4402_bd80_2f1cfecb9358.slice/crio-587a9e777632672c68ab0b7ce602272111de1938b319e7c3bd295b33dec92f3e WatchSource:0}: Error finding container 587a9e777632672c68ab0b7ce602272111de1938b319e7c3bd295b33dec92f3e: Status 404 returned error can't find the container with id 587a9e777632672c68ab0b7ce602272111de1938b319e7c3bd295b33dec92f3e
Aug 05 19:06:13.131514 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:13.131478    2533 generic.go:356] "Generic (PLEG): container finished" podID="6fb05c4c-c520-4402-bd80-2f1cfecb9358" containerID="01f90277dca994f927b184cace08c55a88bc7c56dce5d94ff25fdee6f293eeb2" exitCode=0
Aug 05 19:06:13.131898 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:13.131524    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm" event={"ID":"6fb05c4c-c520-4402-bd80-2f1cfecb9358","Type":"ContainerDied","Data":"01f90277dca994f927b184cace08c55a88bc7c56dce5d94ff25fdee6f293eeb2"}
Aug 05 19:06:13.131898 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:13.131568    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm" event={"ID":"6fb05c4c-c520-4402-bd80-2f1cfecb9358","Type":"ContainerStarted","Data":"587a9e777632672c68ab0b7ce602272111de1938b319e7c3bd295b33dec92f3e"}
Aug 05 19:06:15.141777 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:15.141739    2533 generic.go:356] "Generic (PLEG): container finished" podID="6fb05c4c-c520-4402-bd80-2f1cfecb9358" containerID="924003fe9243f17511a6a7c030e5abe7ffaae9b8c026fa06f16fe902a7155690" exitCode=0
Aug 05 19:06:15.142202 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:15.141828    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm" event={"ID":"6fb05c4c-c520-4402-bd80-2f1cfecb9358","Type":"ContainerDied","Data":"924003fe9243f17511a6a7c030e5abe7ffaae9b8c026fa06f16fe902a7155690"}
Aug 05 19:06:16.148327 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:16.148292    2533 generic.go:356] "Generic (PLEG): container finished" podID="6fb05c4c-c520-4402-bd80-2f1cfecb9358" containerID="6c87ed4cdc076c1b0a0424ffb6e776a74f41a890b9b472a6ebfc1fd3720f95e9" exitCode=0
Aug 05 19:06:16.148724 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:16.148345    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm" event={"ID":"6fb05c4c-c520-4402-bd80-2f1cfecb9358","Type":"ContainerDied","Data":"6c87ed4cdc076c1b0a0424ffb6e776a74f41a890b9b472a6ebfc1fd3720f95e9"}
Aug 05 19:06:17.283553 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:17.283528    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"
Aug 05 19:06:17.373572 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:17.373540    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fb05c4c-c520-4402-bd80-2f1cfecb9358-bundle\") pod \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\" (UID: \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\") "
Aug 05 19:06:17.373775 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:17.373593    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhvm2\" (UniqueName: \"kubernetes.io/projected/6fb05c4c-c520-4402-bd80-2f1cfecb9358-kube-api-access-lhvm2\") pod \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\" (UID: \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\") "
Aug 05 19:06:17.373775 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:17.373656    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fb05c4c-c520-4402-bd80-2f1cfecb9358-util\") pod \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\" (UID: \"6fb05c4c-c520-4402-bd80-2f1cfecb9358\") "
Aug 05 19:06:17.374385 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:17.374357    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fb05c4c-c520-4402-bd80-2f1cfecb9358-bundle" (OuterVolumeSpecName: "bundle") pod "6fb05c4c-c520-4402-bd80-2f1cfecb9358" (UID: "6fb05c4c-c520-4402-bd80-2f1cfecb9358"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:06:17.375727 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:17.375705    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fb05c4c-c520-4402-bd80-2f1cfecb9358-kube-api-access-lhvm2" (OuterVolumeSpecName: "kube-api-access-lhvm2") pod "6fb05c4c-c520-4402-bd80-2f1cfecb9358" (UID: "6fb05c4c-c520-4402-bd80-2f1cfecb9358"). InnerVolumeSpecName "kube-api-access-lhvm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:06:17.465069 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:17.465027    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fb05c4c-c520-4402-bd80-2f1cfecb9358-util" (OuterVolumeSpecName: "util") pod "6fb05c4c-c520-4402-bd80-2f1cfecb9358" (UID: "6fb05c4c-c520-4402-bd80-2f1cfecb9358"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:06:17.474933 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:17.474905    2533 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fb05c4c-c520-4402-bd80-2f1cfecb9358-bundle\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:06:17.475046 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:17.474935    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhvm2\" (UniqueName: \"kubernetes.io/projected/6fb05c4c-c520-4402-bd80-2f1cfecb9358-kube-api-access-lhvm2\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:06:17.475046 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:17.474947    2533 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fb05c4c-c520-4402-bd80-2f1cfecb9358-util\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:06:18.158549 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:18.158520    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm"
Aug 05 19:06:18.158549 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:18.158530    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af728tm" event={"ID":"6fb05c4c-c520-4402-bd80-2f1cfecb9358","Type":"ContainerDied","Data":"587a9e777632672c68ab0b7ce602272111de1938b319e7c3bd295b33dec92f3e"}
Aug 05 19:06:18.158747 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:18.158576    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="587a9e777632672c68ab0b7ce602272111de1938b319e7c3bd295b33dec92f3e"
Aug 05 19:06:22.323740 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.323697    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"]
Aug 05 19:06:22.324239 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.324143    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb05c4c-c520-4402-bd80-2f1cfecb9358" containerName="extract"
Aug 05 19:06:22.324239 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.324161    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb05c4c-c520-4402-bd80-2f1cfecb9358" containerName="extract"
Aug 05 19:06:22.324239 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.324174    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb05c4c-c520-4402-bd80-2f1cfecb9358" containerName="util"
Aug 05 19:06:22.324239 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.324182    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb05c4c-c520-4402-bd80-2f1cfecb9358" containerName="util"
Aug 05 19:06:22.324239 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.324200    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb05c4c-c520-4402-bd80-2f1cfecb9358" containerName="pull"
Aug 05 19:06:22.324239 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.324207    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb05c4c-c520-4402-bd80-2f1cfecb9358" containerName="pull"
Aug 05 19:06:22.324542 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.324282    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fb05c4c-c520-4402-bd80-2f1cfecb9358" containerName="extract"
Aug 05 19:06:22.326196 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.326175    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.329079 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.329055    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2m22n\""
Aug 05 19:06:22.329210 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.329119    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 05 19:06:22.329210 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.329161    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 05 19:06:22.329210 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.329180    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 05 19:06:22.329210 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.329061    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 05 19:06:22.329424 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.329124    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 05 19:06:22.342618 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.342593    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"]
Aug 05 19:06:22.416943 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.416904    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/75876958-8bc3-4a56-9483-1d058a7271a5-metrics-cert\") pod \"lws-controller-manager-5bf99ddcb-pwwkp\" (UID: \"75876958-8bc3-4a56-9483-1d058a7271a5\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.417156 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.416959    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkb5p\" (UniqueName: \"kubernetes.io/projected/75876958-8bc3-4a56-9483-1d058a7271a5-kube-api-access-vkb5p\") pod \"lws-controller-manager-5bf99ddcb-pwwkp\" (UID: \"75876958-8bc3-4a56-9483-1d058a7271a5\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.417156 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.417032    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/75876958-8bc3-4a56-9483-1d058a7271a5-manager-config\") pod \"lws-controller-manager-5bf99ddcb-pwwkp\" (UID: \"75876958-8bc3-4a56-9483-1d058a7271a5\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.417156 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.417074    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75876958-8bc3-4a56-9483-1d058a7271a5-cert\") pod \"lws-controller-manager-5bf99ddcb-pwwkp\" (UID: \"75876958-8bc3-4a56-9483-1d058a7271a5\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.518346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.518294    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/75876958-8bc3-4a56-9483-1d058a7271a5-metrics-cert\") pod \"lws-controller-manager-5bf99ddcb-pwwkp\" (UID: \"75876958-8bc3-4a56-9483-1d058a7271a5\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.518522 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.518364    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkb5p\" (UniqueName: \"kubernetes.io/projected/75876958-8bc3-4a56-9483-1d058a7271a5-kube-api-access-vkb5p\") pod \"lws-controller-manager-5bf99ddcb-pwwkp\" (UID: \"75876958-8bc3-4a56-9483-1d058a7271a5\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.518522 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.518393    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/75876958-8bc3-4a56-9483-1d058a7271a5-manager-config\") pod \"lws-controller-manager-5bf99ddcb-pwwkp\" (UID: \"75876958-8bc3-4a56-9483-1d058a7271a5\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.518522 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.518410    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75876958-8bc3-4a56-9483-1d058a7271a5-cert\") pod \"lws-controller-manager-5bf99ddcb-pwwkp\" (UID: \"75876958-8bc3-4a56-9483-1d058a7271a5\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.519214 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.519189    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/75876958-8bc3-4a56-9483-1d058a7271a5-manager-config\") pod \"lws-controller-manager-5bf99ddcb-pwwkp\" (UID: \"75876958-8bc3-4a56-9483-1d058a7271a5\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.520784 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.520763    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/75876958-8bc3-4a56-9483-1d058a7271a5-metrics-cert\") pod \"lws-controller-manager-5bf99ddcb-pwwkp\" (UID: \"75876958-8bc3-4a56-9483-1d058a7271a5\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.520951 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.520931    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75876958-8bc3-4a56-9483-1d058a7271a5-cert\") pod \"lws-controller-manager-5bf99ddcb-pwwkp\" (UID: \"75876958-8bc3-4a56-9483-1d058a7271a5\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.526123 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.526096    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkb5p\" (UniqueName: \"kubernetes.io/projected/75876958-8bc3-4a56-9483-1d058a7271a5-kube-api-access-vkb5p\") pod \"lws-controller-manager-5bf99ddcb-pwwkp\" (UID: \"75876958-8bc3-4a56-9483-1d058a7271a5\") " pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.635435 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.635338    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:22.793282 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:22.793253    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"]
Aug 05 19:06:22.796101 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:06:22.796059    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75876958_8bc3_4a56_9483_1d058a7271a5.slice/crio-498a0672e9e971e31a10edd295205bc3c629cc6a2d20c46a228f362c56d104dc WatchSource:0}: Error finding container 498a0672e9e971e31a10edd295205bc3c629cc6a2d20c46a228f362c56d104dc: Status 404 returned error can't find the container with id 498a0672e9e971e31a10edd295205bc3c629cc6a2d20c46a228f362c56d104dc
Aug 05 19:06:23.180280 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:23.180238    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp" event={"ID":"75876958-8bc3-4a56-9483-1d058a7271a5","Type":"ContainerStarted","Data":"498a0672e9e971e31a10edd295205bc3c629cc6a2d20c46a228f362c56d104dc"}
Aug 05 19:06:26.194137 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:26.194094    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp" event={"ID":"75876958-8bc3-4a56-9483-1d058a7271a5","Type":"ContainerStarted","Data":"fe19b6ebe69f4f83e56acb304523dc8e6da3569c68de5cca346ae967550fde71"}
Aug 05 19:06:26.194547 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:26.194236    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:26.212322 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:26.212255    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp" podStartSLOduration=1.343465857 podStartE2EDuration="4.212231405s" totalImagesPullingTime="2.868765548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:06:26.209791435 +0000 UTC m=+287.699726509" watchObservedRunningTime="2026-08-05 19:06:26.212231405 +0000 UTC m=+287.702166471"
Aug 05 19:06:29.263660 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.263630    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"]
Aug 05 19:06:29.266134 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.266110    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.268604 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.268575    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 05 19:06:29.268739 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.268584    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 05 19:06:29.268877 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.268861    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 05 19:06:29.269106 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.269092    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rp8sm\""
Aug 05 19:06:29.272538 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.272517    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 05 19:06:29.294869 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.294829    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"]
Aug 05 19:06:29.379370 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.379336    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr42l\" (UniqueName: \"kubernetes.io/projected/61e6786c-fff5-44c2-a9c0-b38ce08f5670-kube-api-access-dr42l\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.379370 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.379377    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/61e6786c-fff5-44c2-a9c0-b38ce08f5670-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.379604 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.379435    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61e6786c-fff5-44c2-a9c0-b38ce08f5670-webhook-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.379604 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.379453    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61e6786c-fff5-44c2-a9c0-b38ce08f5670-tmp\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.379604 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.379472    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/61e6786c-fff5-44c2-a9c0-b38ce08f5670-manifests\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.480639 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.480585    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/61e6786c-fff5-44c2-a9c0-b38ce08f5670-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.480849 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.480685    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61e6786c-fff5-44c2-a9c0-b38ce08f5670-webhook-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.480849 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.480708    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61e6786c-fff5-44c2-a9c0-b38ce08f5670-tmp\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.480849 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.480726    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/61e6786c-fff5-44c2-a9c0-b38ce08f5670-manifests\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.480849 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.480790    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr42l\" (UniqueName: \"kubernetes.io/projected/61e6786c-fff5-44c2-a9c0-b38ce08f5670-kube-api-access-dr42l\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.481210 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.481183    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/61e6786c-fff5-44c2-a9c0-b38ce08f5670-manifests\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.483217 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.483187    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61e6786c-fff5-44c2-a9c0-b38ce08f5670-tmp\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.483315 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.483249    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/61e6786c-fff5-44c2-a9c0-b38ce08f5670-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.483396 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.483372    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61e6786c-fff5-44c2-a9c0-b38ce08f5670-webhook-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.489593 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.489566    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr42l\" (UniqueName: \"kubernetes.io/projected/61e6786c-fff5-44c2-a9c0-b38ce08f5670-kube-api-access-dr42l\") pod \"opendatahub-operator-controller-manager-74df9bd579-926tr\" (UID: \"61e6786c-fff5-44c2-a9c0-b38ce08f5670\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.577229 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.577136    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:29.714204 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:29.714162    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"]
Aug 05 19:06:29.716377 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:06:29.716347    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e6786c_fff5_44c2_a9c0_b38ce08f5670.slice/crio-99cdebc28d18f8d1e8fa54a1c2ee1efb819bab405b0aa698199e2c3f0aebbdc5 WatchSource:0}: Error finding container 99cdebc28d18f8d1e8fa54a1c2ee1efb819bab405b0aa698199e2c3f0aebbdc5: Status 404 returned error can't find the container with id 99cdebc28d18f8d1e8fa54a1c2ee1efb819bab405b0aa698199e2c3f0aebbdc5
Aug 05 19:06:30.212973 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:30.212936    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr" event={"ID":"61e6786c-fff5-44c2-a9c0-b38ce08f5670","Type":"ContainerStarted","Data":"99cdebc28d18f8d1e8fa54a1c2ee1efb819bab405b0aa698199e2c3f0aebbdc5"}
Aug 05 19:06:33.229449 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:33.229411    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr" event={"ID":"61e6786c-fff5-44c2-a9c0-b38ce08f5670","Type":"ContainerStarted","Data":"ccfcf7933ce1ade07bb4c99bc622bfdab0cb85e5d8dc6d1e108b9dd247258218"}
Aug 05 19:06:34.235848 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:34.235810    2533 generic.go:356] "Generic (PLEG): container finished" podID="61e6786c-fff5-44c2-a9c0-b38ce08f5670" containerID="ccfcf7933ce1ade07bb4c99bc622bfdab0cb85e5d8dc6d1e108b9dd247258218" exitCode=0
Aug 05 19:06:34.236292 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:34.235858    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr" event={"ID":"61e6786c-fff5-44c2-a9c0-b38ce08f5670","Type":"ContainerDied","Data":"ccfcf7933ce1ade07bb4c99bc622bfdab0cb85e5d8dc6d1e108b9dd247258218"}
Aug 05 19:06:35.242661 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:35.242627    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr" event={"ID":"61e6786c-fff5-44c2-a9c0-b38ce08f5670","Type":"ContainerStarted","Data":"e044ebe88e6e20d18d624805f1eda45c12a407006bc2378338ee1208d8a5dcfe"}
Aug 05 19:06:35.243097 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:35.242737    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:06:35.263042 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:35.262947    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr" podStartSLOduration=1.988799122 podStartE2EDuration="6.26292952s" totalImagesPullingTime="3.266168302s" totalInitContainerRuntime="1.007962096s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:06:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:06:35.262587044 +0000 UTC m=+296.752522163" watchObservedRunningTime="2026-08-05 19:06:35.26292952 +0000 UTC m=+296.752864594"
Aug 05 19:06:37.201124 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:37.201093    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5bf99ddcb-pwwkp"
Aug 05 19:06:38.877470 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:38.877444    2533 kubelet.go:1648] "Image garbage collection succeeded"
Aug 05 19:06:46.250864 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:06:46.250829    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-926tr"
Aug 05 19:07:01.410152 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.410116    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"]
Aug 05 19:07:01.412298 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.412275    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.417006 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.416963    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 05 19:07:01.417006 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.416972    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 05 19:07:01.417238 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.417113    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 05 19:07:01.418040 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.418014    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 05 19:07:01.418176 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.418025    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 05 19:07:01.418176 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.418061    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 05 19:07:01.421241 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.421221    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-x9n5t\""
Aug 05 19:07:01.446075 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.446041    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"]
Aug 05 19:07:01.536382 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.536332    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9af40b4-2069-4de0-988d-f040cd08782e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.536382 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.536379    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9af40b4-2069-4de0-988d-f040cd08782e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.536602 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.536399    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9af40b4-2069-4de0-988d-f040cd08782e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.536602 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.536479    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9af40b4-2069-4de0-988d-f040cd08782e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.536602 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.536562    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcqkc\" (UniqueName: \"kubernetes.io/projected/b9af40b4-2069-4de0-988d-f040cd08782e-kube-api-access-wcqkc\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.536699 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.536602    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9af40b4-2069-4de0-988d-f040cd08782e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.536699 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.536622    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9af40b4-2069-4de0-988d-f040cd08782e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.637871 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.637822    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9af40b4-2069-4de0-988d-f040cd08782e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.637871 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.637875    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9af40b4-2069-4de0-988d-f040cd08782e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.637871 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.637893    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9af40b4-2069-4de0-988d-f040cd08782e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.638181 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.638057    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcqkc\" (UniqueName: \"kubernetes.io/projected/b9af40b4-2069-4de0-988d-f040cd08782e-kube-api-access-wcqkc\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.638181 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.638123    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9af40b4-2069-4de0-988d-f040cd08782e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.638313 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.638291    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9af40b4-2069-4de0-988d-f040cd08782e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.638426 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.638410    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9af40b4-2069-4de0-988d-f040cd08782e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.639070 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.639042    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9af40b4-2069-4de0-988d-f040cd08782e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.640409 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.640382    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9af40b4-2069-4de0-988d-f040cd08782e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.640517 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.640443    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9af40b4-2069-4de0-988d-f040cd08782e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.640693 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.640676    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9af40b4-2069-4de0-988d-f040cd08782e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.640806 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.640785    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9af40b4-2069-4de0-988d-f040cd08782e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.646554 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.646532    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcqkc\" (UniqueName: \"kubernetes.io/projected/b9af40b4-2069-4de0-988d-f040cd08782e-kube-api-access-wcqkc\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.646657 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.646635    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9af40b4-2069-4de0-988d-f040cd08782e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8pcdv\" (UID: \"b9af40b4-2069-4de0-988d-f040cd08782e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.722433 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.722403    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:01.867578 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.867546    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"]
Aug 05 19:07:01.868810 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:07:01.868786    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9af40b4_2069_4de0_988d_f040cd08782e.slice/crio-a359d7f1a5bf7002bd891f6d7473f214cf6dabefe7a670dad3a92b2ad8c23658 WatchSource:0}: Error finding container a359d7f1a5bf7002bd891f6d7473f214cf6dabefe7a670dad3a92b2ad8c23658: Status 404 returned error can't find the container with id a359d7f1a5bf7002bd891f6d7473f214cf6dabefe7a670dad3a92b2ad8c23658
Aug 05 19:07:01.870976 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:01.870959    2533 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 19:07:02.363662 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:02.363625    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv" event={"ID":"b9af40b4-2069-4de0-988d-f040cd08782e","Type":"ContainerStarted","Data":"a359d7f1a5bf7002bd891f6d7473f214cf6dabefe7a670dad3a92b2ad8c23658"}
Aug 05 19:07:04.706668 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:04.706626    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:07:04.706945 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:04.706698    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:07:05.380552 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:05.380518    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv" event={"ID":"b9af40b4-2069-4de0-988d-f040cd08782e","Type":"ContainerStarted","Data":"d417c6d589bb8b857f0c59015e1131d09dd7fb501b9ab708a49ebabd2848fbdd"}
Aug 05 19:07:05.380769 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:05.380692    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:05.382420 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:05.382394    2533 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-8pcdv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 19:07:05.382528 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:05.382451    2533 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv" podUID="b9af40b4-2069-4de0-988d-f040cd08782e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 19:07:05.401908 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:05.401855    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv" podStartSLOduration=1.566656333 podStartE2EDuration="4.401838605s" totalImagesPullingTime="2.835182272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:07:05.401244293 +0000 UTC m=+326.891179389" watchObservedRunningTime="2026-08-05 19:07:05.401838605 +0000 UTC m=+326.891773679"
Aug 05 19:07:06.385371 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:06.385345    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8pcdv"
Aug 05 19:07:52.910361 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.910279    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"]
Aug 05 19:07:52.916008 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.915966    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"
Aug 05 19:07:52.918171 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.918149    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 19:07:52.918292 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.918149    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 19:07:52.918829 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.918816    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k7vqm\""
Aug 05 19:07:52.924854 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.924828    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"]
Aug 05 19:07:52.944893 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.944863    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"]
Aug 05 19:07:52.947309 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.947289    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"
Aug 05 19:07:52.956387 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.956364    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"]
Aug 05 19:07:52.975262 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.975230    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7tzb\" (UniqueName: \"kubernetes.io/projected/557bd99f-5364-47a8-9418-6dc2e456b928-kube-api-access-c7tzb\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl\" (UID: \"557bd99f-5364-47a8-9418-6dc2e456b928\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"
Aug 05 19:07:52.975413 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.975278    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc19acdc-999c-4005-8a1f-b16e5bac6381-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92\" (UID: \"cc19acdc-999c-4005-8a1f-b16e5bac6381\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"
Aug 05 19:07:52.975413 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.975342    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/557bd99f-5364-47a8-9418-6dc2e456b928-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl\" (UID: \"557bd99f-5364-47a8-9418-6dc2e456b928\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"
Aug 05 19:07:52.975486 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.975423    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtzln\" (UniqueName: \"kubernetes.io/projected/cc19acdc-999c-4005-8a1f-b16e5bac6381-kube-api-access-vtzln\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92\" (UID: \"cc19acdc-999c-4005-8a1f-b16e5bac6381\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"
Aug 05 19:07:52.975486 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.975449    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc19acdc-999c-4005-8a1f-b16e5bac6381-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92\" (UID: \"cc19acdc-999c-4005-8a1f-b16e5bac6381\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"
Aug 05 19:07:52.975486 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:52.975466    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/557bd99f-5364-47a8-9418-6dc2e456b928-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl\" (UID: \"557bd99f-5364-47a8-9418-6dc2e456b928\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"
Aug 05 19:07:53.030226 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.030189    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"]
Aug 05 19:07:53.032800 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.032782    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"
Aug 05 19:07:53.041220 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.041193    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"]
Aug 05 19:07:53.075908 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.075866    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc19acdc-999c-4005-8a1f-b16e5bac6381-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92\" (UID: \"cc19acdc-999c-4005-8a1f-b16e5bac6381\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"
Aug 05 19:07:53.075908 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.075915    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/557bd99f-5364-47a8-9418-6dc2e456b928-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl\" (UID: \"557bd99f-5364-47a8-9418-6dc2e456b928\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"
Aug 05 19:07:53.076200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.075958    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtzln\" (UniqueName: \"kubernetes.io/projected/cc19acdc-999c-4005-8a1f-b16e5bac6381-kube-api-access-vtzln\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92\" (UID: \"cc19acdc-999c-4005-8a1f-b16e5bac6381\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"
Aug 05 19:07:53.076200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.075978    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc19acdc-999c-4005-8a1f-b16e5bac6381-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92\" (UID: \"cc19acdc-999c-4005-8a1f-b16e5bac6381\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"
Aug 05 19:07:53.076200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.076027    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/557bd99f-5364-47a8-9418-6dc2e456b928-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl\" (UID: \"557bd99f-5364-47a8-9418-6dc2e456b928\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"
Aug 05 19:07:53.076200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.076047    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c768c12-aeb0-4adc-8bc3-039dfdedb450-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k\" (UID: \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"
Aug 05 19:07:53.076200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.076070    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c768c12-aeb0-4adc-8bc3-039dfdedb450-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k\" (UID: \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"
Aug 05 19:07:53.076200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.076094    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxb89\" (UniqueName: \"kubernetes.io/projected/0c768c12-aeb0-4adc-8bc3-039dfdedb450-kube-api-access-mxb89\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k\" (UID: \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"
Aug 05 19:07:53.076200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.076159    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7tzb\" (UniqueName: \"kubernetes.io/projected/557bd99f-5364-47a8-9418-6dc2e456b928-kube-api-access-c7tzb\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl\" (UID: \"557bd99f-5364-47a8-9418-6dc2e456b928\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"
Aug 05 19:07:53.076519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.076377    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc19acdc-999c-4005-8a1f-b16e5bac6381-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92\" (UID: \"cc19acdc-999c-4005-8a1f-b16e5bac6381\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"
Aug 05 19:07:53.076519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.076398    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/557bd99f-5364-47a8-9418-6dc2e456b928-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl\" (UID: \"557bd99f-5364-47a8-9418-6dc2e456b928\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"
Aug 05 19:07:53.076519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.076405    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc19acdc-999c-4005-8a1f-b16e5bac6381-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92\" (UID: \"cc19acdc-999c-4005-8a1f-b16e5bac6381\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"
Aug 05 19:07:53.076519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.076432    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/557bd99f-5364-47a8-9418-6dc2e456b928-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl\" (UID: \"557bd99f-5364-47a8-9418-6dc2e456b928\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"
Aug 05 19:07:53.083860 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.083833    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtzln\" (UniqueName: \"kubernetes.io/projected/cc19acdc-999c-4005-8a1f-b16e5bac6381-kube-api-access-vtzln\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92\" (UID: \"cc19acdc-999c-4005-8a1f-b16e5bac6381\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"
Aug 05 19:07:53.083974 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.083858    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7tzb\" (UniqueName: \"kubernetes.io/projected/557bd99f-5364-47a8-9418-6dc2e456b928-kube-api-access-c7tzb\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl\" (UID: \"557bd99f-5364-47a8-9418-6dc2e456b928\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"
Aug 05 19:07:53.133573 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.133534    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"]
Aug 05 19:07:53.136100 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.136076    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"
Aug 05 19:07:53.145400 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.145374    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"]
Aug 05 19:07:53.177021 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.176968    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/764c6ad6-de27-4607-9dd8-09f5b842fbcc-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt\" (UID: \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"
Aug 05 19:07:53.177191 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.177053    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/764c6ad6-de27-4607-9dd8-09f5b842fbcc-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt\" (UID: \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"
Aug 05 19:07:53.177191 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.177094    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpssf\" (UniqueName: \"kubernetes.io/projected/764c6ad6-de27-4607-9dd8-09f5b842fbcc-kube-api-access-kpssf\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt\" (UID: \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"
Aug 05 19:07:53.177191 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.177122    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c768c12-aeb0-4adc-8bc3-039dfdedb450-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k\" (UID: \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"
Aug 05 19:07:53.177191 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.177164    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c768c12-aeb0-4adc-8bc3-039dfdedb450-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k\" (UID: \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"
Aug 05 19:07:53.177320 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.177192    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxb89\" (UniqueName: \"kubernetes.io/projected/0c768c12-aeb0-4adc-8bc3-039dfdedb450-kube-api-access-mxb89\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k\" (UID: \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"
Aug 05 19:07:53.177520 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.177500    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c768c12-aeb0-4adc-8bc3-039dfdedb450-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k\" (UID: \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"
Aug 05 19:07:53.177555 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.177517    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c768c12-aeb0-4adc-8bc3-039dfdedb450-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k\" (UID: \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"
Aug 05 19:07:53.185506 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.185469    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxb89\" (UniqueName: \"kubernetes.io/projected/0c768c12-aeb0-4adc-8bc3-039dfdedb450-kube-api-access-mxb89\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k\" (UID: \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"
Aug 05 19:07:53.233084 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.233044    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"
Aug 05 19:07:53.257192 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.257163    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"
Aug 05 19:07:53.278564 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.278527    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/764c6ad6-de27-4607-9dd8-09f5b842fbcc-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt\" (UID: \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"
Aug 05 19:07:53.278733 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.278583    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/764c6ad6-de27-4607-9dd8-09f5b842fbcc-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt\" (UID: \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"
Aug 05 19:07:53.278733 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.278640    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpssf\" (UniqueName: \"kubernetes.io/projected/764c6ad6-de27-4607-9dd8-09f5b842fbcc-kube-api-access-kpssf\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt\" (UID: \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"
Aug 05 19:07:53.279031 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.278975    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/764c6ad6-de27-4607-9dd8-09f5b842fbcc-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt\" (UID: \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"
Aug 05 19:07:53.279178 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.279052    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/764c6ad6-de27-4607-9dd8-09f5b842fbcc-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt\" (UID: \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"
Aug 05 19:07:53.287391 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.287334    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpssf\" (UniqueName: \"kubernetes.io/projected/764c6ad6-de27-4607-9dd8-09f5b842fbcc-kube-api-access-kpssf\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt\" (UID: \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"
Aug 05 19:07:53.342510 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.342479    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"
Aug 05 19:07:53.385954 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.385910    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"]
Aug 05 19:07:53.390120 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:07:53.390092    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557bd99f_5364_47a8_9418_6dc2e456b928.slice/crio-520284b72bc6ce24dcdce09aeffb68b92c7d696a3133e9dbdf1ad8a8637ac643 WatchSource:0}: Error finding container 520284b72bc6ce24dcdce09aeffb68b92c7d696a3133e9dbdf1ad8a8637ac643: Status 404 returned error can't find the container with id 520284b72bc6ce24dcdce09aeffb68b92c7d696a3133e9dbdf1ad8a8637ac643
Aug 05 19:07:53.409189 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:07:53.409152    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc19acdc_999c_4005_8a1f_b16e5bac6381.slice/crio-98edb9b1f7936050fe06031bb46827749a70c70f35b569cf3ca86a89b17b20da WatchSource:0}: Error finding container 98edb9b1f7936050fe06031bb46827749a70c70f35b569cf3ca86a89b17b20da: Status 404 returned error can't find the container with id 98edb9b1f7936050fe06031bb46827749a70c70f35b569cf3ca86a89b17b20da
Aug 05 19:07:53.409585 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.409559    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"]
Aug 05 19:07:53.446635 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.446608    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"
Aug 05 19:07:53.496462 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.496419    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"]
Aug 05 19:07:53.498008 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:07:53.497958    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c768c12_aeb0_4adc_8bc3_039dfdedb450.slice/crio-a3720997f01fc9cb677b9f9bf3b664a4cb63603343b7f162f30ff6f6f4236600 WatchSource:0}: Error finding container a3720997f01fc9cb677b9f9bf3b664a4cb63603343b7f162f30ff6f6f4236600: Status 404 returned error can't find the container with id a3720997f01fc9cb677b9f9bf3b664a4cb63603343b7f162f30ff6f6f4236600
Aug 05 19:07:53.592435 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.592409    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"]
Aug 05 19:07:53.599939 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.599907    2533 generic.go:356] "Generic (PLEG): container finished" podID="cc19acdc-999c-4005-8a1f-b16e5bac6381" containerID="f263eff3c8f07b2d9c9a2fe66d1c2d00727c8b2c95a796b194f22862353398ce" exitCode=0
Aug 05 19:07:53.600110 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.600030    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92" event={"ID":"cc19acdc-999c-4005-8a1f-b16e5bac6381","Type":"ContainerDied","Data":"f263eff3c8f07b2d9c9a2fe66d1c2d00727c8b2c95a796b194f22862353398ce"}
Aug 05 19:07:53.600110 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.600083    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92" event={"ID":"cc19acdc-999c-4005-8a1f-b16e5bac6381","Type":"ContainerStarted","Data":"98edb9b1f7936050fe06031bb46827749a70c70f35b569cf3ca86a89b17b20da"}
Aug 05 19:07:53.601832 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.601724    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k" event={"ID":"0c768c12-aeb0-4adc-8bc3-039dfdedb450","Type":"ContainerStarted","Data":"a3720997f01fc9cb677b9f9bf3b664a4cb63603343b7f162f30ff6f6f4236600"}
Aug 05 19:07:53.603318 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.603291    2533 generic.go:356] "Generic (PLEG): container finished" podID="557bd99f-5364-47a8-9418-6dc2e456b928" containerID="3302b6baf21837ee47e50ff249772ff328c82a37aa0e93b90e28c9e92025b90d" exitCode=0
Aug 05 19:07:53.603440 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.603369    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl" event={"ID":"557bd99f-5364-47a8-9418-6dc2e456b928","Type":"ContainerDied","Data":"3302b6baf21837ee47e50ff249772ff328c82a37aa0e93b90e28c9e92025b90d"}
Aug 05 19:07:53.603440 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:53.603415    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl" event={"ID":"557bd99f-5364-47a8-9418-6dc2e456b928","Type":"ContainerStarted","Data":"520284b72bc6ce24dcdce09aeffb68b92c7d696a3133e9dbdf1ad8a8637ac643"}
Aug 05 19:07:53.614168 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:07:53.614137    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764c6ad6_de27_4607_9dd8_09f5b842fbcc.slice/crio-a02e711c56d82f23a17ea0f7b34c8282ef28b052bfa87cf731bf1bf2eda3c977 WatchSource:0}: Error finding container a02e711c56d82f23a17ea0f7b34c8282ef28b052bfa87cf731bf1bf2eda3c977: Status 404 returned error can't find the container with id a02e711c56d82f23a17ea0f7b34c8282ef28b052bfa87cf731bf1bf2eda3c977
Aug 05 19:07:54.611455 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:54.611419    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92" event={"ID":"cc19acdc-999c-4005-8a1f-b16e5bac6381","Type":"ContainerStarted","Data":"bf54aed8170ae0e15216f0d84395b9d68c9eecd6e114bdbbdfa375f77418d733"}
Aug 05 19:07:54.613111 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:54.613082    2533 generic.go:356] "Generic (PLEG): container finished" podID="0c768c12-aeb0-4adc-8bc3-039dfdedb450" containerID="8a0e62e4531ad37ba6599932feb97ed5f1ebb6b253376a47bf86bc4d6f7431dc" exitCode=0
Aug 05 19:07:54.613262 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:54.613167    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k" event={"ID":"0c768c12-aeb0-4adc-8bc3-039dfdedb450","Type":"ContainerDied","Data":"8a0e62e4531ad37ba6599932feb97ed5f1ebb6b253376a47bf86bc4d6f7431dc"}
Aug 05 19:07:54.615065 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:54.614919    2533 generic.go:356] "Generic (PLEG): container finished" podID="764c6ad6-de27-4607-9dd8-09f5b842fbcc" containerID="3af89712edabd1a96f026c79673933e05a6c84e20815faed77b8878d6e2298af" exitCode=0
Aug 05 19:07:54.615065 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:54.615024    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt" event={"ID":"764c6ad6-de27-4607-9dd8-09f5b842fbcc","Type":"ContainerDied","Data":"3af89712edabd1a96f026c79673933e05a6c84e20815faed77b8878d6e2298af"}
Aug 05 19:07:54.615065 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:54.615062    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt" event={"ID":"764c6ad6-de27-4607-9dd8-09f5b842fbcc","Type":"ContainerStarted","Data":"a02e711c56d82f23a17ea0f7b34c8282ef28b052bfa87cf731bf1bf2eda3c977"}
Aug 05 19:07:55.627562 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:55.627527    2533 generic.go:356] "Generic (PLEG): container finished" podID="cc19acdc-999c-4005-8a1f-b16e5bac6381" containerID="bf54aed8170ae0e15216f0d84395b9d68c9eecd6e114bdbbdfa375f77418d733" exitCode=0
Aug 05 19:07:55.628012 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:55.627611    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92" event={"ID":"cc19acdc-999c-4005-8a1f-b16e5bac6381","Type":"ContainerDied","Data":"bf54aed8170ae0e15216f0d84395b9d68c9eecd6e114bdbbdfa375f77418d733"}
Aug 05 19:07:55.629607 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:55.629585    2533 generic.go:356] "Generic (PLEG): container finished" podID="764c6ad6-de27-4607-9dd8-09f5b842fbcc" containerID="b4f0522f02eaa724c0d6dde7389fd7d78e32d90b06c875b168d3576c37634f8b" exitCode=0
Aug 05 19:07:55.629699 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:55.629664    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt" event={"ID":"764c6ad6-de27-4607-9dd8-09f5b842fbcc","Type":"ContainerDied","Data":"b4f0522f02eaa724c0d6dde7389fd7d78e32d90b06c875b168d3576c37634f8b"}
Aug 05 19:07:55.631706 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:55.631683    2533 generic.go:356] "Generic (PLEG): container finished" podID="557bd99f-5364-47a8-9418-6dc2e456b928" containerID="2fed2b2584b44ec9a37fc834bdd29c8d811194de7914b0eb10e3b0294740b8c3" exitCode=0
Aug 05 19:07:55.631772 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:55.631755    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl" event={"ID":"557bd99f-5364-47a8-9418-6dc2e456b928","Type":"ContainerDied","Data":"2fed2b2584b44ec9a37fc834bdd29c8d811194de7914b0eb10e3b0294740b8c3"}
Aug 05 19:07:56.638916 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:56.638834    2533 generic.go:356] "Generic (PLEG): container finished" podID="cc19acdc-999c-4005-8a1f-b16e5bac6381" containerID="92c0d1164c81b7468a458fd3bdceb5f084db173ad6e0611b0ae811923be61535" exitCode=0
Aug 05 19:07:56.639394 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:56.638920    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92" event={"ID":"cc19acdc-999c-4005-8a1f-b16e5bac6381","Type":"ContainerDied","Data":"92c0d1164c81b7468a458fd3bdceb5f084db173ad6e0611b0ae811923be61535"}
Aug 05 19:07:56.640867 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:56.640845    2533 generic.go:356] "Generic (PLEG): container finished" podID="764c6ad6-de27-4607-9dd8-09f5b842fbcc" containerID="3a7aec56fe14559083d8924d35305190b46eeafcbb8997712863632c030e15e8" exitCode=0
Aug 05 19:07:56.640940 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:56.640927    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt" event={"ID":"764c6ad6-de27-4607-9dd8-09f5b842fbcc","Type":"ContainerDied","Data":"3a7aec56fe14559083d8924d35305190b46eeafcbb8997712863632c030e15e8"}
Aug 05 19:07:56.642956 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:56.642937    2533 generic.go:356] "Generic (PLEG): container finished" podID="557bd99f-5364-47a8-9418-6dc2e456b928" containerID="af51ac8719a610c2dded6cd1b8abe68b64db0e8a1e2c6955114121ada1d494b4" exitCode=0
Aug 05 19:07:56.643081 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:56.643024    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl" event={"ID":"557bd99f-5364-47a8-9418-6dc2e456b928","Type":"ContainerDied","Data":"af51ac8719a610c2dded6cd1b8abe68b64db0e8a1e2c6955114121ada1d494b4"}
Aug 05 19:07:57.821795 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.821769    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"
Aug 05 19:07:57.825077 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.825052    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"
Aug 05 19:07:57.828811 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.828791    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"
Aug 05 19:07:57.918896 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.918811    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/557bd99f-5364-47a8-9418-6dc2e456b928-bundle\") pod \"557bd99f-5364-47a8-9418-6dc2e456b928\" (UID: \"557bd99f-5364-47a8-9418-6dc2e456b928\") "
Aug 05 19:07:57.918896 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.918855    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc19acdc-999c-4005-8a1f-b16e5bac6381-bundle\") pod \"cc19acdc-999c-4005-8a1f-b16e5bac6381\" (UID: \"cc19acdc-999c-4005-8a1f-b16e5bac6381\") "
Aug 05 19:07:57.918896 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.918878    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/557bd99f-5364-47a8-9418-6dc2e456b928-util\") pod \"557bd99f-5364-47a8-9418-6dc2e456b928\" (UID: \"557bd99f-5364-47a8-9418-6dc2e456b928\") "
Aug 05 19:07:57.918896 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.918895    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/764c6ad6-de27-4607-9dd8-09f5b842fbcc-util\") pod \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\" (UID: \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\") "
Aug 05 19:07:57.919254 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.918916    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/764c6ad6-de27-4607-9dd8-09f5b842fbcc-bundle\") pod \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\" (UID: \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\") "
Aug 05 19:07:57.919254 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.918962    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc19acdc-999c-4005-8a1f-b16e5bac6381-util\") pod \"cc19acdc-999c-4005-8a1f-b16e5bac6381\" (UID: \"cc19acdc-999c-4005-8a1f-b16e5bac6381\") "
Aug 05 19:07:57.919254 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.918983    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpssf\" (UniqueName: \"kubernetes.io/projected/764c6ad6-de27-4607-9dd8-09f5b842fbcc-kube-api-access-kpssf\") pod \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\" (UID: \"764c6ad6-de27-4607-9dd8-09f5b842fbcc\") "
Aug 05 19:07:57.919254 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.919070    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7tzb\" (UniqueName: \"kubernetes.io/projected/557bd99f-5364-47a8-9418-6dc2e456b928-kube-api-access-c7tzb\") pod \"557bd99f-5364-47a8-9418-6dc2e456b928\" (UID: \"557bd99f-5364-47a8-9418-6dc2e456b928\") "
Aug 05 19:07:57.919254 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.919113    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtzln\" (UniqueName: \"kubernetes.io/projected/cc19acdc-999c-4005-8a1f-b16e5bac6381-kube-api-access-vtzln\") pod \"cc19acdc-999c-4005-8a1f-b16e5bac6381\" (UID: \"cc19acdc-999c-4005-8a1f-b16e5bac6381\") "
Aug 05 19:07:57.919681 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.919652    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/764c6ad6-de27-4607-9dd8-09f5b842fbcc-bundle" (OuterVolumeSpecName: "bundle") pod "764c6ad6-de27-4607-9dd8-09f5b842fbcc" (UID: "764c6ad6-de27-4607-9dd8-09f5b842fbcc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:07:57.919862 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.919838    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557bd99f-5364-47a8-9418-6dc2e456b928-bundle" (OuterVolumeSpecName: "bundle") pod "557bd99f-5364-47a8-9418-6dc2e456b928" (UID: "557bd99f-5364-47a8-9418-6dc2e456b928"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:07:57.920395 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.920353    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc19acdc-999c-4005-8a1f-b16e5bac6381-bundle" (OuterVolumeSpecName: "bundle") pod "cc19acdc-999c-4005-8a1f-b16e5bac6381" (UID: "cc19acdc-999c-4005-8a1f-b16e5bac6381"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:07:57.921593 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.921547    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/764c6ad6-de27-4607-9dd8-09f5b842fbcc-kube-api-access-kpssf" (OuterVolumeSpecName: "kube-api-access-kpssf") pod "764c6ad6-de27-4607-9dd8-09f5b842fbcc" (UID: "764c6ad6-de27-4607-9dd8-09f5b842fbcc"). InnerVolumeSpecName "kube-api-access-kpssf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:07:57.921691 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.921645    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc19acdc-999c-4005-8a1f-b16e5bac6381-kube-api-access-vtzln" (OuterVolumeSpecName: "kube-api-access-vtzln") pod "cc19acdc-999c-4005-8a1f-b16e5bac6381" (UID: "cc19acdc-999c-4005-8a1f-b16e5bac6381"). InnerVolumeSpecName "kube-api-access-vtzln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:07:57.921691 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.921653    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/557bd99f-5364-47a8-9418-6dc2e456b928-kube-api-access-c7tzb" (OuterVolumeSpecName: "kube-api-access-c7tzb") pod "557bd99f-5364-47a8-9418-6dc2e456b928" (UID: "557bd99f-5364-47a8-9418-6dc2e456b928"). InnerVolumeSpecName "kube-api-access-c7tzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:07:57.925379 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.925355    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557bd99f-5364-47a8-9418-6dc2e456b928-util" (OuterVolumeSpecName: "util") pod "557bd99f-5364-47a8-9418-6dc2e456b928" (UID: "557bd99f-5364-47a8-9418-6dc2e456b928"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:07:57.925462 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.925426    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/764c6ad6-de27-4607-9dd8-09f5b842fbcc-util" (OuterVolumeSpecName: "util") pod "764c6ad6-de27-4607-9dd8-09f5b842fbcc" (UID: "764c6ad6-de27-4607-9dd8-09f5b842fbcc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:07:57.926211 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:57.926187    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc19acdc-999c-4005-8a1f-b16e5bac6381-util" (OuterVolumeSpecName: "util") pod "cc19acdc-999c-4005-8a1f-b16e5bac6381" (UID: "cc19acdc-999c-4005-8a1f-b16e5bac6381"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:07:58.020381 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.020349    2533 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc19acdc-999c-4005-8a1f-b16e5bac6381-bundle\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:07:58.020381 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.020375    2533 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/557bd99f-5364-47a8-9418-6dc2e456b928-util\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:07:58.020381 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.020384    2533 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/764c6ad6-de27-4607-9dd8-09f5b842fbcc-util\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:07:58.020577 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.020393    2533 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/764c6ad6-de27-4607-9dd8-09f5b842fbcc-bundle\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:07:58.020577 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.020400    2533 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc19acdc-999c-4005-8a1f-b16e5bac6381-util\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:07:58.020577 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.020409    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpssf\" (UniqueName: \"kubernetes.io/projected/764c6ad6-de27-4607-9dd8-09f5b842fbcc-kube-api-access-kpssf\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:07:58.020577 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.020420    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7tzb\" (UniqueName: \"kubernetes.io/projected/557bd99f-5364-47a8-9418-6dc2e456b928-kube-api-access-c7tzb\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:07:58.020577 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.020430    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtzln\" (UniqueName: \"kubernetes.io/projected/cc19acdc-999c-4005-8a1f-b16e5bac6381-kube-api-access-vtzln\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:07:58.020577 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.020439    2533 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/557bd99f-5364-47a8-9418-6dc2e456b928-bundle\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:07:58.654819 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.654776    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92"
Aug 05 19:07:58.655016 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.654782    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a07nr92" event={"ID":"cc19acdc-999c-4005-8a1f-b16e5bac6381","Type":"ContainerDied","Data":"98edb9b1f7936050fe06031bb46827749a70c70f35b569cf3ca86a89b17b20da"}
Aug 05 19:07:58.655016 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.654905    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98edb9b1f7936050fe06031bb46827749a70c70f35b569cf3ca86a89b17b20da"
Aug 05 19:07:58.656812 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.656792    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt"
Aug 05 19:07:58.656928 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.656822    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb2tgjt" event={"ID":"764c6ad6-de27-4607-9dd8-09f5b842fbcc","Type":"ContainerDied","Data":"a02e711c56d82f23a17ea0f7b34c8282ef28b052bfa87cf731bf1bf2eda3c977"}
Aug 05 19:07:58.656928 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.656862    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a02e711c56d82f23a17ea0f7b34c8282ef28b052bfa87cf731bf1bf2eda3c977"
Aug 05 19:07:58.658704 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.658680    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl" event={"ID":"557bd99f-5364-47a8-9418-6dc2e456b928","Type":"ContainerDied","Data":"520284b72bc6ce24dcdce09aeffb68b92c7d696a3133e9dbdf1ad8a8637ac643"}
Aug 05 19:07:58.658803 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.658714    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870535fzdl"
Aug 05 19:07:58.658803 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:58.658719    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="520284b72bc6ce24dcdce09aeffb68b92c7d696a3133e9dbdf1ad8a8637ac643"
Aug 05 19:07:59.665065 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:59.665027    2533 generic.go:356] "Generic (PLEG): container finished" podID="0c768c12-aeb0-4adc-8bc3-039dfdedb450" containerID="c5f51bb180fc82030f0a60d08b7d1d4c35e1da55668322d6ab870997a3841b38" exitCode=0
Aug 05 19:07:59.665450 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:07:59.665113    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k" event={"ID":"0c768c12-aeb0-4adc-8bc3-039dfdedb450","Type":"ContainerDied","Data":"c5f51bb180fc82030f0a60d08b7d1d4c35e1da55668322d6ab870997a3841b38"}
Aug 05 19:08:00.672007 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:00.671953    2533 generic.go:356] "Generic (PLEG): container finished" podID="0c768c12-aeb0-4adc-8bc3-039dfdedb450" containerID="29724360e8fea3a4047b7b7497e40a291dd25890571460b646eb6e5a055fde39" exitCode=0
Aug 05 19:08:00.672356 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:00.672044    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k" event={"ID":"0c768c12-aeb0-4adc-8bc3-039dfdedb450","Type":"ContainerDied","Data":"29724360e8fea3a4047b7b7497e40a291dd25890571460b646eb6e5a055fde39"}
Aug 05 19:08:01.803453 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:01.803429    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"
Aug 05 19:08:01.853888 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:01.853845    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c768c12-aeb0-4adc-8bc3-039dfdedb450-bundle\") pod \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\" (UID: \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\") "
Aug 05 19:08:01.854067 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:01.854022    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxb89\" (UniqueName: \"kubernetes.io/projected/0c768c12-aeb0-4adc-8bc3-039dfdedb450-kube-api-access-mxb89\") pod \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\" (UID: \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\") "
Aug 05 19:08:01.854137 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:01.854076    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c768c12-aeb0-4adc-8bc3-039dfdedb450-util\") pod \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\" (UID: \"0c768c12-aeb0-4adc-8bc3-039dfdedb450\") "
Aug 05 19:08:01.854480 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:01.854452    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c768c12-aeb0-4adc-8bc3-039dfdedb450-bundle" (OuterVolumeSpecName: "bundle") pod "0c768c12-aeb0-4adc-8bc3-039dfdedb450" (UID: "0c768c12-aeb0-4adc-8bc3-039dfdedb450"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:08:01.856179 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:01.856152    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c768c12-aeb0-4adc-8bc3-039dfdedb450-kube-api-access-mxb89" (OuterVolumeSpecName: "kube-api-access-mxb89") pod "0c768c12-aeb0-4adc-8bc3-039dfdedb450" (UID: "0c768c12-aeb0-4adc-8bc3-039dfdedb450"). InnerVolumeSpecName "kube-api-access-mxb89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:08:01.860686 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:01.860657    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c768c12-aeb0-4adc-8bc3-039dfdedb450-util" (OuterVolumeSpecName: "util") pod "0c768c12-aeb0-4adc-8bc3-039dfdedb450" (UID: "0c768c12-aeb0-4adc-8bc3-039dfdedb450"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:08:01.955333 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:01.955233    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxb89\" (UniqueName: \"kubernetes.io/projected/0c768c12-aeb0-4adc-8bc3-039dfdedb450-kube-api-access-mxb89\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:08:01.955333 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:01.955274    2533 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c768c12-aeb0-4adc-8bc3-039dfdedb450-util\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:08:01.955333 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:01.955285    2533 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c768c12-aeb0-4adc-8bc3-039dfdedb450-bundle\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:08:02.683535 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:02.683492    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k" event={"ID":"0c768c12-aeb0-4adc-8bc3-039dfdedb450","Type":"ContainerDied","Data":"a3720997f01fc9cb677b9f9bf3b664a4cb63603343b7f162f30ff6f6f4236600"}
Aug 05 19:08:02.683535 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:02.683537    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9k69k"
Aug 05 19:08:02.683731 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:02.683549    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3720997f01fc9cb677b9f9bf3b664a4cb63603343b7f162f30ff6f6f4236600"
Aug 05 19:08:38.104196 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104156    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"]
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104483    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c768c12-aeb0-4adc-8bc3-039dfdedb450" containerName="util"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104497    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c768c12-aeb0-4adc-8bc3-039dfdedb450" containerName="util"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104508    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c768c12-aeb0-4adc-8bc3-039dfdedb450" containerName="pull"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104515    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c768c12-aeb0-4adc-8bc3-039dfdedb450" containerName="pull"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104522    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="557bd99f-5364-47a8-9418-6dc2e456b928" containerName="extract"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104528    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="557bd99f-5364-47a8-9418-6dc2e456b928" containerName="extract"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104538    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="764c6ad6-de27-4607-9dd8-09f5b842fbcc" containerName="extract"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104543    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="764c6ad6-de27-4607-9dd8-09f5b842fbcc" containerName="extract"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104550    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc19acdc-999c-4005-8a1f-b16e5bac6381" containerName="pull"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104558    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc19acdc-999c-4005-8a1f-b16e5bac6381" containerName="pull"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104571    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="764c6ad6-de27-4607-9dd8-09f5b842fbcc" containerName="util"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104577    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="764c6ad6-de27-4607-9dd8-09f5b842fbcc" containerName="util"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104584    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="557bd99f-5364-47a8-9418-6dc2e456b928" containerName="pull"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104589    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="557bd99f-5364-47a8-9418-6dc2e456b928" containerName="pull"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104595    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="557bd99f-5364-47a8-9418-6dc2e456b928" containerName="util"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104599    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="557bd99f-5364-47a8-9418-6dc2e456b928" containerName="util"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104607    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc19acdc-999c-4005-8a1f-b16e5bac6381" containerName="util"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104611    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc19acdc-999c-4005-8a1f-b16e5bac6381" containerName="util"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104617    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="764c6ad6-de27-4607-9dd8-09f5b842fbcc" containerName="pull"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104622    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="764c6ad6-de27-4607-9dd8-09f5b842fbcc" containerName="pull"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104628    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c768c12-aeb0-4adc-8bc3-039dfdedb450" containerName="extract"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104634    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c768c12-aeb0-4adc-8bc3-039dfdedb450" containerName="extract"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104644    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc19acdc-999c-4005-8a1f-b16e5bac6381" containerName="extract"
Aug 05 19:08:38.104676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104651    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc19acdc-999c-4005-8a1f-b16e5bac6381" containerName="extract"
Aug 05 19:08:38.105426 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104697    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c768c12-aeb0-4adc-8bc3-039dfdedb450" containerName="extract"
Aug 05 19:08:38.105426 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104705    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="764c6ad6-de27-4607-9dd8-09f5b842fbcc" containerName="extract"
Aug 05 19:08:38.105426 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104711    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc19acdc-999c-4005-8a1f-b16e5bac6381" containerName="extract"
Aug 05 19:08:38.105426 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.104720    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="557bd99f-5364-47a8-9418-6dc2e456b928" containerName="extract"
Aug 05 19:08:38.107753 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.107736    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"
Aug 05 19:08:38.110247 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.110225    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 05 19:08:38.110406 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.110309    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 05 19:08:38.110611 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.110594    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kfct5\""
Aug 05 19:08:38.122601 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.122574    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"]
Aug 05 19:08:38.167507 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.167458    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smwzz\" (UniqueName: \"kubernetes.io/projected/fc70a32a-525b-443c-8a32-0042e1cddcdc-kube-api-access-smwzz\") pod \"kuadrant-operator-controller-manager-96db98c47-ft595\" (UID: \"fc70a32a-525b-443c-8a32-0042e1cddcdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"
Aug 05 19:08:38.167686 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.167570    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc70a32a-525b-443c-8a32-0042e1cddcdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-ft595\" (UID: \"fc70a32a-525b-443c-8a32-0042e1cddcdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"
Aug 05 19:08:38.268773 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.268729    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc70a32a-525b-443c-8a32-0042e1cddcdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-ft595\" (UID: \"fc70a32a-525b-443c-8a32-0042e1cddcdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"
Aug 05 19:08:38.268950 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.268796    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smwzz\" (UniqueName: \"kubernetes.io/projected/fc70a32a-525b-443c-8a32-0042e1cddcdc-kube-api-access-smwzz\") pod \"kuadrant-operator-controller-manager-96db98c47-ft595\" (UID: \"fc70a32a-525b-443c-8a32-0042e1cddcdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"
Aug 05 19:08:38.269171 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.269150    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc70a32a-525b-443c-8a32-0042e1cddcdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-ft595\" (UID: \"fc70a32a-525b-443c-8a32-0042e1cddcdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"
Aug 05 19:08:38.277840 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.277816    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smwzz\" (UniqueName: \"kubernetes.io/projected/fc70a32a-525b-443c-8a32-0042e1cddcdc-kube-api-access-smwzz\") pod \"kuadrant-operator-controller-manager-96db98c47-ft595\" (UID: \"fc70a32a-525b-443c-8a32-0042e1cddcdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"
Aug 05 19:08:38.418039 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.417929    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"
Aug 05 19:08:38.553770 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.553731    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"]
Aug 05 19:08:38.557063 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:08:38.557034    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc70a32a_525b_443c_8a32_0042e1cddcdc.slice/crio-7cd80f5996a496b49f0f45531c4f1d88b7b638991b56d3e65f795858d8721069 WatchSource:0}: Error finding container 7cd80f5996a496b49f0f45531c4f1d88b7b638991b56d3e65f795858d8721069: Status 404 returned error can't find the container with id 7cd80f5996a496b49f0f45531c4f1d88b7b638991b56d3e65f795858d8721069
Aug 05 19:08:38.761821 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.761785    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"]
Aug 05 19:08:38.779369 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.779325    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"]
Aug 05 19:08:38.798225 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.798185    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"]
Aug 05 19:08:38.803260 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.803230    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"
Aug 05 19:08:38.822082 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.822051    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"]
Aug 05 19:08:38.878004 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.877957    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-jfbl7\" (UID: \"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"
Aug 05 19:08:38.878188 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.878081    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj57t\" (UniqueName: \"kubernetes.io/projected/37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2-kube-api-access-mj57t\") pod \"kuadrant-operator-controller-manager-96db98c47-jfbl7\" (UID: \"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"
Aug 05 19:08:38.978668 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.978630    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj57t\" (UniqueName: \"kubernetes.io/projected/37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2-kube-api-access-mj57t\") pod \"kuadrant-operator-controller-manager-96db98c47-jfbl7\" (UID: \"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"
Aug 05 19:08:38.978847 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.978727    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-jfbl7\" (UID: \"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"
Aug 05 19:08:38.979148 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.979132    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-jfbl7\" (UID: \"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"
Aug 05 19:08:38.987318 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:38.987295    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj57t\" (UniqueName: \"kubernetes.io/projected/37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2-kube-api-access-mj57t\") pod \"kuadrant-operator-controller-manager-96db98c47-jfbl7\" (UID: \"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"
Aug 05 19:08:39.116297 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:39.116206    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"
Aug 05 19:08:39.272003 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:39.271906    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"]
Aug 05 19:08:39.277285 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:08:39.277248    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e44e0d_1a6d_4d30_bb70_6ddf8a3e16f2.slice/crio-43c48e58543afee182c02ec9cb6c5864f7ad7c156265faa2f218da43d187326c WatchSource:0}: Error finding container 43c48e58543afee182c02ec9cb6c5864f7ad7c156265faa2f218da43d187326c: Status 404 returned error can't find the container with id 43c48e58543afee182c02ec9cb6c5864f7ad7c156265faa2f218da43d187326c
Aug 05 19:08:39.874850 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:39.874781    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7" event={"ID":"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2","Type":"ContainerStarted","Data":"43c48e58543afee182c02ec9cb6c5864f7ad7c156265faa2f218da43d187326c"}
Aug 05 19:08:43.903421 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:43.903375    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595" podUID="fc70a32a-525b-443c-8a32-0042e1cddcdc" containerName="manager" containerID="cri-o://3efa8108506fd3bdd12cf65ad82ed94b99ca9e38b7909d1f40b5099c621c23fe" gracePeriod=2
Aug 05 19:08:43.905110 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:43.905079    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7" event={"ID":"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2","Type":"ContainerStarted","Data":"b92e0a9589e3ec100dfc365dadf4b8c86a57b0971c5bdec416e642e9b14b4394"}
Aug 05 19:08:43.905244 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:43.905231    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"
Aug 05 19:08:43.926855 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:43.926803    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7" podStartSLOduration=1.975563087 podStartE2EDuration="5.926786858s" totalImagesPullingTime="3.951223771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:08:43.925967053 +0000 UTC m=+425.415902126" watchObservedRunningTime="2026-08-05 19:08:43.926786858 +0000 UTC m=+425.416721931"
Aug 05 19:08:44.151286 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:44.151261    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"
Aug 05 19:08:44.153140 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:08:44.153107    2533 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-ft595\" is forbidden: User \"system:node:ip-10-0-143-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-76.ec2.internal' and this object" podUID="fc70a32a-525b-443c-8a32-0042e1cddcdc" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"
Aug 05 19:08:44.230723 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:44.230685    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smwzz\" (UniqueName: \"kubernetes.io/projected/fc70a32a-525b-443c-8a32-0042e1cddcdc-kube-api-access-smwzz\") pod \"fc70a32a-525b-443c-8a32-0042e1cddcdc\" (UID: \"fc70a32a-525b-443c-8a32-0042e1cddcdc\") "
Aug 05 19:08:44.230723 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:44.230729    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc70a32a-525b-443c-8a32-0042e1cddcdc-extensions-socket-volume\") pod \"fc70a32a-525b-443c-8a32-0042e1cddcdc\" (UID: \"fc70a32a-525b-443c-8a32-0042e1cddcdc\") "
Aug 05 19:08:44.231034 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:44.231004    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc70a32a-525b-443c-8a32-0042e1cddcdc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fc70a32a-525b-443c-8a32-0042e1cddcdc" (UID: "fc70a32a-525b-443c-8a32-0042e1cddcdc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:08:44.232860 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:44.232838    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc70a32a-525b-443c-8a32-0042e1cddcdc-kube-api-access-smwzz" (OuterVolumeSpecName: "kube-api-access-smwzz") pod "fc70a32a-525b-443c-8a32-0042e1cddcdc" (UID: "fc70a32a-525b-443c-8a32-0042e1cddcdc"). InnerVolumeSpecName "kube-api-access-smwzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:08:44.331801 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:44.331760    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smwzz\" (UniqueName: \"kubernetes.io/projected/fc70a32a-525b-443c-8a32-0042e1cddcdc-kube-api-access-smwzz\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:08:44.331801 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:44.331795    2533 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc70a32a-525b-443c-8a32-0042e1cddcdc-extensions-socket-volume\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:08:44.911851 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:44.911818    2533 generic.go:356] "Generic (PLEG): container finished" podID="fc70a32a-525b-443c-8a32-0042e1cddcdc" containerID="3efa8108506fd3bdd12cf65ad82ed94b99ca9e38b7909d1f40b5099c621c23fe" exitCode=2
Aug 05 19:08:44.912365 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:44.911878    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"
Aug 05 19:08:44.912579 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:44.912557    2533 scope.go:117] "RemoveContainer" containerID="3efa8108506fd3bdd12cf65ad82ed94b99ca9e38b7909d1f40b5099c621c23fe"
Aug 05 19:08:44.914029 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:08:44.914006    2533 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-ft595\" is forbidden: User \"system:node:ip-10-0-143-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-76.ec2.internal' and this object" podUID="fc70a32a-525b-443c-8a32-0042e1cddcdc" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"
Aug 05 19:08:44.921538 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:44.921516    2533 scope.go:117] "RemoveContainer" containerID="3efa8108506fd3bdd12cf65ad82ed94b99ca9e38b7909d1f40b5099c621c23fe"
Aug 05 19:08:44.921804 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:08:44.921783    2533 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-ft595\" is forbidden: User \"system:node:ip-10-0-143-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-76.ec2.internal' and this object" podUID="fc70a32a-525b-443c-8a32-0042e1cddcdc" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ft595"
Aug 05 19:08:44.921882 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:08:44.921813    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3efa8108506fd3bdd12cf65ad82ed94b99ca9e38b7909d1f40b5099c621c23fe\": container with ID starting with 3efa8108506fd3bdd12cf65ad82ed94b99ca9e38b7909d1f40b5099c621c23fe not found: ID does not exist" containerID="3efa8108506fd3bdd12cf65ad82ed94b99ca9e38b7909d1f40b5099c621c23fe"
Aug 05 19:08:44.921931 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:44.921852    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3efa8108506fd3bdd12cf65ad82ed94b99ca9e38b7909d1f40b5099c621c23fe"} err="failed to get container status \"3efa8108506fd3bdd12cf65ad82ed94b99ca9e38b7909d1f40b5099c621c23fe\": rpc error: code = NotFound desc = could not find container \"3efa8108506fd3bdd12cf65ad82ed94b99ca9e38b7909d1f40b5099c621c23fe\": container with ID starting with 3efa8108506fd3bdd12cf65ad82ed94b99ca9e38b7909d1f40b5099c621c23fe not found: ID does not exist"
Aug 05 19:08:45.012520 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:45.012486    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc70a32a-525b-443c-8a32-0042e1cddcdc" path="/var/lib/kubelet/pods/fc70a32a-525b-443c-8a32-0042e1cddcdc/volumes"
Aug 05 19:08:54.914217 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:08:54.914182    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"
Aug 05 19:09:07.361983 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:07.361901    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"]
Aug 05 19:09:07.362405 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:07.362133    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7" podUID="37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2" containerName="manager" containerID="cri-o://b92e0a9589e3ec100dfc365dadf4b8c86a57b0971c5bdec416e642e9b14b4394" gracePeriod=10
Aug 05 19:09:07.603860 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:07.603836    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"
Aug 05 19:09:07.742713 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:07.742684    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mj57t\" (UniqueName: \"kubernetes.io/projected/37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2-kube-api-access-mj57t\") pod \"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2\" (UID: \"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2\") "
Aug 05 19:09:07.742860 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:07.742748    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2-extensions-socket-volume\") pod \"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2\" (UID: \"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2\") "
Aug 05 19:09:07.743273 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:07.743247    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2" (UID: "37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:09:07.744824 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:07.744803    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2-kube-api-access-mj57t" (OuterVolumeSpecName: "kube-api-access-mj57t") pod "37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2" (UID: "37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2"). InnerVolumeSpecName "kube-api-access-mj57t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:09:07.844390 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:07.844345    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj57t\" (UniqueName: \"kubernetes.io/projected/37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2-kube-api-access-mj57t\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:09:07.844390 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:07.844383    2533 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2-extensions-socket-volume\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:09:08.026736 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:08.026646    2533 generic.go:356] "Generic (PLEG): container finished" podID="37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2" containerID="b92e0a9589e3ec100dfc365dadf4b8c86a57b0971c5bdec416e642e9b14b4394" exitCode=0
Aug 05 19:09:08.026736 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:08.026693    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"
Aug 05 19:09:08.026736 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:08.026702    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7" event={"ID":"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2","Type":"ContainerDied","Data":"b92e0a9589e3ec100dfc365dadf4b8c86a57b0971c5bdec416e642e9b14b4394"}
Aug 05 19:09:08.026970 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:08.026745    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7" event={"ID":"37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2","Type":"ContainerDied","Data":"43c48e58543afee182c02ec9cb6c5864f7ad7c156265faa2f218da43d187326c"}
Aug 05 19:09:08.026970 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:08.026770    2533 scope.go:117] "RemoveContainer" containerID="b92e0a9589e3ec100dfc365dadf4b8c86a57b0971c5bdec416e642e9b14b4394"
Aug 05 19:09:08.035607 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:08.035585    2533 scope.go:117] "RemoveContainer" containerID="b92e0a9589e3ec100dfc365dadf4b8c86a57b0971c5bdec416e642e9b14b4394"
Aug 05 19:09:08.035880 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:09:08.035864    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b92e0a9589e3ec100dfc365dadf4b8c86a57b0971c5bdec416e642e9b14b4394\": container with ID starting with b92e0a9589e3ec100dfc365dadf4b8c86a57b0971c5bdec416e642e9b14b4394 not found: ID does not exist" containerID="b92e0a9589e3ec100dfc365dadf4b8c86a57b0971c5bdec416e642e9b14b4394"
Aug 05 19:09:08.035923 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:08.035890    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92e0a9589e3ec100dfc365dadf4b8c86a57b0971c5bdec416e642e9b14b4394"} err="failed to get container status \"b92e0a9589e3ec100dfc365dadf4b8c86a57b0971c5bdec416e642e9b14b4394\": rpc error: code = NotFound desc = could not find container \"b92e0a9589e3ec100dfc365dadf4b8c86a57b0971c5bdec416e642e9b14b4394\": container with ID starting with b92e0a9589e3ec100dfc365dadf4b8c86a57b0971c5bdec416e642e9b14b4394 not found: ID does not exist"
Aug 05 19:09:08.049056 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:08.049024    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"]
Aug 05 19:09:08.053012 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:08.052977    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-jfbl7"]
Aug 05 19:09:09.018699 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:09.018661    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2" path="/var/lib/kubelet/pods/37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2/volumes"
Aug 05 19:09:24.775602 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.775562    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"]
Aug 05 19:09:24.775973 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.775905    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc70a32a-525b-443c-8a32-0042e1cddcdc" containerName="manager"
Aug 05 19:09:24.775973 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.775917    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc70a32a-525b-443c-8a32-0042e1cddcdc" containerName="manager"
Aug 05 19:09:24.775973 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.775938    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2" containerName="manager"
Aug 05 19:09:24.775973 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.775945    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2" containerName="manager"
Aug 05 19:09:24.776141 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.776021    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e44e0d-1a6d-4d30-bb70-6ddf8a3e16f2" containerName="manager"
Aug 05 19:09:24.776141 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.776029    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc70a32a-525b-443c-8a32-0042e1cddcdc" containerName="manager"
Aug 05 19:09:24.778710 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.778692    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"
Aug 05 19:09:24.781142 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.781103    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 05 19:09:24.781506 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.781469    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 05 19:09:24.782031 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.782008    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 05 19:09:24.782153 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.782131    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nfhfh\""
Aug 05 19:09:24.784502 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.784483    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"]
Aug 05 19:09:24.879741 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.879708    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"]
Aug 05 19:09:24.893376 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.893344    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c80c49e1-43cd-4708-8439-3b01fa278f57-config-file\") pod \"limitador-limitador-859c4d96d6-jpm4p\" (UID: \"c80c49e1-43cd-4708-8439-3b01fa278f57\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"
Aug 05 19:09:24.893533 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.893442    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5h2q\" (UniqueName: \"kubernetes.io/projected/c80c49e1-43cd-4708-8439-3b01fa278f57-kube-api-access-r5h2q\") pod \"limitador-limitador-859c4d96d6-jpm4p\" (UID: \"c80c49e1-43cd-4708-8439-3b01fa278f57\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"
Aug 05 19:09:24.994171 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.994131    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c80c49e1-43cd-4708-8439-3b01fa278f57-config-file\") pod \"limitador-limitador-859c4d96d6-jpm4p\" (UID: \"c80c49e1-43cd-4708-8439-3b01fa278f57\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"
Aug 05 19:09:24.994337 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.994201    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5h2q\" (UniqueName: \"kubernetes.io/projected/c80c49e1-43cd-4708-8439-3b01fa278f57-kube-api-access-r5h2q\") pod \"limitador-limitador-859c4d96d6-jpm4p\" (UID: \"c80c49e1-43cd-4708-8439-3b01fa278f57\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"
Aug 05 19:09:24.994829 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:24.994796    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c80c49e1-43cd-4708-8439-3b01fa278f57-config-file\") pod \"limitador-limitador-859c4d96d6-jpm4p\" (UID: \"c80c49e1-43cd-4708-8439-3b01fa278f57\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"
Aug 05 19:09:25.001956 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:25.001931    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5h2q\" (UniqueName: \"kubernetes.io/projected/c80c49e1-43cd-4708-8439-3b01fa278f57-kube-api-access-r5h2q\") pod \"limitador-limitador-859c4d96d6-jpm4p\" (UID: \"c80c49e1-43cd-4708-8439-3b01fa278f57\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"
Aug 05 19:09:25.090182 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:25.090056    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"
Aug 05 19:09:25.222502 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:25.222475    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"]
Aug 05 19:09:25.224566 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:09:25.224535    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80c49e1_43cd_4708_8439_3b01fa278f57.slice/crio-1c487428f97053def9e5eb128c4292aa6d0a09d093f7b1920479d5260cebde02 WatchSource:0}: Error finding container 1c487428f97053def9e5eb128c4292aa6d0a09d093f7b1920479d5260cebde02: Status 404 returned error can't find the container with id 1c487428f97053def9e5eb128c4292aa6d0a09d093f7b1920479d5260cebde02
Aug 05 19:09:25.683550 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:25.683510    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-25d7s"]
Aug 05 19:09:25.686548 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:25.686515    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-25d7s"
Aug 05 19:09:25.689171 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:25.689147    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kbdmn\""
Aug 05 19:09:25.697517 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:25.697491    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-25d7s"]
Aug 05 19:09:25.801403 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:25.801367    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8trs9\" (UniqueName: \"kubernetes.io/projected/76b34922-3d95-4de2-b9b3-0bf19fc6c0b2-kube-api-access-8trs9\") pod \"authorino-c548b5d7d-25d7s\" (UID: \"76b34922-3d95-4de2-b9b3-0bf19fc6c0b2\") " pod="kuadrant-system/authorino-c548b5d7d-25d7s"
Aug 05 19:09:25.902465 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:25.902427    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8trs9\" (UniqueName: \"kubernetes.io/projected/76b34922-3d95-4de2-b9b3-0bf19fc6c0b2-kube-api-access-8trs9\") pod \"authorino-c548b5d7d-25d7s\" (UID: \"76b34922-3d95-4de2-b9b3-0bf19fc6c0b2\") " pod="kuadrant-system/authorino-c548b5d7d-25d7s"
Aug 05 19:09:25.910768 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:25.910734    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8trs9\" (UniqueName: \"kubernetes.io/projected/76b34922-3d95-4de2-b9b3-0bf19fc6c0b2-kube-api-access-8trs9\") pod \"authorino-c548b5d7d-25d7s\" (UID: \"76b34922-3d95-4de2-b9b3-0bf19fc6c0b2\") " pod="kuadrant-system/authorino-c548b5d7d-25d7s"
Aug 05 19:09:25.996790 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:25.996700    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-25d7s"
Aug 05 19:09:26.121607 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:26.121575    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p" event={"ID":"c80c49e1-43cd-4708-8439-3b01fa278f57","Type":"ContainerStarted","Data":"1c487428f97053def9e5eb128c4292aa6d0a09d093f7b1920479d5260cebde02"}
Aug 05 19:09:26.127310 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:26.127284    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-25d7s"]
Aug 05 19:09:26.129247 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:09:26.129223    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76b34922_3d95_4de2_b9b3_0bf19fc6c0b2.slice/crio-35997b928f285ac01eefc689ca5505e4993e6201b7d9d767501d6ce95c526dd3 WatchSource:0}: Error finding container 35997b928f285ac01eefc689ca5505e4993e6201b7d9d767501d6ce95c526dd3: Status 404 returned error can't find the container with id 35997b928f285ac01eefc689ca5505e4993e6201b7d9d767501d6ce95c526dd3
Aug 05 19:09:27.130736 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:27.130500    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p" event={"ID":"c80c49e1-43cd-4708-8439-3b01fa278f57","Type":"ContainerStarted","Data":"73010f91a8b587197f037b04a34e4b9fcbaa5083633e78de67be93a7ac561beb"}
Aug 05 19:09:27.130736 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:27.130582    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"
Aug 05 19:09:27.132804 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:27.132776    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-25d7s" event={"ID":"76b34922-3d95-4de2-b9b3-0bf19fc6c0b2","Type":"ContainerStarted","Data":"35997b928f285ac01eefc689ca5505e4993e6201b7d9d767501d6ce95c526dd3"}
Aug 05 19:09:27.147790 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:27.147720    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p" podStartSLOduration=1.75322562 podStartE2EDuration="3.147697516s" totalImagesPullingTime="1.394471896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:09:27.145462384 +0000 UTC m=+468.635397485" watchObservedRunningTime="2026-08-05 19:09:27.147697516 +0000 UTC m=+468.637632593"
Aug 05 19:09:29.147787 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:29.147753    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-25d7s" event={"ID":"76b34922-3d95-4de2-b9b3-0bf19fc6c0b2","Type":"ContainerStarted","Data":"1bf71317541ff660666a12af09da459bb4776206daaebad8a4d0455e51f428d0"}
Aug 05 19:09:29.162471 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:29.162419    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-25d7s" podStartSLOduration=2.055870057 podStartE2EDuration="4.16240462s" totalImagesPullingTime="2.106534563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:09:29.160677341 +0000 UTC m=+470.650612421" watchObservedRunningTime="2026-08-05 19:09:29.16240462 +0000 UTC m=+470.652339694"
Aug 05 19:09:38.139883 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:38.139853    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"
Aug 05 19:09:38.507569 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:38.507532    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"]
Aug 05 19:09:38.507752 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:38.507724    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p" podUID="c80c49e1-43cd-4708-8439-3b01fa278f57" containerName="limitador" containerID="cri-o://73010f91a8b587197f037b04a34e4b9fcbaa5083633e78de67be93a7ac561beb" gracePeriod=30
Aug 05 19:09:39.055968 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.055941    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"
Aug 05 19:09:39.113919 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.113816    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c80c49e1-43cd-4708-8439-3b01fa278f57-config-file\") pod \"c80c49e1-43cd-4708-8439-3b01fa278f57\" (UID: \"c80c49e1-43cd-4708-8439-3b01fa278f57\") "
Aug 05 19:09:39.113919 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.113877    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5h2q\" (UniqueName: \"kubernetes.io/projected/c80c49e1-43cd-4708-8439-3b01fa278f57-kube-api-access-r5h2q\") pod \"c80c49e1-43cd-4708-8439-3b01fa278f57\" (UID: \"c80c49e1-43cd-4708-8439-3b01fa278f57\") "
Aug 05 19:09:39.114210 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.114188    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c80c49e1-43cd-4708-8439-3b01fa278f57-config-file" (OuterVolumeSpecName: "config-file") pod "c80c49e1-43cd-4708-8439-3b01fa278f57" (UID: "c80c49e1-43cd-4708-8439-3b01fa278f57"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:09:39.115927 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.115898    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c80c49e1-43cd-4708-8439-3b01fa278f57-kube-api-access-r5h2q" (OuterVolumeSpecName: "kube-api-access-r5h2q") pod "c80c49e1-43cd-4708-8439-3b01fa278f57" (UID: "c80c49e1-43cd-4708-8439-3b01fa278f57"). InnerVolumeSpecName "kube-api-access-r5h2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:09:39.197641 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.197604    2533 generic.go:356] "Generic (PLEG): container finished" podID="c80c49e1-43cd-4708-8439-3b01fa278f57" containerID="73010f91a8b587197f037b04a34e4b9fcbaa5083633e78de67be93a7ac561beb" exitCode=0
Aug 05 19:09:39.198030 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.197657    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"
Aug 05 19:09:39.198030 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.197661    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p" event={"ID":"c80c49e1-43cd-4708-8439-3b01fa278f57","Type":"ContainerDied","Data":"73010f91a8b587197f037b04a34e4b9fcbaa5083633e78de67be93a7ac561beb"}
Aug 05 19:09:39.198030 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.197815    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-jpm4p" event={"ID":"c80c49e1-43cd-4708-8439-3b01fa278f57","Type":"ContainerDied","Data":"1c487428f97053def9e5eb128c4292aa6d0a09d093f7b1920479d5260cebde02"}
Aug 05 19:09:39.198030 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.197854    2533 scope.go:117] "RemoveContainer" containerID="73010f91a8b587197f037b04a34e4b9fcbaa5083633e78de67be93a7ac561beb"
Aug 05 19:09:39.206954 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.206934    2533 scope.go:117] "RemoveContainer" containerID="73010f91a8b587197f037b04a34e4b9fcbaa5083633e78de67be93a7ac561beb"
Aug 05 19:09:39.207311 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:09:39.207291    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73010f91a8b587197f037b04a34e4b9fcbaa5083633e78de67be93a7ac561beb\": container with ID starting with 73010f91a8b587197f037b04a34e4b9fcbaa5083633e78de67be93a7ac561beb not found: ID does not exist" containerID="73010f91a8b587197f037b04a34e4b9fcbaa5083633e78de67be93a7ac561beb"
Aug 05 19:09:39.207386 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.207323    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73010f91a8b587197f037b04a34e4b9fcbaa5083633e78de67be93a7ac561beb"} err="failed to get container status \"73010f91a8b587197f037b04a34e4b9fcbaa5083633e78de67be93a7ac561beb\": rpc error: code = NotFound desc = could not find container \"73010f91a8b587197f037b04a34e4b9fcbaa5083633e78de67be93a7ac561beb\": container with ID starting with 73010f91a8b587197f037b04a34e4b9fcbaa5083633e78de67be93a7ac561beb not found: ID does not exist"
Aug 05 19:09:39.214751 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.214731    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5h2q\" (UniqueName: \"kubernetes.io/projected/c80c49e1-43cd-4708-8439-3b01fa278f57-kube-api-access-r5h2q\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:09:39.214834 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.214754    2533 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c80c49e1-43cd-4708-8439-3b01fa278f57-config-file\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:09:39.219313 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.219288    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"]
Aug 05 19:09:39.221259 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:39.221235    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-jpm4p"]
Aug 05 19:09:41.012350 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:41.012308    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c80c49e1-43cd-4708-8439-3b01fa278f57" path="/var/lib/kubelet/pods/c80c49e1-43cd-4708-8439-3b01fa278f57/volumes"
Aug 05 19:09:44.672470 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.672429    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t"]
Aug 05 19:09:44.672965 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.672948    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c80c49e1-43cd-4708-8439-3b01fa278f57" containerName="limitador"
Aug 05 19:09:44.673042 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.672968    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="c80c49e1-43cd-4708-8439-3b01fa278f57" containerName="limitador"
Aug 05 19:09:44.673080 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.673062    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="c80c49e1-43cd-4708-8439-3b01fa278f57" containerName="limitador"
Aug 05 19:09:44.677690 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.677670    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t"
Aug 05 19:09:44.680045 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.680019    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 19:09:44.680045 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.680032    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 05 19:09:44.680789 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.680765    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-v52jx\""
Aug 05 19:09:44.680952 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.680809    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 19:09:44.683753 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.683728    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t"]
Aug 05 19:09:44.762872 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.762829    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1da80c10-acb1-4666-aa32-09325ea78062-data\") pod \"postgres-69fb4594cf-4pz8t\" (UID: \"1da80c10-acb1-4666-aa32-09325ea78062\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t"
Aug 05 19:09:44.763088 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.762912    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr2mg\" (UniqueName: \"kubernetes.io/projected/1da80c10-acb1-4666-aa32-09325ea78062-kube-api-access-hr2mg\") pod \"postgres-69fb4594cf-4pz8t\" (UID: \"1da80c10-acb1-4666-aa32-09325ea78062\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t"
Aug 05 19:09:44.863715 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.863670    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr2mg\" (UniqueName: \"kubernetes.io/projected/1da80c10-acb1-4666-aa32-09325ea78062-kube-api-access-hr2mg\") pod \"postgres-69fb4594cf-4pz8t\" (UID: \"1da80c10-acb1-4666-aa32-09325ea78062\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t"
Aug 05 19:09:44.863924 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.863737    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1da80c10-acb1-4666-aa32-09325ea78062-data\") pod \"postgres-69fb4594cf-4pz8t\" (UID: \"1da80c10-acb1-4666-aa32-09325ea78062\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t"
Aug 05 19:09:44.864106 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.864086    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1da80c10-acb1-4666-aa32-09325ea78062-data\") pod \"postgres-69fb4594cf-4pz8t\" (UID: \"1da80c10-acb1-4666-aa32-09325ea78062\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t"
Aug 05 19:09:44.874453 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.874430    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr2mg\" (UniqueName: \"kubernetes.io/projected/1da80c10-acb1-4666-aa32-09325ea78062-kube-api-access-hr2mg\") pod \"postgres-69fb4594cf-4pz8t\" (UID: \"1da80c10-acb1-4666-aa32-09325ea78062\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t"
Aug 05 19:09:44.989211 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:44.989121    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t"
Aug 05 19:09:45.122186 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:45.122161    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t"]
Aug 05 19:09:45.124210 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:09:45.124174    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da80c10_acb1_4666_aa32_09325ea78062.slice/crio-354e1389a9c13ca0377116fe95625a52e2cd57d65aad4c8ee78a376345d5db65 WatchSource:0}: Error finding container 354e1389a9c13ca0377116fe95625a52e2cd57d65aad4c8ee78a376345d5db65: Status 404 returned error can't find the container with id 354e1389a9c13ca0377116fe95625a52e2cd57d65aad4c8ee78a376345d5db65
Aug 05 19:09:45.229974 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:45.229935    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t" event={"ID":"1da80c10-acb1-4666-aa32-09325ea78062","Type":"ContainerStarted","Data":"354e1389a9c13ca0377116fe95625a52e2cd57d65aad4c8ee78a376345d5db65"}
Aug 05 19:09:50.261332 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:50.261221    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t" event={"ID":"1da80c10-acb1-4666-aa32-09325ea78062","Type":"ContainerStarted","Data":"01420509ba295fe4dea8b3f94206cfd2a4a7639a4e487758d3b40b8e17c773fc"}
Aug 05 19:09:50.261332 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:50.261313    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t"
Aug 05 19:09:50.277517 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:50.277463    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t" podStartSLOduration=1.398980568 podStartE2EDuration="6.277445478s" totalImagesPullingTime="4.87846491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:09:50.276089562 +0000 UTC m=+491.766024635" watchObservedRunningTime="2026-08-05 19:09:50.277445478 +0000 UTC m=+491.767380552"
Aug 05 19:09:56.296740 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:56.296709    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4pz8t"
Aug 05 19:09:57.068385 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:57.068348    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b97c9494b-7zn99"]
Aug 05 19:09:57.073553 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:57.073529    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b97c9494b-7zn99"
Aug 05 19:09:57.076399 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:57.076373    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 05 19:09:57.077532 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:57.077505    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vvdh\" (UniqueName: \"kubernetes.io/projected/6b993272-88fa-4185-a849-57988e9838a8-kube-api-access-6vvdh\") pod \"authorino-6b97c9494b-7zn99\" (UID: \"6b993272-88fa-4185-a849-57988e9838a8\") " pod="kuadrant-system/authorino-6b97c9494b-7zn99"
Aug 05 19:09:57.077672 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:57.077551    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b993272-88fa-4185-a849-57988e9838a8-tls-cert\") pod \"authorino-6b97c9494b-7zn99\" (UID: \"6b993272-88fa-4185-a849-57988e9838a8\") " pod="kuadrant-system/authorino-6b97c9494b-7zn99"
Aug 05 19:09:57.078375 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:57.078349    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b97c9494b-7zn99"]
Aug 05 19:09:57.178312 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:57.178279    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vvdh\" (UniqueName: \"kubernetes.io/projected/6b993272-88fa-4185-a849-57988e9838a8-kube-api-access-6vvdh\") pod \"authorino-6b97c9494b-7zn99\" (UID: \"6b993272-88fa-4185-a849-57988e9838a8\") " pod="kuadrant-system/authorino-6b97c9494b-7zn99"
Aug 05 19:09:57.178312 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:57.178324    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b993272-88fa-4185-a849-57988e9838a8-tls-cert\") pod \"authorino-6b97c9494b-7zn99\" (UID: \"6b993272-88fa-4185-a849-57988e9838a8\") " pod="kuadrant-system/authorino-6b97c9494b-7zn99"
Aug 05 19:09:57.180694 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:57.180671    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b993272-88fa-4185-a849-57988e9838a8-tls-cert\") pod \"authorino-6b97c9494b-7zn99\" (UID: \"6b993272-88fa-4185-a849-57988e9838a8\") " pod="kuadrant-system/authorino-6b97c9494b-7zn99"
Aug 05 19:09:57.185930 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:57.185902    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vvdh\" (UniqueName: \"kubernetes.io/projected/6b993272-88fa-4185-a849-57988e9838a8-kube-api-access-6vvdh\") pod \"authorino-6b97c9494b-7zn99\" (UID: \"6b993272-88fa-4185-a849-57988e9838a8\") " pod="kuadrant-system/authorino-6b97c9494b-7zn99"
Aug 05 19:09:57.384100 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:57.384009    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b97c9494b-7zn99"
Aug 05 19:09:57.514755 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:57.514727    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b97c9494b-7zn99"]
Aug 05 19:09:57.516908 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:09:57.516876    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b993272_88fa_4185_a849_57988e9838a8.slice/crio-0deeae1531258c6d919d25643922cf92582299be211dcc1170bcb687e14a3b4b WatchSource:0}: Error finding container 0deeae1531258c6d919d25643922cf92582299be211dcc1170bcb687e14a3b4b: Status 404 returned error can't find the container with id 0deeae1531258c6d919d25643922cf92582299be211dcc1170bcb687e14a3b4b
Aug 05 19:09:58.302783 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:58.302747    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b97c9494b-7zn99" event={"ID":"6b993272-88fa-4185-a849-57988e9838a8","Type":"ContainerStarted","Data":"0deeae1531258c6d919d25643922cf92582299be211dcc1170bcb687e14a3b4b"}
Aug 05 19:09:59.309577 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:59.309543    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b97c9494b-7zn99" event={"ID":"6b993272-88fa-4185-a849-57988e9838a8","Type":"ContainerStarted","Data":"4bde8d59eb43b3ad8fc7404fa0c6c21bd401f076ca1eca6ab9fc214b1346fe96"}
Aug 05 19:09:59.324435 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:59.324373    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b97c9494b-7zn99" podStartSLOduration=1.073852955 podStartE2EDuration="2.324353071s" totalImagesPullingTime="1.250500116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:09:59.322846593 +0000 UTC m=+500.812781691" watchObservedRunningTime="2026-08-05 19:09:59.324353071 +0000 UTC m=+500.814288160"
Aug 05 19:09:59.347655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:59.347614    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-25d7s"]
Aug 05 19:09:59.347891 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:59.347857    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-25d7s" podUID="76b34922-3d95-4de2-b9b3-0bf19fc6c0b2" containerName="authorino" containerID="cri-o://1bf71317541ff660666a12af09da459bb4776206daaebad8a4d0455e51f428d0" gracePeriod=30
Aug 05 19:09:59.611919 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:59.611879    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-25d7s"
Aug 05 19:09:59.700391 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:59.700354    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8trs9\" (UniqueName: \"kubernetes.io/projected/76b34922-3d95-4de2-b9b3-0bf19fc6c0b2-kube-api-access-8trs9\") pod \"76b34922-3d95-4de2-b9b3-0bf19fc6c0b2\" (UID: \"76b34922-3d95-4de2-b9b3-0bf19fc6c0b2\") "
Aug 05 19:09:59.702429 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:59.702410    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76b34922-3d95-4de2-b9b3-0bf19fc6c0b2-kube-api-access-8trs9" (OuterVolumeSpecName: "kube-api-access-8trs9") pod "76b34922-3d95-4de2-b9b3-0bf19fc6c0b2" (UID: "76b34922-3d95-4de2-b9b3-0bf19fc6c0b2"). InnerVolumeSpecName "kube-api-access-8trs9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:09:59.801801 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:09:59.801762    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8trs9\" (UniqueName: \"kubernetes.io/projected/76b34922-3d95-4de2-b9b3-0bf19fc6c0b2-kube-api-access-8trs9\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:10:00.315369 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:00.315333    2533 generic.go:356] "Generic (PLEG): container finished" podID="76b34922-3d95-4de2-b9b3-0bf19fc6c0b2" containerID="1bf71317541ff660666a12af09da459bb4776206daaebad8a4d0455e51f428d0" exitCode=0
Aug 05 19:10:00.315800 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:00.315386    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-25d7s"
Aug 05 19:10:00.315800 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:00.315419    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-25d7s" event={"ID":"76b34922-3d95-4de2-b9b3-0bf19fc6c0b2","Type":"ContainerDied","Data":"1bf71317541ff660666a12af09da459bb4776206daaebad8a4d0455e51f428d0"}
Aug 05 19:10:00.315800 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:00.315455    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-25d7s" event={"ID":"76b34922-3d95-4de2-b9b3-0bf19fc6c0b2","Type":"ContainerDied","Data":"35997b928f285ac01eefc689ca5505e4993e6201b7d9d767501d6ce95c526dd3"}
Aug 05 19:10:00.315800 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:00.315472    2533 scope.go:117] "RemoveContainer" containerID="1bf71317541ff660666a12af09da459bb4776206daaebad8a4d0455e51f428d0"
Aug 05 19:10:00.324653 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:00.324637    2533 scope.go:117] "RemoveContainer" containerID="1bf71317541ff660666a12af09da459bb4776206daaebad8a4d0455e51f428d0"
Aug 05 19:10:00.324937 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:10:00.324919    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bf71317541ff660666a12af09da459bb4776206daaebad8a4d0455e51f428d0\": container with ID starting with 1bf71317541ff660666a12af09da459bb4776206daaebad8a4d0455e51f428d0 not found: ID does not exist" containerID="1bf71317541ff660666a12af09da459bb4776206daaebad8a4d0455e51f428d0"
Aug 05 19:10:00.325027 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:00.324945    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bf71317541ff660666a12af09da459bb4776206daaebad8a4d0455e51f428d0"} err="failed to get container status \"1bf71317541ff660666a12af09da459bb4776206daaebad8a4d0455e51f428d0\": rpc error: code = NotFound desc = could not find container \"1bf71317541ff660666a12af09da459bb4776206daaebad8a4d0455e51f428d0\": container with ID starting with 1bf71317541ff660666a12af09da459bb4776206daaebad8a4d0455e51f428d0 not found: ID does not exist"
Aug 05 19:10:00.336520 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:00.336487    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-25d7s"]
Aug 05 19:10:00.339942 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:00.339920    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-25d7s"]
Aug 05 19:10:01.012551 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:01.012521    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76b34922-3d95-4de2-b9b3-0bf19fc6c0b2" path="/var/lib/kubelet/pods/76b34922-3d95-4de2-b9b3-0bf19fc6c0b2/volumes"
Aug 05 19:10:03.817891 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:03.817857    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b687c575c-868zl"]
Aug 05 19:10:03.818356 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:03.818185    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76b34922-3d95-4de2-b9b3-0bf19fc6c0b2" containerName="authorino"
Aug 05 19:10:03.818356 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:03.818196    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="76b34922-3d95-4de2-b9b3-0bf19fc6c0b2" containerName="authorino"
Aug 05 19:10:03.818356 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:03.818256    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="76b34922-3d95-4de2-b9b3-0bf19fc6c0b2" containerName="authorino"
Aug 05 19:10:03.820080 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:03.820064    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b687c575c-868zl"
Aug 05 19:10:03.822744 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:03.822721    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gnhpv\""
Aug 05 19:10:03.823016 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:03.822975    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 05 19:10:03.823579 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:03.823564    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 05 19:10:03.833968 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:03.833944    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b687c575c-868zl"]
Aug 05 19:10:03.939113 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:03.939071    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppnjb\" (UniqueName: \"kubernetes.io/projected/111fc259-1918-4036-b98c-7fb5b1c7766e-kube-api-access-ppnjb\") pod \"maas-controller-b687c575c-868zl\" (UID: \"111fc259-1918-4036-b98c-7fb5b1c7766e\") " pod="opendatahub/maas-controller-b687c575c-868zl"
Aug 05 19:10:03.939302 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:03.939136    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/111fc259-1918-4036-b98c-7fb5b1c7766e-webhook-cert\") pod \"maas-controller-b687c575c-868zl\" (UID: \"111fc259-1918-4036-b98c-7fb5b1c7766e\") " pod="opendatahub/maas-controller-b687c575c-868zl"
Aug 05 19:10:03.990267 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:03.990231    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-pqw22"]
Aug 05 19:10:03.992707 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:03.992687    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8dd8c4bc-pqw22"
Aug 05 19:10:04.005979 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.005951    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-pqw22"]
Aug 05 19:10:04.040113 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.040079    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b4e3ebd-1139-4856-88c2-3c83aa338212-webhook-cert\") pod \"maas-controller-c8dd8c4bc-pqw22\" (UID: \"4b4e3ebd-1139-4856-88c2-3c83aa338212\") " pod="opendatahub/maas-controller-c8dd8c4bc-pqw22"
Aug 05 19:10:04.040317 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.040139    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppnjb\" (UniqueName: \"kubernetes.io/projected/111fc259-1918-4036-b98c-7fb5b1c7766e-kube-api-access-ppnjb\") pod \"maas-controller-b687c575c-868zl\" (UID: \"111fc259-1918-4036-b98c-7fb5b1c7766e\") " pod="opendatahub/maas-controller-b687c575c-868zl"
Aug 05 19:10:04.040317 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.040229    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/111fc259-1918-4036-b98c-7fb5b1c7766e-webhook-cert\") pod \"maas-controller-b687c575c-868zl\" (UID: \"111fc259-1918-4036-b98c-7fb5b1c7766e\") " pod="opendatahub/maas-controller-b687c575c-868zl"
Aug 05 19:10:04.040317 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.040285    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znf2v\" (UniqueName: \"kubernetes.io/projected/4b4e3ebd-1139-4856-88c2-3c83aa338212-kube-api-access-znf2v\") pod \"maas-controller-c8dd8c4bc-pqw22\" (UID: \"4b4e3ebd-1139-4856-88c2-3c83aa338212\") " pod="opendatahub/maas-controller-c8dd8c4bc-pqw22"
Aug 05 19:10:04.042611 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.042580    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/111fc259-1918-4036-b98c-7fb5b1c7766e-webhook-cert\") pod \"maas-controller-b687c575c-868zl\" (UID: \"111fc259-1918-4036-b98c-7fb5b1c7766e\") " pod="opendatahub/maas-controller-b687c575c-868zl"
Aug 05 19:10:04.047888 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.047863    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppnjb\" (UniqueName: \"kubernetes.io/projected/111fc259-1918-4036-b98c-7fb5b1c7766e-kube-api-access-ppnjb\") pod \"maas-controller-b687c575c-868zl\" (UID: \"111fc259-1918-4036-b98c-7fb5b1c7766e\") " pod="opendatahub/maas-controller-b687c575c-868zl"
Aug 05 19:10:04.130415 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.130325    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b687c575c-868zl"
Aug 05 19:10:04.141698 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.141665    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znf2v\" (UniqueName: \"kubernetes.io/projected/4b4e3ebd-1139-4856-88c2-3c83aa338212-kube-api-access-znf2v\") pod \"maas-controller-c8dd8c4bc-pqw22\" (UID: \"4b4e3ebd-1139-4856-88c2-3c83aa338212\") " pod="opendatahub/maas-controller-c8dd8c4bc-pqw22"
Aug 05 19:10:04.141856 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.141708    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b4e3ebd-1139-4856-88c2-3c83aa338212-webhook-cert\") pod \"maas-controller-c8dd8c4bc-pqw22\" (UID: \"4b4e3ebd-1139-4856-88c2-3c83aa338212\") " pod="opendatahub/maas-controller-c8dd8c4bc-pqw22"
Aug 05 19:10:04.144514 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.144488    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b4e3ebd-1139-4856-88c2-3c83aa338212-webhook-cert\") pod \"maas-controller-c8dd8c4bc-pqw22\" (UID: \"4b4e3ebd-1139-4856-88c2-3c83aa338212\") " pod="opendatahub/maas-controller-c8dd8c4bc-pqw22"
Aug 05 19:10:04.150094 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.150070    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znf2v\" (UniqueName: \"kubernetes.io/projected/4b4e3ebd-1139-4856-88c2-3c83aa338212-kube-api-access-znf2v\") pod \"maas-controller-c8dd8c4bc-pqw22\" (UID: \"4b4e3ebd-1139-4856-88c2-3c83aa338212\") " pod="opendatahub/maas-controller-c8dd8c4bc-pqw22"
Aug 05 19:10:04.261640 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.261614    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b687c575c-868zl"]
Aug 05 19:10:04.263389 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:10:04.263360    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111fc259_1918_4036_b98c_7fb5b1c7766e.slice/crio-6545f16a9a4dcedd4bdf611159e607959c516aaa5f450f22cafaa7ec3b8646b4 WatchSource:0}: Error finding container 6545f16a9a4dcedd4bdf611159e607959c516aaa5f450f22cafaa7ec3b8646b4: Status 404 returned error can't find the container with id 6545f16a9a4dcedd4bdf611159e607959c516aaa5f450f22cafaa7ec3b8646b4
Aug 05 19:10:04.302711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.302672    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8dd8c4bc-pqw22"
Aug 05 19:10:04.336055 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.336017    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b687c575c-868zl" event={"ID":"111fc259-1918-4036-b98c-7fb5b1c7766e","Type":"ContainerStarted","Data":"6545f16a9a4dcedd4bdf611159e607959c516aaa5f450f22cafaa7ec3b8646b4"}
Aug 05 19:10:04.431820 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:04.431796    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-pqw22"]
Aug 05 19:10:04.433661 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:10:04.433621    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4e3ebd_1139_4856_88c2_3c83aa338212.slice/crio-dd7bd9470c00d991761eef4840dee603e50a23866c773364e9975664067f2f17 WatchSource:0}: Error finding container dd7bd9470c00d991761eef4840dee603e50a23866c773364e9975664067f2f17: Status 404 returned error can't find the container with id dd7bd9470c00d991761eef4840dee603e50a23866c773364e9975664067f2f17
Aug 05 19:10:05.348094 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:05.348012    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8dd8c4bc-pqw22" event={"ID":"4b4e3ebd-1139-4856-88c2-3c83aa338212","Type":"ContainerStarted","Data":"dd7bd9470c00d991761eef4840dee603e50a23866c773364e9975664067f2f17"}
Aug 05 19:10:07.360758 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:07.360699    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8dd8c4bc-pqw22" event={"ID":"4b4e3ebd-1139-4856-88c2-3c83aa338212","Type":"ContainerStarted","Data":"d850208f3680951468e853e6714fe4b35dc9e51b252a14ef2f4ed43c9a1fa8a1"}
Aug 05 19:10:07.361248 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:07.360853    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c8dd8c4bc-pqw22"
Aug 05 19:10:07.362277 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:07.362251    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b687c575c-868zl" event={"ID":"111fc259-1918-4036-b98c-7fb5b1c7766e","Type":"ContainerStarted","Data":"26ca17449fa59dc95206b8f53da6075bd90081ab2422300eae7b4b6c320ef6c9"}
Aug 05 19:10:07.362407 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:07.362391    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b687c575c-868zl"
Aug 05 19:10:07.380928 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:07.380875    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c8dd8c4bc-pqw22" podStartSLOduration=1.97412974 podStartE2EDuration="4.38085942s" totalImagesPullingTime="2.40672968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:10:07.38019585 +0000 UTC m=+508.870130957" watchObservedRunningTime="2026-08-05 19:10:07.38085942 +0000 UTC m=+508.870794495"
Aug 05 19:10:07.397511 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:07.397457    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b687c575c-868zl" podStartSLOduration=1.828504645 podStartE2EDuration="4.397439761s" totalImagesPullingTime="2.568935116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:10:07.396188042 +0000 UTC m=+508.886123142" watchObservedRunningTime="2026-08-05 19:10:07.397439761 +0000 UTC m=+508.887374828"
Aug 05 19:10:18.369406 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:18.369374    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c8dd8c4bc-pqw22"
Aug 05 19:10:18.369898 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:18.369458    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b687c575c-868zl"
Aug 05 19:10:18.426246 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:18.426216    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b687c575c-868zl"]
Aug 05 19:10:18.426414 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:18.426396    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b687c575c-868zl" podUID="111fc259-1918-4036-b98c-7fb5b1c7766e" containerName="manager" containerID="cri-o://26ca17449fa59dc95206b8f53da6075bd90081ab2422300eae7b4b6c320ef6c9" gracePeriod=30
Aug 05 19:10:18.672789 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:18.672757    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b687c575c-868zl"
Aug 05 19:10:18.781763 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:18.781727    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/111fc259-1918-4036-b98c-7fb5b1c7766e-webhook-cert\") pod \"111fc259-1918-4036-b98c-7fb5b1c7766e\" (UID: \"111fc259-1918-4036-b98c-7fb5b1c7766e\") "
Aug 05 19:10:18.781763 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:18.781770    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppnjb\" (UniqueName: \"kubernetes.io/projected/111fc259-1918-4036-b98c-7fb5b1c7766e-kube-api-access-ppnjb\") pod \"111fc259-1918-4036-b98c-7fb5b1c7766e\" (UID: \"111fc259-1918-4036-b98c-7fb5b1c7766e\") "
Aug 05 19:10:18.784017 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:18.783965    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/111fc259-1918-4036-b98c-7fb5b1c7766e-kube-api-access-ppnjb" (OuterVolumeSpecName: "kube-api-access-ppnjb") pod "111fc259-1918-4036-b98c-7fb5b1c7766e" (UID: "111fc259-1918-4036-b98c-7fb5b1c7766e"). InnerVolumeSpecName "kube-api-access-ppnjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:10:18.784017 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:18.784012    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/111fc259-1918-4036-b98c-7fb5b1c7766e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "111fc259-1918-4036-b98c-7fb5b1c7766e" (UID: "111fc259-1918-4036-b98c-7fb5b1c7766e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:10:18.882671 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:18.882639    2533 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/111fc259-1918-4036-b98c-7fb5b1c7766e-webhook-cert\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:10:18.882671 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:18.882669    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppnjb\" (UniqueName: \"kubernetes.io/projected/111fc259-1918-4036-b98c-7fb5b1c7766e-kube-api-access-ppnjb\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:10:19.423865 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:19.423826    2533 generic.go:356] "Generic (PLEG): container finished" podID="111fc259-1918-4036-b98c-7fb5b1c7766e" containerID="26ca17449fa59dc95206b8f53da6075bd90081ab2422300eae7b4b6c320ef6c9" exitCode=0
Aug 05 19:10:19.424378 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:19.423896    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b687c575c-868zl"
Aug 05 19:10:19.424378 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:19.423897    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b687c575c-868zl" event={"ID":"111fc259-1918-4036-b98c-7fb5b1c7766e","Type":"ContainerDied","Data":"26ca17449fa59dc95206b8f53da6075bd90081ab2422300eae7b4b6c320ef6c9"}
Aug 05 19:10:19.424378 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:19.424069    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b687c575c-868zl" event={"ID":"111fc259-1918-4036-b98c-7fb5b1c7766e","Type":"ContainerDied","Data":"6545f16a9a4dcedd4bdf611159e607959c516aaa5f450f22cafaa7ec3b8646b4"}
Aug 05 19:10:19.424378 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:19.424092    2533 scope.go:117] "RemoveContainer" containerID="26ca17449fa59dc95206b8f53da6075bd90081ab2422300eae7b4b6c320ef6c9"
Aug 05 19:10:19.433091 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:19.432876    2533 scope.go:117] "RemoveContainer" containerID="26ca17449fa59dc95206b8f53da6075bd90081ab2422300eae7b4b6c320ef6c9"
Aug 05 19:10:19.433230 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:10:19.433210    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ca17449fa59dc95206b8f53da6075bd90081ab2422300eae7b4b6c320ef6c9\": container with ID starting with 26ca17449fa59dc95206b8f53da6075bd90081ab2422300eae7b4b6c320ef6c9 not found: ID does not exist" containerID="26ca17449fa59dc95206b8f53da6075bd90081ab2422300eae7b4b6c320ef6c9"
Aug 05 19:10:19.433274 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:19.433241    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ca17449fa59dc95206b8f53da6075bd90081ab2422300eae7b4b6c320ef6c9"} err="failed to get container status \"26ca17449fa59dc95206b8f53da6075bd90081ab2422300eae7b4b6c320ef6c9\": rpc error: code = NotFound desc = could not find container \"26ca17449fa59dc95206b8f53da6075bd90081ab2422300eae7b4b6c320ef6c9\": container with ID starting with 26ca17449fa59dc95206b8f53da6075bd90081ab2422300eae7b4b6c320ef6c9 not found: ID does not exist"
Aug 05 19:10:19.441818 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:19.441793    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b687c575c-868zl"]
Aug 05 19:10:19.446307 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:19.446284    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b687c575c-868zl"]
Aug 05 19:10:21.012110 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:21.012076    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="111fc259-1918-4036-b98c-7fb5b1c7766e" path="/var/lib/kubelet/pods/111fc259-1918-4036-b98c-7fb5b1c7766e/volumes"
Aug 05 19:10:40.181453 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.181418    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5888db464-bcgqr"]
Aug 05 19:10:40.181921 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.181788    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="111fc259-1918-4036-b98c-7fb5b1c7766e" containerName="manager"
Aug 05 19:10:40.181921 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.181806    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="111fc259-1918-4036-b98c-7fb5b1c7766e" containerName="manager"
Aug 05 19:10:40.181921 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.181886    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="111fc259-1918-4036-b98c-7fb5b1c7766e" containerName="manager"
Aug 05 19:10:40.186723 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.186703    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:40.188753 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.188731    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Aug 05 19:10:40.188893 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.188876    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fsnxv\""
Aug 05 19:10:40.195691 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.195664    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5888db464-bcgqr"]
Aug 05 19:10:40.263145 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.263109    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d88be28-03c5-460e-9940-be5f3dd8ab3b-maas-api-tls\") pod \"maas-api-5888db464-bcgqr\" (UID: \"3d88be28-03c5-460e-9940-be5f3dd8ab3b\") " pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:40.263351 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.263155    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk25b\" (UniqueName: \"kubernetes.io/projected/3d88be28-03c5-460e-9940-be5f3dd8ab3b-kube-api-access-vk25b\") pod \"maas-api-5888db464-bcgqr\" (UID: \"3d88be28-03c5-460e-9940-be5f3dd8ab3b\") " pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:40.263351 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.263283    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d88be28-03c5-460e-9940-be5f3dd8ab3b-openshift-service-ca\") pod \"maas-api-5888db464-bcgqr\" (UID: \"3d88be28-03c5-460e-9940-be5f3dd8ab3b\") " pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:40.364138 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.364097    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d88be28-03c5-460e-9940-be5f3dd8ab3b-openshift-service-ca\") pod \"maas-api-5888db464-bcgqr\" (UID: \"3d88be28-03c5-460e-9940-be5f3dd8ab3b\") " pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:40.364329 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.364162    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d88be28-03c5-460e-9940-be5f3dd8ab3b-maas-api-tls\") pod \"maas-api-5888db464-bcgqr\" (UID: \"3d88be28-03c5-460e-9940-be5f3dd8ab3b\") " pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:40.364329 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.364200    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk25b\" (UniqueName: \"kubernetes.io/projected/3d88be28-03c5-460e-9940-be5f3dd8ab3b-kube-api-access-vk25b\") pod \"maas-api-5888db464-bcgqr\" (UID: \"3d88be28-03c5-460e-9940-be5f3dd8ab3b\") " pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:40.364406 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:10:40.364328    2533 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Aug 05 19:10:40.364440 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:10:40.364404    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d88be28-03c5-460e-9940-be5f3dd8ab3b-maas-api-tls podName:3d88be28-03c5-460e-9940-be5f3dd8ab3b nodeName:}" failed. No retries permitted until 2026-08-05 19:10:40.864384481 +0000 UTC m=+542.354319538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3d88be28-03c5-460e-9940-be5f3dd8ab3b-maas-api-tls") pod "maas-api-5888db464-bcgqr" (UID: "3d88be28-03c5-460e-9940-be5f3dd8ab3b") : secret "maas-api-serving-cert" not found
Aug 05 19:10:40.364869 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.364851    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d88be28-03c5-460e-9940-be5f3dd8ab3b-openshift-service-ca\") pod \"maas-api-5888db464-bcgqr\" (UID: \"3d88be28-03c5-460e-9940-be5f3dd8ab3b\") " pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:40.371971 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.371945    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk25b\" (UniqueName: \"kubernetes.io/projected/3d88be28-03c5-460e-9940-be5f3dd8ab3b-kube-api-access-vk25b\") pod \"maas-api-5888db464-bcgqr\" (UID: \"3d88be28-03c5-460e-9940-be5f3dd8ab3b\") " pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:40.868019 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.867954    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d88be28-03c5-460e-9940-be5f3dd8ab3b-maas-api-tls\") pod \"maas-api-5888db464-bcgqr\" (UID: \"3d88be28-03c5-460e-9940-be5f3dd8ab3b\") " pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:40.870375 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:40.870347    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d88be28-03c5-460e-9940-be5f3dd8ab3b-maas-api-tls\") pod \"maas-api-5888db464-bcgqr\" (UID: \"3d88be28-03c5-460e-9940-be5f3dd8ab3b\") " pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:41.099324 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:41.099292    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:41.236939 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:41.236910    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5888db464-bcgqr"]
Aug 05 19:10:41.238960 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:10:41.238931    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d88be28_03c5_460e_9940_be5f3dd8ab3b.slice/crio-09ff57692be773b67a26b4409954f5bb442e73c55f151e7c34fdc89882b8da65 WatchSource:0}: Error finding container 09ff57692be773b67a26b4409954f5bb442e73c55f151e7c34fdc89882b8da65: Status 404 returned error can't find the container with id 09ff57692be773b67a26b4409954f5bb442e73c55f151e7c34fdc89882b8da65
Aug 05 19:10:41.540594 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:41.540560    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr" event={"ID":"3d88be28-03c5-460e-9940-be5f3dd8ab3b","Type":"ContainerStarted","Data":"09ff57692be773b67a26b4409954f5bb442e73c55f151e7c34fdc89882b8da65"}
Aug 05 19:10:43.552813 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:43.552772    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr" event={"ID":"3d88be28-03c5-460e-9940-be5f3dd8ab3b","Type":"ContainerStarted","Data":"528e197ad455d77bb9301f6122c828f50ea44d1c0ff79764ed7c1cca914b570a"}
Aug 05 19:10:43.553282 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:43.552871    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:43.572057 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:43.572001    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr" podStartSLOduration=1.922971499 podStartE2EDuration="3.571974282s" totalImagesPullingTime="1.649002783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:10:43.569252993 +0000 UTC m=+545.059188090" watchObservedRunningTime="2026-08-05 19:10:43.571974282 +0000 UTC m=+545.061909377"
Aug 05 19:10:49.562726 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:49.562694    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5888db464-bcgqr"
Aug 05 19:10:56.587024 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.586958    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"]
Aug 05 19:10:56.589552 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.589533    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.592585 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.592559    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 05 19:10:56.592711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.592559    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Aug 05 19:10:56.592711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.592559    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8tm4f\""
Aug 05 19:10:56.592711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.592561    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 05 19:10:56.600814 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.600789    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"]
Aug 05 19:10:56.712215 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.712176    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.712215 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.712212    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.712421 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.712242    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.712421 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.712269    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.712421 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.712352    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.712569 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.712439    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgjt5\" (UniqueName: \"kubernetes.io/projected/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-kube-api-access-rgjt5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.813387 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.813345    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgjt5\" (UniqueName: \"kubernetes.io/projected/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-kube-api-access-rgjt5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.813571 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.813401    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.813571 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.813420    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.813571 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.813438    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.813571 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.813461    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.813571 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.813502    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.813893 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.813870    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.813959 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.813913    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.813959 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.813941    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.815644 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.815624    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.815935 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.815919    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.821167 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.821144    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgjt5\" (UniqueName: \"kubernetes.io/projected/b9ef82da-f037-4a35-98fa-4ea8ff07d2c1-kube-api-access-rgjt5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8\" (UID: \"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:56.901314 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:56.901227    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:10:57.033625 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:57.033587    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"]
Aug 05 19:10:57.036691 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:10:57.036661    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ef82da_f037_4a35_98fa_4ea8ff07d2c1.slice/crio-aa023bbee373e8948ca3d08e241eddaa881cb20221041997f84d3e9635476d55 WatchSource:0}: Error finding container aa023bbee373e8948ca3d08e241eddaa881cb20221041997f84d3e9635476d55: Status 404 returned error can't find the container with id aa023bbee373e8948ca3d08e241eddaa881cb20221041997f84d3e9635476d55
Aug 05 19:10:57.624353 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:57.624318    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8" event={"ID":"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1","Type":"ContainerStarted","Data":"aa023bbee373e8948ca3d08e241eddaa881cb20221041997f84d3e9635476d55"}
Aug 05 19:10:59.637484 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:59.637387    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8" event={"ID":"b9ef82da-f037-4a35-98fa-4ea8ff07d2c1","Type":"ContainerStarted","Data":"29e020e7ddf0b51b420d1cf29589ec80588eaa1ac92416da01138c6fbff0b42c"}
Aug 05 19:10:59.653304 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:10:59.653253    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8" podStartSLOduration=1.4813872670000001 podStartE2EDuration="3.65323675s" totalImagesPullingTime="2.171849483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:10:59.652010118 +0000 UTC m=+561.141945213" watchObservedRunningTime="2026-08-05 19:10:59.65323675 +0000 UTC m=+561.143171823"
Aug 05 19:11:06.901759 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:06.901722    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:11:06.902181 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:06.901811    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:11:06.914582 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:06.914547    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:11:07.689254 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:07.689220    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8"
Aug 05 19:11:32.687968 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.687934    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"]
Aug 05 19:11:32.691363 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.691346    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.693566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.693547    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Aug 05 19:11:32.698911 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.698881    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"]
Aug 05 19:11:32.727500 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.727466    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/841efe15-2b0a-4e29-a995-bb51c996f276-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.727693 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.727513    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/841efe15-2b0a-4e29-a995-bb51c996f276-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.727693 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.727561    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/841efe15-2b0a-4e29-a995-bb51c996f276-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.727693 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.727605    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsbct\" (UniqueName: \"kubernetes.io/projected/841efe15-2b0a-4e29-a995-bb51c996f276-kube-api-access-zsbct\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.727693 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.727675    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/841efe15-2b0a-4e29-a995-bb51c996f276-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.727929 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.727703    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/841efe15-2b0a-4e29-a995-bb51c996f276-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.828690 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.828649    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/841efe15-2b0a-4e29-a995-bb51c996f276-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.828690 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.828688    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/841efe15-2b0a-4e29-a995-bb51c996f276-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.828942 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.828814    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/841efe15-2b0a-4e29-a995-bb51c996f276-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.828942 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.828863    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/841efe15-2b0a-4e29-a995-bb51c996f276-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.828942 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.828886    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/841efe15-2b0a-4e29-a995-bb51c996f276-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.828942 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.828910    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsbct\" (UniqueName: \"kubernetes.io/projected/841efe15-2b0a-4e29-a995-bb51c996f276-kube-api-access-zsbct\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.829185 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.829116    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/841efe15-2b0a-4e29-a995-bb51c996f276-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.829185 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.829173    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/841efe15-2b0a-4e29-a995-bb51c996f276-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.829304 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.829283    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/841efe15-2b0a-4e29-a995-bb51c996f276-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.831092 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.831068    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/841efe15-2b0a-4e29-a995-bb51c996f276-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.831257 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.831240    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/841efe15-2b0a-4e29-a995-bb51c996f276-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:32.836407 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:32.836385    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsbct\" (UniqueName: \"kubernetes.io/projected/841efe15-2b0a-4e29-a995-bb51c996f276-kube-api-access-zsbct\") pod \"e2e-trlp-test-simulated-kserve-598466548d-464ld\" (UID: \"841efe15-2b0a-4e29-a995-bb51c996f276\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:33.003091 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:33.002972    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:33.140442 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:33.140414    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"]
Aug 05 19:11:33.141562 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:11:33.141525    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841efe15_2b0a_4e29_a995_bb51c996f276.slice/crio-99c0d13f3e38021759b4cd35c9a680b35f7dedfe8ecbd25d6321d0670eba4e07 WatchSource:0}: Error finding container 99c0d13f3e38021759b4cd35c9a680b35f7dedfe8ecbd25d6321d0670eba4e07: Status 404 returned error can't find the container with id 99c0d13f3e38021759b4cd35c9a680b35f7dedfe8ecbd25d6321d0670eba4e07
Aug 05 19:11:33.824192 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:33.824157    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld" event={"ID":"841efe15-2b0a-4e29-a995-bb51c996f276","Type":"ContainerStarted","Data":"97b23fcf0472932c96c66c10256680217bb42d6d9b04ffdb94f8637f6eaee8ba"}
Aug 05 19:11:33.824580 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:33.824221    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld" event={"ID":"841efe15-2b0a-4e29-a995-bb51c996f276","Type":"ContainerStarted","Data":"99c0d13f3e38021759b4cd35c9a680b35f7dedfe8ecbd25d6321d0670eba4e07"}
Aug 05 19:11:33.841320 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:33.841272    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld" podStartSLOduration=1.642948689 podStartE2EDuration="1.841255828s" totalImagesPullingTime="198.307139ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:11:33.839191169 +0000 UTC m=+595.329126244" watchObservedRunningTime="2026-08-05 19:11:33.841255828 +0000 UTC m=+595.331190902"
Aug 05 19:11:43.003431 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:43.003393    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:43.004059 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:43.003459    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:43.016016 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:43.015966    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:11:43.887769 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:11:43.887739    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-464ld"
Aug 05 19:12:01.380622 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.380540    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"]
Aug 05 19:12:01.384068 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.384040    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.386360 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.386339    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Aug 05 19:12:01.391577 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.391547    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"]
Aug 05 19:12:01.492218 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.492174    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc8b2281-22b6-48d6-a6af-15b8799ce351-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.492404 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.492231    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc8b2281-22b6-48d6-a6af-15b8799ce351-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.492404 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.492298    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc8b2281-22b6-48d6-a6af-15b8799ce351-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.492404 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.492329    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc8b2281-22b6-48d6-a6af-15b8799ce351-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.492404 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.492352    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj4cw\" (UniqueName: \"kubernetes.io/projected/bc8b2281-22b6-48d6-a6af-15b8799ce351-kube-api-access-qj4cw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.492404 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.492378    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc8b2281-22b6-48d6-a6af-15b8799ce351-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.593729 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.593690    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc8b2281-22b6-48d6-a6af-15b8799ce351-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.593729 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.593738    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc8b2281-22b6-48d6-a6af-15b8799ce351-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.594006 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.593778    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc8b2281-22b6-48d6-a6af-15b8799ce351-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.594006 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.593802    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc8b2281-22b6-48d6-a6af-15b8799ce351-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.594006 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.593825    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj4cw\" (UniqueName: \"kubernetes.io/projected/bc8b2281-22b6-48d6-a6af-15b8799ce351-kube-api-access-qj4cw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.594006 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.593856    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc8b2281-22b6-48d6-a6af-15b8799ce351-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.594234 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.594197    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc8b2281-22b6-48d6-a6af-15b8799ce351-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.594292 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.594226    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc8b2281-22b6-48d6-a6af-15b8799ce351-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.594292 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.594279    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc8b2281-22b6-48d6-a6af-15b8799ce351-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.596822 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.596791    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc8b2281-22b6-48d6-a6af-15b8799ce351-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.596926 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.596908    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc8b2281-22b6-48d6-a6af-15b8799ce351-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.601381 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.601361    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj4cw\" (UniqueName: \"kubernetes.io/projected/bc8b2281-22b6-48d6-a6af-15b8799ce351-kube-api-access-qj4cw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl\" (UID: \"bc8b2281-22b6-48d6-a6af-15b8799ce351\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.697161 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.697115    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:01.830899 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.830867    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"]
Aug 05 19:12:01.832440 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:12:01.832414    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc8b2281_22b6_48d6_a6af_15b8799ce351.slice/crio-503e979b7d04c57f28b0ddb198b97a2b1fede84a67ce51e0a0814b1ecd17c211 WatchSource:0}: Error finding container 503e979b7d04c57f28b0ddb198b97a2b1fede84a67ce51e0a0814b1ecd17c211: Status 404 returned error can't find the container with id 503e979b7d04c57f28b0ddb198b97a2b1fede84a67ce51e0a0814b1ecd17c211
Aug 05 19:12:01.968721 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:01.968637    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl" event={"ID":"bc8b2281-22b6-48d6-a6af-15b8799ce351","Type":"ContainerStarted","Data":"503e979b7d04c57f28b0ddb198b97a2b1fede84a67ce51e0a0814b1ecd17c211"}
Aug 05 19:12:02.978606 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:02.978565    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl" event={"ID":"bc8b2281-22b6-48d6-a6af-15b8799ce351","Type":"ContainerStarted","Data":"0744bf0a8d9cc01c397d2d874562bf79ad7a19c0f1e23308e702c82a47c64c6f"}
Aug 05 19:12:02.997141 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:02.997075    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl" podStartSLOduration=1.674379481 podStartE2EDuration="1.997054859s" totalImagesPullingTime="322.675378ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:12:02.994223013 +0000 UTC m=+624.484158093" watchObservedRunningTime="2026-08-05 19:12:02.997054859 +0000 UTC m=+624.486989933"
Aug 05 19:12:11.697996 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:11.697941    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:11.698414 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:11.698030    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:11.710888 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:11.710855    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:12:12.039797 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:12:12.039724    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl"
Aug 05 19:13:35.587863 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:35.587762    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b97c9494b-7zn99"]
Aug 05 19:13:35.588392 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:35.587923    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6b97c9494b-7zn99" podUID="6b993272-88fa-4185-a849-57988e9838a8" containerName="authorino" containerID="cri-o://4bde8d59eb43b3ad8fc7404fa0c6c21bd401f076ca1eca6ab9fc214b1346fe96" gracePeriod=30
Aug 05 19:13:35.835327 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:35.835293    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b97c9494b-7zn99"
Aug 05 19:13:35.953931 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:35.953898    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b993272-88fa-4185-a849-57988e9838a8-tls-cert\") pod \"6b993272-88fa-4185-a849-57988e9838a8\" (UID: \"6b993272-88fa-4185-a849-57988e9838a8\") "
Aug 05 19:13:35.954175 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:35.953954    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vvdh\" (UniqueName: \"kubernetes.io/projected/6b993272-88fa-4185-a849-57988e9838a8-kube-api-access-6vvdh\") pod \"6b993272-88fa-4185-a849-57988e9838a8\" (UID: \"6b993272-88fa-4185-a849-57988e9838a8\") "
Aug 05 19:13:35.956040 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:35.956009    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b993272-88fa-4185-a849-57988e9838a8-kube-api-access-6vvdh" (OuterVolumeSpecName: "kube-api-access-6vvdh") pod "6b993272-88fa-4185-a849-57988e9838a8" (UID: "6b993272-88fa-4185-a849-57988e9838a8"). InnerVolumeSpecName "kube-api-access-6vvdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:13:35.964769 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:35.964739    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b993272-88fa-4185-a849-57988e9838a8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6b993272-88fa-4185-a849-57988e9838a8" (UID: "6b993272-88fa-4185-a849-57988e9838a8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:13:36.055230 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:36.055193    2533 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b993272-88fa-4185-a849-57988e9838a8-tls-cert\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:13:36.055230 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:36.055226    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vvdh\" (UniqueName: \"kubernetes.io/projected/6b993272-88fa-4185-a849-57988e9838a8-kube-api-access-6vvdh\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:13:36.459730 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:36.459695    2533 generic.go:356] "Generic (PLEG): container finished" podID="6b993272-88fa-4185-a849-57988e9838a8" containerID="4bde8d59eb43b3ad8fc7404fa0c6c21bd401f076ca1eca6ab9fc214b1346fe96" exitCode=0
Aug 05 19:13:36.459923 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:36.459760    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b97c9494b-7zn99"
Aug 05 19:13:36.459923 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:36.459787    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b97c9494b-7zn99" event={"ID":"6b993272-88fa-4185-a849-57988e9838a8","Type":"ContainerDied","Data":"4bde8d59eb43b3ad8fc7404fa0c6c21bd401f076ca1eca6ab9fc214b1346fe96"}
Aug 05 19:13:36.459923 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:36.459832    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b97c9494b-7zn99" event={"ID":"6b993272-88fa-4185-a849-57988e9838a8","Type":"ContainerDied","Data":"0deeae1531258c6d919d25643922cf92582299be211dcc1170bcb687e14a3b4b"}
Aug 05 19:13:36.459923 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:36.459853    2533 scope.go:117] "RemoveContainer" containerID="4bde8d59eb43b3ad8fc7404fa0c6c21bd401f076ca1eca6ab9fc214b1346fe96"
Aug 05 19:13:36.472345 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:36.471748    2533 scope.go:117] "RemoveContainer" containerID="4bde8d59eb43b3ad8fc7404fa0c6c21bd401f076ca1eca6ab9fc214b1346fe96"
Aug 05 19:13:36.472345 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:13:36.472297    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bde8d59eb43b3ad8fc7404fa0c6c21bd401f076ca1eca6ab9fc214b1346fe96\": container with ID starting with 4bde8d59eb43b3ad8fc7404fa0c6c21bd401f076ca1eca6ab9fc214b1346fe96 not found: ID does not exist" containerID="4bde8d59eb43b3ad8fc7404fa0c6c21bd401f076ca1eca6ab9fc214b1346fe96"
Aug 05 19:13:36.472556 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:36.472348    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bde8d59eb43b3ad8fc7404fa0c6c21bd401f076ca1eca6ab9fc214b1346fe96"} err="failed to get container status \"4bde8d59eb43b3ad8fc7404fa0c6c21bd401f076ca1eca6ab9fc214b1346fe96\": rpc error: code = NotFound desc = could not find container \"4bde8d59eb43b3ad8fc7404fa0c6c21bd401f076ca1eca6ab9fc214b1346fe96\": container with ID starting with 4bde8d59eb43b3ad8fc7404fa0c6c21bd401f076ca1eca6ab9fc214b1346fe96 not found: ID does not exist"
Aug 05 19:13:36.514544 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:36.514504    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b97c9494b-7zn99"]
Aug 05 19:13:36.529558 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:36.529523    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6b97c9494b-7zn99"]
Aug 05 19:13:37.013069 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:13:37.013034    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b993272-88fa-4185-a849-57988e9838a8" path="/var/lib/kubelet/pods/6b993272-88fa-4185-a849-57988e9838a8/volumes"
Aug 05 19:14:22.357710 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.357673    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-pqw22"]
Aug 05 19:14:22.358197 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.357882    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c8dd8c4bc-pqw22" podUID="4b4e3ebd-1139-4856-88c2-3c83aa338212" containerName="manager" containerID="cri-o://d850208f3680951468e853e6714fe4b35dc9e51b252a14ef2f4ed43c9a1fa8a1" gracePeriod=30
Aug 05 19:14:22.614426 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.614360    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8dd8c4bc-pqw22"
Aug 05 19:14:22.675252 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.675215    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znf2v\" (UniqueName: \"kubernetes.io/projected/4b4e3ebd-1139-4856-88c2-3c83aa338212-kube-api-access-znf2v\") pod \"4b4e3ebd-1139-4856-88c2-3c83aa338212\" (UID: \"4b4e3ebd-1139-4856-88c2-3c83aa338212\") "
Aug 05 19:14:22.675441 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.675369    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b4e3ebd-1139-4856-88c2-3c83aa338212-webhook-cert\") pod \"4b4e3ebd-1139-4856-88c2-3c83aa338212\" (UID: \"4b4e3ebd-1139-4856-88c2-3c83aa338212\") "
Aug 05 19:14:22.677373 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.677344    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4e3ebd-1139-4856-88c2-3c83aa338212-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4b4e3ebd-1139-4856-88c2-3c83aa338212" (UID: "4b4e3ebd-1139-4856-88c2-3c83aa338212"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:14:22.677491 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.677394    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4e3ebd-1139-4856-88c2-3c83aa338212-kube-api-access-znf2v" (OuterVolumeSpecName: "kube-api-access-znf2v") pod "4b4e3ebd-1139-4856-88c2-3c83aa338212" (UID: "4b4e3ebd-1139-4856-88c2-3c83aa338212"). InnerVolumeSpecName "kube-api-access-znf2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:14:22.702186 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.702151    2533 generic.go:356] "Generic (PLEG): container finished" podID="4b4e3ebd-1139-4856-88c2-3c83aa338212" containerID="d850208f3680951468e853e6714fe4b35dc9e51b252a14ef2f4ed43c9a1fa8a1" exitCode=0
Aug 05 19:14:22.702385 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.702215    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8dd8c4bc-pqw22"
Aug 05 19:14:22.702385 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.702231    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8dd8c4bc-pqw22" event={"ID":"4b4e3ebd-1139-4856-88c2-3c83aa338212","Type":"ContainerDied","Data":"d850208f3680951468e853e6714fe4b35dc9e51b252a14ef2f4ed43c9a1fa8a1"}
Aug 05 19:14:22.702385 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.702296    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8dd8c4bc-pqw22" event={"ID":"4b4e3ebd-1139-4856-88c2-3c83aa338212","Type":"ContainerDied","Data":"dd7bd9470c00d991761eef4840dee603e50a23866c773364e9975664067f2f17"}
Aug 05 19:14:22.702385 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.702327    2533 scope.go:117] "RemoveContainer" containerID="d850208f3680951468e853e6714fe4b35dc9e51b252a14ef2f4ed43c9a1fa8a1"
Aug 05 19:14:22.711668 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.711647    2533 scope.go:117] "RemoveContainer" containerID="d850208f3680951468e853e6714fe4b35dc9e51b252a14ef2f4ed43c9a1fa8a1"
Aug 05 19:14:22.712041 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:14:22.712010    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d850208f3680951468e853e6714fe4b35dc9e51b252a14ef2f4ed43c9a1fa8a1\": container with ID starting with d850208f3680951468e853e6714fe4b35dc9e51b252a14ef2f4ed43c9a1fa8a1 not found: ID does not exist" containerID="d850208f3680951468e853e6714fe4b35dc9e51b252a14ef2f4ed43c9a1fa8a1"
Aug 05 19:14:22.712156 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.712050    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d850208f3680951468e853e6714fe4b35dc9e51b252a14ef2f4ed43c9a1fa8a1"} err="failed to get container status \"d850208f3680951468e853e6714fe4b35dc9e51b252a14ef2f4ed43c9a1fa8a1\": rpc error: code = NotFound desc = could not find container \"d850208f3680951468e853e6714fe4b35dc9e51b252a14ef2f4ed43c9a1fa8a1\": container with ID starting with d850208f3680951468e853e6714fe4b35dc9e51b252a14ef2f4ed43c9a1fa8a1 not found: ID does not exist"
Aug 05 19:14:22.733605 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.733557    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-pqw22"]
Aug 05 19:14:22.733808 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.733620    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-pqw22"]
Aug 05 19:14:22.775969 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.775927    2533 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b4e3ebd-1139-4856-88c2-3c83aa338212-webhook-cert\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:14:22.775969 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:22.775962    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znf2v\" (UniqueName: \"kubernetes.io/projected/4b4e3ebd-1139-4856-88c2-3c83aa338212-kube-api-access-znf2v\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:14:23.012468 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:14:23.012423    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b4e3ebd-1139-4856-88c2-3c83aa338212" path="/var/lib/kubelet/pods/4b4e3ebd-1139-4856-88c2-3c83aa338212/volumes"
Aug 05 19:15:00.139414 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.139372    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765955-4pq8h"]
Aug 05 19:15:00.139874 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.139720    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b4e3ebd-1139-4856-88c2-3c83aa338212" containerName="manager"
Aug 05 19:15:00.139874 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.139731    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4e3ebd-1139-4856-88c2-3c83aa338212" containerName="manager"
Aug 05 19:15:00.139874 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.139742    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b993272-88fa-4185-a849-57988e9838a8" containerName="authorino"
Aug 05 19:15:00.139874 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.139748    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b993272-88fa-4185-a849-57988e9838a8" containerName="authorino"
Aug 05 19:15:00.139874 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.139813    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b4e3ebd-1139-4856-88c2-3c83aa338212" containerName="manager"
Aug 05 19:15:00.139874 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.139822    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b993272-88fa-4185-a849-57988e9838a8" containerName="authorino"
Aug 05 19:15:00.142723 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.142707    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765955-4pq8h"
Aug 05 19:15:00.144947 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.144925    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:15:00.149609 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.149578    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765955-4pq8h"]
Aug 05 19:15:00.155195 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.155170    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765955-4pq8h"
Aug 05 19:15:00.285908 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.285878    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765955-4pq8h"]
Aug 05 19:15:00.288114 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:15:00.288088    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65382b78_3f75_4105_8084_1b93fe60b9a9.slice/crio-a16da44700bbb0659343f2216bc50ab517a0dde854ddc1e030bb378f1b41757f WatchSource:0}: Error finding container a16da44700bbb0659343f2216bc50ab517a0dde854ddc1e030bb378f1b41757f: Status 404 returned error can't find the container with id a16da44700bbb0659343f2216bc50ab517a0dde854ddc1e030bb378f1b41757f
Aug 05 19:15:00.290040 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.290020    2533 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 19:15:00.899404 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:00.899371    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765955-4pq8h" event={"ID":"65382b78-3f75-4105-8084-1b93fe60b9a9","Type":"ContainerStarted","Data":"a16da44700bbb0659343f2216bc50ab517a0dde854ddc1e030bb378f1b41757f"}
Aug 05 19:15:03.917374 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:03.917283    2533 generic.go:356] "Generic (PLEG): container finished" podID="65382b78-3f75-4105-8084-1b93fe60b9a9" containerID="42a629baf555a30a792a050d41a65cc9d3d9dc05a631d660367b3d134ef36552" exitCode=0
Aug 05 19:15:03.917745 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:03.917375    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765955-4pq8h" event={"ID":"65382b78-3f75-4105-8084-1b93fe60b9a9","Type":"ContainerDied","Data":"42a629baf555a30a792a050d41a65cc9d3d9dc05a631d660367b3d134ef36552"}
Aug 05 19:15:05.058129 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:05.058103    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765955-4pq8h"
Aug 05 19:15:05.930095 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:05.930064    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765955-4pq8h"
Aug 05 19:15:05.930095 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:05.930090    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765955-4pq8h" event={"ID":"65382b78-3f75-4105-8084-1b93fe60b9a9","Type":"ContainerDied","Data":"a16da44700bbb0659343f2216bc50ab517a0dde854ddc1e030bb378f1b41757f"}
Aug 05 19:15:05.930319 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:05.930138    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a16da44700bbb0659343f2216bc50ab517a0dde854ddc1e030bb378f1b41757f"
Aug 05 19:15:23.485823 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.485783    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-mb9vs"]
Aug 05 19:15:23.486281 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.486192    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65382b78-3f75-4105-8084-1b93fe60b9a9" containerName="cleanup"
Aug 05 19:15:23.486281 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.486209    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="65382b78-3f75-4105-8084-1b93fe60b9a9" containerName="cleanup"
Aug 05 19:15:23.486281 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.486267    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="65382b78-3f75-4105-8084-1b93fe60b9a9" containerName="cleanup"
Aug 05 19:15:23.489682 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.489664    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs"
Aug 05 19:15:23.492925 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.492902    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 05 19:15:23.492925 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.492913    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 05 19:15:23.493139 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.493042    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gnhpv\""
Aug 05 19:15:23.498780 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.498756    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-mb9vs"]
Aug 05 19:15:23.613415 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.613374    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b00a77b-9b33-4c9a-839c-cf5036dbd09a-webhook-cert\") pod \"maas-controller-c8dd8c4bc-mb9vs\" (UID: \"8b00a77b-9b33-4c9a-839c-cf5036dbd09a\") " pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs"
Aug 05 19:15:23.613415 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.613415    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp4bk\" (UniqueName: \"kubernetes.io/projected/8b00a77b-9b33-4c9a-839c-cf5036dbd09a-kube-api-access-mp4bk\") pod \"maas-controller-c8dd8c4bc-mb9vs\" (UID: \"8b00a77b-9b33-4c9a-839c-cf5036dbd09a\") " pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs"
Aug 05 19:15:23.714421 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.714382    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b00a77b-9b33-4c9a-839c-cf5036dbd09a-webhook-cert\") pod \"maas-controller-c8dd8c4bc-mb9vs\" (UID: \"8b00a77b-9b33-4c9a-839c-cf5036dbd09a\") " pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs"
Aug 05 19:15:23.714421 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.714420    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp4bk\" (UniqueName: \"kubernetes.io/projected/8b00a77b-9b33-4c9a-839c-cf5036dbd09a-kube-api-access-mp4bk\") pod \"maas-controller-c8dd8c4bc-mb9vs\" (UID: \"8b00a77b-9b33-4c9a-839c-cf5036dbd09a\") " pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs"
Aug 05 19:15:23.716854 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.716829    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b00a77b-9b33-4c9a-839c-cf5036dbd09a-webhook-cert\") pod \"maas-controller-c8dd8c4bc-mb9vs\" (UID: \"8b00a77b-9b33-4c9a-839c-cf5036dbd09a\") " pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs"
Aug 05 19:15:23.722694 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.722667    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp4bk\" (UniqueName: \"kubernetes.io/projected/8b00a77b-9b33-4c9a-839c-cf5036dbd09a-kube-api-access-mp4bk\") pod \"maas-controller-c8dd8c4bc-mb9vs\" (UID: \"8b00a77b-9b33-4c9a-839c-cf5036dbd09a\") " pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs"
Aug 05 19:15:23.801150 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.801055    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs"
Aug 05 19:15:23.939485 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:23.939452    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-mb9vs"]
Aug 05 19:15:23.942830 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:15:23.942804    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b00a77b_9b33_4c9a_839c_cf5036dbd09a.slice/crio-bf4bf1eb0e4109461f2aff9a1c63af350ffa1e07f064c183957bc5f9dde5b9e0 WatchSource:0}: Error finding container bf4bf1eb0e4109461f2aff9a1c63af350ffa1e07f064c183957bc5f9dde5b9e0: Status 404 returned error can't find the container with id bf4bf1eb0e4109461f2aff9a1c63af350ffa1e07f064c183957bc5f9dde5b9e0
Aug 05 19:15:24.019676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:24.019631    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs" event={"ID":"8b00a77b-9b33-4c9a-839c-cf5036dbd09a","Type":"ContainerStarted","Data":"bf4bf1eb0e4109461f2aff9a1c63af350ffa1e07f064c183957bc5f9dde5b9e0"}
Aug 05 19:15:25.026031 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:25.025979    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs" event={"ID":"8b00a77b-9b33-4c9a-839c-cf5036dbd09a","Type":"ContainerStarted","Data":"eb8d14c04563560478c5c8cbb665d8af10745a156d845696fb978ba174ba9b82"}
Aug 05 19:15:25.026477 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:25.026063    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs"
Aug 05 19:15:25.041109 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:25.041049    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs" podStartSLOduration=1.630016516 podStartE2EDuration="2.041028354s" totalImagesPullingTime="411.011838ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:15:25.040299227 +0000 UTC m=+826.530234301" watchObservedRunningTime="2026-08-05 19:15:25.041028354 +0000 UTC m=+826.530963426"
Aug 05 19:15:36.034368 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:36.034334    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs"
Aug 05 19:15:40.640587 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:40.640550    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-mb9vs"]
Aug 05 19:15:40.641035 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:40.640763    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs" podUID="8b00a77b-9b33-4c9a-839c-cf5036dbd09a" containerName="manager" containerID="cri-o://eb8d14c04563560478c5c8cbb665d8af10745a156d845696fb978ba174ba9b82" gracePeriod=30
Aug 05 19:15:40.890785 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:40.890727    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs"
Aug 05 19:15:40.966533 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:40.966493    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b00a77b-9b33-4c9a-839c-cf5036dbd09a-webhook-cert\") pod \"8b00a77b-9b33-4c9a-839c-cf5036dbd09a\" (UID: \"8b00a77b-9b33-4c9a-839c-cf5036dbd09a\") "
Aug 05 19:15:40.966533 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:40.966534    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp4bk\" (UniqueName: \"kubernetes.io/projected/8b00a77b-9b33-4c9a-839c-cf5036dbd09a-kube-api-access-mp4bk\") pod \"8b00a77b-9b33-4c9a-839c-cf5036dbd09a\" (UID: \"8b00a77b-9b33-4c9a-839c-cf5036dbd09a\") "
Aug 05 19:15:40.968728 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:40.968698    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b00a77b-9b33-4c9a-839c-cf5036dbd09a-kube-api-access-mp4bk" (OuterVolumeSpecName: "kube-api-access-mp4bk") pod "8b00a77b-9b33-4c9a-839c-cf5036dbd09a" (UID: "8b00a77b-9b33-4c9a-839c-cf5036dbd09a"). InnerVolumeSpecName "kube-api-access-mp4bk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:15:40.968848 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:40.968727    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b00a77b-9b33-4c9a-839c-cf5036dbd09a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8b00a77b-9b33-4c9a-839c-cf5036dbd09a" (UID: "8b00a77b-9b33-4c9a-839c-cf5036dbd09a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:15:41.067753 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.067715    2533 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b00a77b-9b33-4c9a-839c-cf5036dbd09a-webhook-cert\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:15:41.067920 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.067803    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp4bk\" (UniqueName: \"kubernetes.io/projected/8b00a77b-9b33-4c9a-839c-cf5036dbd09a-kube-api-access-mp4bk\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:15:41.114109 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.114072    2533 generic.go:356] "Generic (PLEG): container finished" podID="8b00a77b-9b33-4c9a-839c-cf5036dbd09a" containerID="eb8d14c04563560478c5c8cbb665d8af10745a156d845696fb978ba174ba9b82" exitCode=0
Aug 05 19:15:41.114302 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.114138    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs"
Aug 05 19:15:41.114302 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.114165    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs" event={"ID":"8b00a77b-9b33-4c9a-839c-cf5036dbd09a","Type":"ContainerDied","Data":"eb8d14c04563560478c5c8cbb665d8af10745a156d845696fb978ba174ba9b82"}
Aug 05 19:15:41.114302 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.114255    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8dd8c4bc-mb9vs" event={"ID":"8b00a77b-9b33-4c9a-839c-cf5036dbd09a","Type":"ContainerDied","Data":"bf4bf1eb0e4109461f2aff9a1c63af350ffa1e07f064c183957bc5f9dde5b9e0"}
Aug 05 19:15:41.114302 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.114284    2533 scope.go:117] "RemoveContainer" containerID="eb8d14c04563560478c5c8cbb665d8af10745a156d845696fb978ba174ba9b82"
Aug 05 19:15:41.123557 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.123538    2533 scope.go:117] "RemoveContainer" containerID="eb8d14c04563560478c5c8cbb665d8af10745a156d845696fb978ba174ba9b82"
Aug 05 19:15:41.123865 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:15:41.123843    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb8d14c04563560478c5c8cbb665d8af10745a156d845696fb978ba174ba9b82\": container with ID starting with eb8d14c04563560478c5c8cbb665d8af10745a156d845696fb978ba174ba9b82 not found: ID does not exist" containerID="eb8d14c04563560478c5c8cbb665d8af10745a156d845696fb978ba174ba9b82"
Aug 05 19:15:41.123958 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.123872    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8d14c04563560478c5c8cbb665d8af10745a156d845696fb978ba174ba9b82"} err="failed to get container status \"eb8d14c04563560478c5c8cbb665d8af10745a156d845696fb978ba174ba9b82\": rpc error: code = NotFound desc = could not find container \"eb8d14c04563560478c5c8cbb665d8af10745a156d845696fb978ba174ba9b82\": container with ID starting with eb8d14c04563560478c5c8cbb665d8af10745a156d845696fb978ba174ba9b82 not found: ID does not exist"
Aug 05 19:15:41.129963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.129935    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-mb9vs"]
Aug 05 19:15:41.133400 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.133377    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-mb9vs"]
Aug 05 19:15:41.877121 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.877085    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-5qqrr"]
Aug 05 19:15:41.877509 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.877436    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b00a77b-9b33-4c9a-839c-cf5036dbd09a" containerName="manager"
Aug 05 19:15:41.877509 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.877447    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b00a77b-9b33-4c9a-839c-cf5036dbd09a" containerName="manager"
Aug 05 19:15:41.877509 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.877505    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b00a77b-9b33-4c9a-839c-cf5036dbd09a" containerName="manager"
Aug 05 19:15:41.880267 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.880250    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8dd8c4bc-5qqrr"
Aug 05 19:15:41.883319 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.883281    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 05 19:15:41.883319 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.883282    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gnhpv\""
Aug 05 19:15:41.883553 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.883282    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 05 19:15:41.888212 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.888182    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-5qqrr"]
Aug 05 19:15:41.974952 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.974914    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wqqm\" (UniqueName: \"kubernetes.io/projected/3b14284c-b56f-4056-85fc-77857d32ed24-kube-api-access-6wqqm\") pod \"maas-controller-c8dd8c4bc-5qqrr\" (UID: \"3b14284c-b56f-4056-85fc-77857d32ed24\") " pod="opendatahub/maas-controller-c8dd8c4bc-5qqrr"
Aug 05 19:15:41.975176 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:41.974973    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b14284c-b56f-4056-85fc-77857d32ed24-webhook-cert\") pod \"maas-controller-c8dd8c4bc-5qqrr\" (UID: \"3b14284c-b56f-4056-85fc-77857d32ed24\") " pod="opendatahub/maas-controller-c8dd8c4bc-5qqrr"
Aug 05 19:15:42.076573 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:42.076530    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wqqm\" (UniqueName: \"kubernetes.io/projected/3b14284c-b56f-4056-85fc-77857d32ed24-kube-api-access-6wqqm\") pod \"maas-controller-c8dd8c4bc-5qqrr\" (UID: \"3b14284c-b56f-4056-85fc-77857d32ed24\") " pod="opendatahub/maas-controller-c8dd8c4bc-5qqrr"
Aug 05 19:15:42.076788 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:42.076586    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b14284c-b56f-4056-85fc-77857d32ed24-webhook-cert\") pod \"maas-controller-c8dd8c4bc-5qqrr\" (UID: \"3b14284c-b56f-4056-85fc-77857d32ed24\") " pod="opendatahub/maas-controller-c8dd8c4bc-5qqrr"
Aug 05 19:15:42.079059 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:42.079035    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b14284c-b56f-4056-85fc-77857d32ed24-webhook-cert\") pod \"maas-controller-c8dd8c4bc-5qqrr\" (UID: \"3b14284c-b56f-4056-85fc-77857d32ed24\") " pod="opendatahub/maas-controller-c8dd8c4bc-5qqrr"
Aug 05 19:15:42.084789 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:42.084764    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wqqm\" (UniqueName: \"kubernetes.io/projected/3b14284c-b56f-4056-85fc-77857d32ed24-kube-api-access-6wqqm\") pod \"maas-controller-c8dd8c4bc-5qqrr\" (UID: \"3b14284c-b56f-4056-85fc-77857d32ed24\") " pod="opendatahub/maas-controller-c8dd8c4bc-5qqrr"
Aug 05 19:15:42.192595 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:42.192560    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8dd8c4bc-5qqrr"
Aug 05 19:15:42.323931 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:42.323909    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c8dd8c4bc-5qqrr"]
Aug 05 19:15:42.326076 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:15:42.326049    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b14284c_b56f_4056_85fc_77857d32ed24.slice/crio-8762811e3aebce9cd9f21e380bf2e1e5560ec0251e9372ebe602eecc47b0d503 WatchSource:0}: Error finding container 8762811e3aebce9cd9f21e380bf2e1e5560ec0251e9372ebe602eecc47b0d503: Status 404 returned error can't find the container with id 8762811e3aebce9cd9f21e380bf2e1e5560ec0251e9372ebe602eecc47b0d503
Aug 05 19:15:43.012551 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:43.012458    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b00a77b-9b33-4c9a-839c-cf5036dbd09a" path="/var/lib/kubelet/pods/8b00a77b-9b33-4c9a-839c-cf5036dbd09a/volumes"
Aug 05 19:15:43.126473 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:43.126434    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8dd8c4bc-5qqrr" event={"ID":"3b14284c-b56f-4056-85fc-77857d32ed24","Type":"ContainerStarted","Data":"d980522cb47c71ce9cf796321fd964898ba2ad340db9367372291e6a28934d3f"}
Aug 05 19:15:43.126644 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:43.126508    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c8dd8c4bc-5qqrr"
Aug 05 19:15:43.126644 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:43.126526    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8dd8c4bc-5qqrr" event={"ID":"3b14284c-b56f-4056-85fc-77857d32ed24","Type":"ContainerStarted","Data":"8762811e3aebce9cd9f21e380bf2e1e5560ec0251e9372ebe602eecc47b0d503"}
Aug 05 19:15:43.141287 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:43.141235    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c8dd8c4bc-5qqrr" podStartSLOduration=1.788332496 podStartE2EDuration="2.141215624s" totalImagesPullingTime="352.883128ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:15:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:15:43.140849888 +0000 UTC m=+844.630784963" watchObservedRunningTime="2026-08-05 19:15:43.141215624 +0000 UTC m=+844.631150699"
Aug 05 19:15:54.134024 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:15:54.133981    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c8dd8c4bc-5qqrr"
Aug 05 19:26:48.581364 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.581327    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"]
Aug 05 19:26:48.583916 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.583894    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.586270 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.586247    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-ca6ab1d3-kserve-self-signed-certs\""
Aug 05 19:26:48.596283 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.596261    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"]
Aug 05 19:26:48.711600 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.711562    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-dshm\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.711788 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.711620    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-model-cache\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.711788 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.711724    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mrjx\" (UniqueName: \"kubernetes.io/projected/58e9bf3b-cb22-4528-a582-ae5024dc2e22-kube-api-access-6mrjx\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.711788 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.711764    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e9bf3b-cb22-4528-a582-ae5024dc2e22-tls-certs\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.711914 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.711801    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-home\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.711914 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.711825    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-tmp-dir\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.812909 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.812876    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-tmp-dir\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.813121 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.812915    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-dshm\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.813121 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.812952    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-model-cache\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.813211 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.813131    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mrjx\" (UniqueName: \"kubernetes.io/projected/58e9bf3b-cb22-4528-a582-ae5024dc2e22-kube-api-access-6mrjx\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.813211 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.813194    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e9bf3b-cb22-4528-a582-ae5024dc2e22-tls-certs\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.813293 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.813237    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-home\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.813364 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.813343    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-tmp-dir\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.813445 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.813407    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-model-cache\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.813521 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.813505    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-home\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.815208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.815188    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-dshm\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.815727 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.815705    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e9bf3b-cb22-4528-a582-ae5024dc2e22-tls-certs\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.821252 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.821230    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mrjx\" (UniqueName: \"kubernetes.io/projected/58e9bf3b-cb22-4528-a582-ae5024dc2e22-kube-api-access-6mrjx\") pod \"e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") " pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:48.893228 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:48.893146    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:49.031660 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:49.031633    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"]
Aug 05 19:26:49.033964 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:26:49.033934    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58e9bf3b_cb22_4528_a582_ae5024dc2e22.slice/crio-b699461b3b25b22d9b0efe2d67b7d41778b47996e2908b203c07796922c64df6 WatchSource:0}: Error finding container b699461b3b25b22d9b0efe2d67b7d41778b47996e2908b203c07796922c64df6: Status 404 returned error can't find the container with id b699461b3b25b22d9b0efe2d67b7d41778b47996e2908b203c07796922c64df6
Aug 05 19:26:49.543682 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:49.543643    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424" event={"ID":"58e9bf3b-cb22-4528-a582-ae5024dc2e22","Type":"ContainerStarted","Data":"bcd8a0f8148a96c621403b1bac95244eeb60da9eb2b73f6734fb2d939ba4d209"}
Aug 05 19:26:49.543864 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:49.543693    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424" event={"ID":"58e9bf3b-cb22-4528-a582-ae5024dc2e22","Type":"ContainerStarted","Data":"b699461b3b25b22d9b0efe2d67b7d41778b47996e2908b203c07796922c64df6"}
Aug 05 19:26:49.562053 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:49.562003    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424" podStartSLOduration=1.56197273 podStartE2EDuration="1.56197273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:26:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:26:49.559642973 +0000 UTC m=+1511.049578047" watchObservedRunningTime="2026-08-05 19:26:49.56197273 +0000 UTC m=+1511.051907804"
Aug 05 19:26:58.894189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:58.894139    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:58.894586 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:58.894211    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:58.906906 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:58.906873    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:26:59.605655 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:26:59.605627    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:27:11.681333 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:11.681240    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"]
Aug 05 19:27:26.703402 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:26.703358    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424" podUID="58e9bf3b-cb22-4528-a582-ae5024dc2e22" containerName="main" containerID="cri-o://bcd8a0f8148a96c621403b1bac95244eeb60da9eb2b73f6734fb2d939ba4d209" gracePeriod=45
Aug 05 19:27:26.950094 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:26.950066    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:27:27.074536 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.074451    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mrjx\" (UniqueName: \"kubernetes.io/projected/58e9bf3b-cb22-4528-a582-ae5024dc2e22-kube-api-access-6mrjx\") pod \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") "
Aug 05 19:27:27.074536 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.074525    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-tmp-dir\") pod \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") "
Aug 05 19:27:27.074753 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.074555    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-dshm\") pod \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") "
Aug 05 19:27:27.074753 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.074589    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e9bf3b-cb22-4528-a582-ae5024dc2e22-tls-certs\") pod \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") "
Aug 05 19:27:27.074753 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.074637    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-model-cache\") pod \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") "
Aug 05 19:27:27.074753 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.074663    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-home\") pod \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\" (UID: \"58e9bf3b-cb22-4528-a582-ae5024dc2e22\") "
Aug 05 19:27:27.074954 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.074840    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "58e9bf3b-cb22-4528-a582-ae5024dc2e22" (UID: "58e9bf3b-cb22-4528-a582-ae5024dc2e22"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:27:27.075059 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.074947    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-model-cache" (OuterVolumeSpecName: "model-cache") pod "58e9bf3b-cb22-4528-a582-ae5024dc2e22" (UID: "58e9bf3b-cb22-4528-a582-ae5024dc2e22"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:27:27.075059 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.074983    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-home" (OuterVolumeSpecName: "home") pod "58e9bf3b-cb22-4528-a582-ae5024dc2e22" (UID: "58e9bf3b-cb22-4528-a582-ae5024dc2e22"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:27:27.075285 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.075262    2533 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-model-cache\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:27:27.075374 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.075288    2533 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-home\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:27:27.075374 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.075302    2533 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-tmp-dir\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:27:27.076957 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.076931    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-dshm" (OuterVolumeSpecName: "dshm") pod "58e9bf3b-cb22-4528-a582-ae5024dc2e22" (UID: "58e9bf3b-cb22-4528-a582-ae5024dc2e22"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:27:27.076957 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.076945    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e9bf3b-cb22-4528-a582-ae5024dc2e22-kube-api-access-6mrjx" (OuterVolumeSpecName: "kube-api-access-6mrjx") pod "58e9bf3b-cb22-4528-a582-ae5024dc2e22" (UID: "58e9bf3b-cb22-4528-a582-ae5024dc2e22"). InnerVolumeSpecName "kube-api-access-6mrjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:27:27.077102 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.077010    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e9bf3b-cb22-4528-a582-ae5024dc2e22-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "58e9bf3b-cb22-4528-a582-ae5024dc2e22" (UID: "58e9bf3b-cb22-4528-a582-ae5024dc2e22"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:27:27.176689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.176653    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mrjx\" (UniqueName: \"kubernetes.io/projected/58e9bf3b-cb22-4528-a582-ae5024dc2e22-kube-api-access-6mrjx\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:27:27.176689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.176685    2533 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e9bf3b-cb22-4528-a582-ae5024dc2e22-dshm\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:27:27.176689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.176698    2533 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e9bf3b-cb22-4528-a582-ae5024dc2e22-tls-certs\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:27:27.743227 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.743185    2533 generic.go:356] "Generic (PLEG): container finished" podID="58e9bf3b-cb22-4528-a582-ae5024dc2e22" containerID="bcd8a0f8148a96c621403b1bac95244eeb60da9eb2b73f6734fb2d939ba4d209" exitCode=0
Aug 05 19:27:27.743227 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.743213    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424" event={"ID":"58e9bf3b-cb22-4528-a582-ae5024dc2e22","Type":"ContainerDied","Data":"bcd8a0f8148a96c621403b1bac95244eeb60da9eb2b73f6734fb2d939ba4d209"}
Aug 05 19:27:27.743769 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.743253    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"
Aug 05 19:27:27.743769 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.743265    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424" event={"ID":"58e9bf3b-cb22-4528-a582-ae5024dc2e22","Type":"ContainerDied","Data":"b699461b3b25b22d9b0efe2d67b7d41778b47996e2908b203c07796922c64df6"}
Aug 05 19:27:27.743769 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.743283    2533 scope.go:117] "RemoveContainer" containerID="bcd8a0f8148a96c621403b1bac95244eeb60da9eb2b73f6734fb2d939ba4d209"
Aug 05 19:27:27.752533 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.752513    2533 scope.go:117] "RemoveContainer" containerID="bcd8a0f8148a96c621403b1bac95244eeb60da9eb2b73f6734fb2d939ba4d209"
Aug 05 19:27:27.752833 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:27:27.752780    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcd8a0f8148a96c621403b1bac95244eeb60da9eb2b73f6734fb2d939ba4d209\": container with ID starting with bcd8a0f8148a96c621403b1bac95244eeb60da9eb2b73f6734fb2d939ba4d209 not found: ID does not exist" containerID="bcd8a0f8148a96c621403b1bac95244eeb60da9eb2b73f6734fb2d939ba4d209"
Aug 05 19:27:27.752833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.752810    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd8a0f8148a96c621403b1bac95244eeb60da9eb2b73f6734fb2d939ba4d209"} err="failed to get container status \"bcd8a0f8148a96c621403b1bac95244eeb60da9eb2b73f6734fb2d939ba4d209\": rpc error: code = NotFound desc = could not find container \"bcd8a0f8148a96c621403b1bac95244eeb60da9eb2b73f6734fb2d939ba4d209\": container with ID starting with bcd8a0f8148a96c621403b1bac95244eeb60da9eb2b73f6734fb2d939ba4d209 not found: ID does not exist"
Aug 05 19:27:27.765853 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.765824    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"]
Aug 05 19:27:27.767949 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:27.767924    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-ca6ab1d3-kserve-7bfd5b77cf-wh424"]
Aug 05 19:27:29.012033 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:27:29.011981    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58e9bf3b-cb22-4528-a582-ae5024dc2e22" path="/var/lib/kubelet/pods/58e9bf3b-cb22-4528-a582-ae5024dc2e22/volumes"
Aug 05 19:30:00.132682 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:00.132642    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765970-rcmhf"]
Aug 05 19:30:00.134054 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:00.133017    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e9bf3b-cb22-4528-a582-ae5024dc2e22" containerName="main"
Aug 05 19:30:00.134054 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:00.133028    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e9bf3b-cb22-4528-a582-ae5024dc2e22" containerName="main"
Aug 05 19:30:00.134054 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:00.133085    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e9bf3b-cb22-4528-a582-ae5024dc2e22" containerName="main"
Aug 05 19:30:00.134838 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:00.134822    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765970-rcmhf"
Aug 05 19:30:00.137331 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:00.137307    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:30:00.145008 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:00.144961    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765970-rcmhf"
Aug 05 19:30:00.146601 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:00.146559    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765970-rcmhf"]
Aug 05 19:30:00.280862 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:00.280838    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765970-rcmhf"]
Aug 05 19:30:00.282768 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:30:00.282739    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5dfd14_7fef_4297_a5fd_1ee959692c5e.slice/crio-9fd356656c0940639d7ddf3d13c45771658a6f9b1fbcc3038db55d19be2a7ad5 WatchSource:0}: Error finding container 9fd356656c0940639d7ddf3d13c45771658a6f9b1fbcc3038db55d19be2a7ad5: Status 404 returned error can't find the container with id 9fd356656c0940639d7ddf3d13c45771658a6f9b1fbcc3038db55d19be2a7ad5
Aug 05 19:30:00.513388 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:00.513352    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765970-rcmhf" event={"ID":"fd5dfd14-7fef-4297-a5fd-1ee959692c5e","Type":"ContainerStarted","Data":"9fd356656c0940639d7ddf3d13c45771658a6f9b1fbcc3038db55d19be2a7ad5"}
Aug 05 19:30:01.520961 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:01.520928    2533 generic.go:356] "Generic (PLEG): container finished" podID="fd5dfd14-7fef-4297-a5fd-1ee959692c5e" containerID="51c3c0e9600b6bee53dc20bca6610fa58c8cbd8bb26607815c4c4dffe13487ba" exitCode=0
Aug 05 19:30:01.521434 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:01.521023    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765970-rcmhf" event={"ID":"fd5dfd14-7fef-4297-a5fd-1ee959692c5e","Type":"ContainerDied","Data":"51c3c0e9600b6bee53dc20bca6610fa58c8cbd8bb26607815c4c4dffe13487ba"}
Aug 05 19:30:02.657116 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:02.657089    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765970-rcmhf"
Aug 05 19:30:03.531449 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:03.531418    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765970-rcmhf"
Aug 05 19:30:03.531648 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:03.531456    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765970-rcmhf" event={"ID":"fd5dfd14-7fef-4297-a5fd-1ee959692c5e","Type":"ContainerDied","Data":"9fd356656c0940639d7ddf3d13c45771658a6f9b1fbcc3038db55d19be2a7ad5"}
Aug 05 19:30:03.531648 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:30:03.531514    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fd356656c0940639d7ddf3d13c45771658a6f9b1fbcc3038db55d19be2a7ad5"
Aug 05 19:31:15.357611 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.357579    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"]
Aug 05 19:31:15.358117 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.357959    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5dfd14-7fef-4297-a5fd-1ee959692c5e" containerName="cleanup"
Aug 05 19:31:15.358117 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.357970    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5dfd14-7fef-4297-a5fd-1ee959692c5e" containerName="cleanup"
Aug 05 19:31:15.358117 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.358059    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5dfd14-7fef-4297-a5fd-1ee959692c5e" containerName="cleanup"
Aug 05 19:31:15.363523 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.363484    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:15.371866 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.371845    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-aaec4fc4-serving-cert\""
Aug 05 19:31:15.380631 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.380596    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"]
Aug 05 19:31:15.413980 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.413944    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89e07195-5283-47b2-8a80-45ef0e6f320a-maas-api-tls\") pod \"maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv\" (UID: \"89e07195-5283-47b2-8a80-45ef0e6f320a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:15.414208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.414063    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx654\" (UniqueName: \"kubernetes.io/projected/89e07195-5283-47b2-8a80-45ef0e6f320a-kube-api-access-tx654\") pod \"maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv\" (UID: \"89e07195-5283-47b2-8a80-45ef0e6f320a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:15.414208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.414120    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89e07195-5283-47b2-8a80-45ef0e6f320a-openshift-service-ca\") pod \"maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv\" (UID: \"89e07195-5283-47b2-8a80-45ef0e6f320a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:15.515063 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.515017    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89e07195-5283-47b2-8a80-45ef0e6f320a-openshift-service-ca\") pod \"maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv\" (UID: \"89e07195-5283-47b2-8a80-45ef0e6f320a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:15.515268 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.515134    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89e07195-5283-47b2-8a80-45ef0e6f320a-maas-api-tls\") pod \"maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv\" (UID: \"89e07195-5283-47b2-8a80-45ef0e6f320a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:15.515268 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.515182    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx654\" (UniqueName: \"kubernetes.io/projected/89e07195-5283-47b2-8a80-45ef0e6f320a-kube-api-access-tx654\") pod \"maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv\" (UID: \"89e07195-5283-47b2-8a80-45ef0e6f320a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:15.515393 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:31:15.515280    2533 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-serving-cert: secret "maas-api-e2e-ait-aaec4fc4-serving-cert" not found
Aug 05 19:31:15.515393 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:31:15.515357    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89e07195-5283-47b2-8a80-45ef0e6f320a-maas-api-tls podName:89e07195-5283-47b2-8a80-45ef0e6f320a nodeName:}" failed. No retries permitted until 2026-08-05 19:31:16.015339877 +0000 UTC m=+1777.505274929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/89e07195-5283-47b2-8a80-45ef0e6f320a-maas-api-tls") pod "maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv" (UID: "89e07195-5283-47b2-8a80-45ef0e6f320a") : secret "maas-api-e2e-ait-aaec4fc4-serving-cert" not found
Aug 05 19:31:15.515738 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.515714    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89e07195-5283-47b2-8a80-45ef0e6f320a-openshift-service-ca\") pod \"maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv\" (UID: \"89e07195-5283-47b2-8a80-45ef0e6f320a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:15.532081 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:15.532045    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx654\" (UniqueName: \"kubernetes.io/projected/89e07195-5283-47b2-8a80-45ef0e6f320a-kube-api-access-tx654\") pod \"maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv\" (UID: \"89e07195-5283-47b2-8a80-45ef0e6f320a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:16.019303 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:16.019263    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89e07195-5283-47b2-8a80-45ef0e6f320a-maas-api-tls\") pod \"maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv\" (UID: \"89e07195-5283-47b2-8a80-45ef0e6f320a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:16.022177 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:16.022146    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89e07195-5283-47b2-8a80-45ef0e6f320a-maas-api-tls\") pod \"maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv\" (UID: \"89e07195-5283-47b2-8a80-45ef0e6f320a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:16.274586 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:16.274506    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:16.433539 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:16.433516    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"]
Aug 05 19:31:16.435750 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:31:16.435722    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e07195_5283_47b2_8a80_45ef0e6f320a.slice/crio-0f32679083fe5f6912f3fc5043e5607034ee73369195174933406527e595864c WatchSource:0}: Error finding container 0f32679083fe5f6912f3fc5043e5607034ee73369195174933406527e595864c: Status 404 returned error can't find the container with id 0f32679083fe5f6912f3fc5043e5607034ee73369195174933406527e595864c
Aug 05 19:31:16.437445 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:16.437423    2533 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 19:31:16.920219 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:16.920184    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv" event={"ID":"89e07195-5283-47b2-8a80-45ef0e6f320a","Type":"ContainerStarted","Data":"0f32679083fe5f6912f3fc5043e5607034ee73369195174933406527e595864c"}
Aug 05 19:31:17.927969 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:17.927930    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv" event={"ID":"89e07195-5283-47b2-8a80-45ef0e6f320a","Type":"ContainerStarted","Data":"9d6551db16f6195783cfb070d791275eff6cdc27a2f524a6223739c1002076f9"}
Aug 05 19:31:17.928390 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:17.928002    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:17.948543 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:17.948478    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv" podStartSLOduration=2.454953089 podStartE2EDuration="2.948458424s" totalImagesPullingTime="493.505335ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:31:17.947701682 +0000 UTC m=+1779.437636782" watchObservedRunningTime="2026-08-05 19:31:17.948458424 +0000 UTC m=+1779.438393499"
Aug 05 19:31:23.938803 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:23.938767    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:39.729422 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:39.729376    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6"]
Aug 05 19:31:39.733249 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:39.733225    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6"
Aug 05 19:31:39.735765 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:39.735740    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:31:39.750225 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:39.750197    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6"]
Aug 05 19:31:39.827753 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:39.827707    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2fe05f-ccf9-463c-80fd-180bbd68e41b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6\" (UID: \"fb2fe05f-ccf9-463c-80fd-180bbd68e41b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6"
Aug 05 19:31:39.929105 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:39.929060    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2fe05f-ccf9-463c-80fd-180bbd68e41b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6\" (UID: \"fb2fe05f-ccf9-463c-80fd-180bbd68e41b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6"
Aug 05 19:31:39.929743 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:39.929714    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2fe05f-ccf9-463c-80fd-180bbd68e41b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6\" (UID: \"fb2fe05f-ccf9-463c-80fd-180bbd68e41b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6"
Aug 05 19:31:40.043641 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:40.043552    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6"
Aug 05 19:31:40.187101 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:40.187067    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6"]
Aug 05 19:31:40.190636 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:31:40.190604    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2fe05f_ccf9_463c_80fd_180bbd68e41b.slice/crio-7423a63032c965e501882c26a6c7262deb5ee058832d833cd71280fa372b27ce WatchSource:0}: Error finding container 7423a63032c965e501882c26a6c7262deb5ee058832d833cd71280fa372b27ce: Status 404 returned error can't find the container with id 7423a63032c965e501882c26a6c7262deb5ee058832d833cd71280fa372b27ce
Aug 05 19:31:41.058007 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:41.057965    2533 generic.go:356] "Generic (PLEG): container finished" podID="fb2fe05f-ccf9-463c-80fd-180bbd68e41b" containerID="fb5f52a963eac2aa67ab82c0f211df08242190294e84e80b3f904d7961b757a4" exitCode=0
Aug 05 19:31:41.058445 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:41.058055    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6" event={"ID":"fb2fe05f-ccf9-463c-80fd-180bbd68e41b","Type":"ContainerDied","Data":"fb5f52a963eac2aa67ab82c0f211df08242190294e84e80b3f904d7961b757a4"}
Aug 05 19:31:41.058445 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:41.058107    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6" event={"ID":"fb2fe05f-ccf9-463c-80fd-180bbd68e41b","Type":"ContainerStarted","Data":"7423a63032c965e501882c26a6c7262deb5ee058832d833cd71280fa372b27ce"}
Aug 05 19:31:42.193179 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:42.193144    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6"
Aug 05 19:31:42.253685 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:42.253643    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2fe05f-ccf9-463c-80fd-180bbd68e41b-maas-api-service-ca\") pod \"fb2fe05f-ccf9-463c-80fd-180bbd68e41b\" (UID: \"fb2fe05f-ccf9-463c-80fd-180bbd68e41b\") "
Aug 05 19:31:42.254046 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:42.254025    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb2fe05f-ccf9-463c-80fd-180bbd68e41b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fb2fe05f-ccf9-463c-80fd-180bbd68e41b" (UID: "fb2fe05f-ccf9-463c-80fd-180bbd68e41b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:31:42.354519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:42.354439    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2fe05f-ccf9-463c-80fd-180bbd68e41b-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:31:43.070276 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:43.070243    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6" event={"ID":"fb2fe05f-ccf9-463c-80fd-180bbd68e41b","Type":"ContainerDied","Data":"7423a63032c965e501882c26a6c7262deb5ee058832d833cd71280fa372b27ce"}
Aug 05 19:31:43.070451 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:43.070282    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6"
Aug 05 19:31:43.070451 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:43.070322    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7423a63032c965e501882c26a6c7262deb5ee058832d833cd71280fa372b27ce"
Aug 05 19:31:45.973300 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:45.973264    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"]
Aug 05 19:31:45.973811 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:45.973524    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv" podUID="89e07195-5283-47b2-8a80-45ef0e6f320a" containerName="maas-api" containerID="cri-o://9d6551db16f6195783cfb070d791275eff6cdc27a2f524a6223739c1002076f9" gracePeriod=30
Aug 05 19:31:46.207965 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:46.207929    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6"]
Aug 05 19:31:46.210279 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:46.210241    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aaec4fc4-jzdr6"]
Aug 05 19:31:46.233041 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:46.232952    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:46.287745 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:46.287701    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx654\" (UniqueName: \"kubernetes.io/projected/89e07195-5283-47b2-8a80-45ef0e6f320a-kube-api-access-tx654\") pod \"89e07195-5283-47b2-8a80-45ef0e6f320a\" (UID: \"89e07195-5283-47b2-8a80-45ef0e6f320a\") "
Aug 05 19:31:46.287935 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:46.287775    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89e07195-5283-47b2-8a80-45ef0e6f320a-openshift-service-ca\") pod \"89e07195-5283-47b2-8a80-45ef0e6f320a\" (UID: \"89e07195-5283-47b2-8a80-45ef0e6f320a\") "
Aug 05 19:31:46.287935 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:46.287799    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89e07195-5283-47b2-8a80-45ef0e6f320a-maas-api-tls\") pod \"89e07195-5283-47b2-8a80-45ef0e6f320a\" (UID: \"89e07195-5283-47b2-8a80-45ef0e6f320a\") "
Aug 05 19:31:46.288174 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:46.288145    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89e07195-5283-47b2-8a80-45ef0e6f320a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "89e07195-5283-47b2-8a80-45ef0e6f320a" (UID: "89e07195-5283-47b2-8a80-45ef0e6f320a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:31:46.290053 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:46.290021    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89e07195-5283-47b2-8a80-45ef0e6f320a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "89e07195-5283-47b2-8a80-45ef0e6f320a" (UID: "89e07195-5283-47b2-8a80-45ef0e6f320a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:31:46.290178 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:46.290049    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89e07195-5283-47b2-8a80-45ef0e6f320a-kube-api-access-tx654" (OuterVolumeSpecName: "kube-api-access-tx654") pod "89e07195-5283-47b2-8a80-45ef0e6f320a" (UID: "89e07195-5283-47b2-8a80-45ef0e6f320a"). InnerVolumeSpecName "kube-api-access-tx654". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:31:46.388833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:46.388785    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx654\" (UniqueName: \"kubernetes.io/projected/89e07195-5283-47b2-8a80-45ef0e6f320a-kube-api-access-tx654\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:31:46.388833 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:46.388827    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89e07195-5283-47b2-8a80-45ef0e6f320a-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:31:46.389071 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:46.388844    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89e07195-5283-47b2-8a80-45ef0e6f320a-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:31:47.013086 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:47.012983    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb2fe05f-ccf9-463c-80fd-180bbd68e41b" path="/var/lib/kubelet/pods/fb2fe05f-ccf9-463c-80fd-180bbd68e41b/volumes"
Aug 05 19:31:47.092030 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:47.091971    2533 generic.go:356] "Generic (PLEG): container finished" podID="89e07195-5283-47b2-8a80-45ef0e6f320a" containerID="9d6551db16f6195783cfb070d791275eff6cdc27a2f524a6223739c1002076f9" exitCode=0
Aug 05 19:31:47.092030 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:47.092020    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv" event={"ID":"89e07195-5283-47b2-8a80-45ef0e6f320a","Type":"ContainerDied","Data":"9d6551db16f6195783cfb070d791275eff6cdc27a2f524a6223739c1002076f9"}
Aug 05 19:31:47.092242 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:47.092040    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"
Aug 05 19:31:47.092242 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:47.092084    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv" event={"ID":"89e07195-5283-47b2-8a80-45ef0e6f320a","Type":"ContainerDied","Data":"0f32679083fe5f6912f3fc5043e5607034ee73369195174933406527e595864c"}
Aug 05 19:31:47.092242 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:47.092108    2533 scope.go:117] "RemoveContainer" containerID="9d6551db16f6195783cfb070d791275eff6cdc27a2f524a6223739c1002076f9"
Aug 05 19:31:47.101051 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:47.101024    2533 scope.go:117] "RemoveContainer" containerID="9d6551db16f6195783cfb070d791275eff6cdc27a2f524a6223739c1002076f9"
Aug 05 19:31:47.101344 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:31:47.101324    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d6551db16f6195783cfb070d791275eff6cdc27a2f524a6223739c1002076f9\": container with ID starting with 9d6551db16f6195783cfb070d791275eff6cdc27a2f524a6223739c1002076f9 not found: ID does not exist" containerID="9d6551db16f6195783cfb070d791275eff6cdc27a2f524a6223739c1002076f9"
Aug 05 19:31:47.101397 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:47.101355    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d6551db16f6195783cfb070d791275eff6cdc27a2f524a6223739c1002076f9"} err="failed to get container status \"9d6551db16f6195783cfb070d791275eff6cdc27a2f524a6223739c1002076f9\": rpc error: code = NotFound desc = could not find container \"9d6551db16f6195783cfb070d791275eff6cdc27a2f524a6223739c1002076f9\": container with ID starting with 9d6551db16f6195783cfb070d791275eff6cdc27a2f524a6223739c1002076f9 not found: ID does not exist"
Aug 05 19:31:47.110205 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:47.110177    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"]
Aug 05 19:31:47.117012 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:47.116958    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aaec4fc4-d94d99684-7xgbv"]
Aug 05 19:31:49.013150 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.013112    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89e07195-5283-47b2-8a80-45ef0e6f320a" path="/var/lib/kubelet/pods/89e07195-5283-47b2-8a80-45ef0e6f320a/volumes"
Aug 05 19:31:49.843730 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.843690    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"]
Aug 05 19:31:49.844586 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.844559    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb2fe05f-ccf9-463c-80fd-180bbd68e41b" containerName="revoke-keys"
Aug 05 19:31:49.844676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.844588    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb2fe05f-ccf9-463c-80fd-180bbd68e41b" containerName="revoke-keys"
Aug 05 19:31:49.844676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.844603    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e07195-5283-47b2-8a80-45ef0e6f320a" containerName="maas-api"
Aug 05 19:31:49.844676 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.844612    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e07195-5283-47b2-8a80-45ef0e6f320a" containerName="maas-api"
Aug 05 19:31:49.844826 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.844802    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="89e07195-5283-47b2-8a80-45ef0e6f320a" containerName="maas-api"
Aug 05 19:31:49.844878 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.844825    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb2fe05f-ccf9-463c-80fd-180bbd68e41b" containerName="revoke-keys"
Aug 05 19:31:49.851975 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.851949    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:31:49.855917 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.855896    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-bf1161af-serving-cert\""
Aug 05 19:31:49.868486 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.868462    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"]
Aug 05 19:31:49.920894 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.920858    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bckcv\" (UniqueName: \"kubernetes.io/projected/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-kube-api-access-bckcv\") pod \"maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p\" (UID: \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:31:49.921116 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.921012    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-openshift-service-ca\") pod \"maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p\" (UID: \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:31:49.921170 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:49.921121    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-maas-api-tls\") pod \"maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p\" (UID: \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:31:50.021781 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:50.021738    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bckcv\" (UniqueName: \"kubernetes.io/projected/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-kube-api-access-bckcv\") pod \"maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p\" (UID: \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:31:50.022319 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:50.021810    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-openshift-service-ca\") pod \"maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p\" (UID: \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:31:50.022319 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:50.021886    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-maas-api-tls\") pod \"maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p\" (UID: \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:31:50.022556 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:50.022518    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-openshift-service-ca\") pod \"maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p\" (UID: \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:31:50.024355 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:50.024333    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-maas-api-tls\") pod \"maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p\" (UID: \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:31:50.033194 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:50.033172    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bckcv\" (UniqueName: \"kubernetes.io/projected/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-kube-api-access-bckcv\") pod \"maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p\" (UID: \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:31:50.162080 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:50.161958    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:31:50.314880 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:50.314853    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"]
Aug 05 19:31:50.316823 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:31:50.316793    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0af63d9_bc48_4ab3_ac08_2a8d69b511a2.slice/crio-4670121db22480759699b766a8429d9adfe161307087bd81bd3c4d220df00cc1 WatchSource:0}: Error finding container 4670121db22480759699b766a8429d9adfe161307087bd81bd3c4d220df00cc1: Status 404 returned error can't find the container with id 4670121db22480759699b766a8429d9adfe161307087bd81bd3c4d220df00cc1
Aug 05 19:31:51.116561 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:51.116472    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p" event={"ID":"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2","Type":"ContainerStarted","Data":"782c9a48990e9ebe80b447937e4a6d09fd62e0558857f6af0ab329d164310ff0"}
Aug 05 19:31:51.116912 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:51.116672    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:31:51.116912 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:51.116708    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p" event={"ID":"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2","Type":"ContainerStarted","Data":"4670121db22480759699b766a8429d9adfe161307087bd81bd3c4d220df00cc1"}
Aug 05 19:31:51.155105 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:51.155045    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p" podStartSLOduration=1.6533746470000001 podStartE2EDuration="2.155019162s" totalImagesPullingTime="501.644515ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:31:51.15333985 +0000 UTC m=+1812.643274945" watchObservedRunningTime="2026-08-05 19:31:51.155019162 +0000 UTC m=+1812.644954236"
Aug 05 19:31:57.127458 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:31:57.127426    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:32:14.518916 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:14.518873    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn"]
Aug 05 19:32:14.522518 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:14.522496    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn"
Aug 05 19:32:14.525604 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:14.525583    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:32:14.534639 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:14.534609    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn"]
Aug 05 19:32:14.544827 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:14.544787    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7c552d-6379-482e-a2dd-4aa7c69751cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn\" (UID: \"8c7c552d-6379-482e-a2dd-4aa7c69751cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn"
Aug 05 19:32:14.646446 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:14.646406    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7c552d-6379-482e-a2dd-4aa7c69751cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn\" (UID: \"8c7c552d-6379-482e-a2dd-4aa7c69751cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn"
Aug 05 19:32:14.647381 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:14.647356    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7c552d-6379-482e-a2dd-4aa7c69751cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn\" (UID: \"8c7c552d-6379-482e-a2dd-4aa7c69751cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn"
Aug 05 19:32:14.835148 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:14.835046    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn"
Aug 05 19:32:14.981134 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:14.981107    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn"]
Aug 05 19:32:14.983100 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:32:14.983062    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7c552d_6379_482e_a2dd_4aa7c69751cc.slice/crio-8b8dbcafe8c7d9278c05495bb5d82588f22d14ea9bae86a9b46f101c37e5f7a3 WatchSource:0}: Error finding container 8b8dbcafe8c7d9278c05495bb5d82588f22d14ea9bae86a9b46f101c37e5f7a3: Status 404 returned error can't find the container with id 8b8dbcafe8c7d9278c05495bb5d82588f22d14ea9bae86a9b46f101c37e5f7a3
Aug 05 19:32:15.242280 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:15.242238    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn" event={"ID":"8c7c552d-6379-482e-a2dd-4aa7c69751cc","Type":"ContainerStarted","Data":"8b8dbcafe8c7d9278c05495bb5d82588f22d14ea9bae86a9b46f101c37e5f7a3"}
Aug 05 19:32:16.249449 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:16.249413    2533 generic.go:356] "Generic (PLEG): container finished" podID="8c7c552d-6379-482e-a2dd-4aa7c69751cc" containerID="01d614d9e411a9bdcd0437d198516490cba91b48e9202a01d10569a07e2114a4" exitCode=0
Aug 05 19:32:16.249852 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:16.249464    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn" event={"ID":"8c7c552d-6379-482e-a2dd-4aa7c69751cc","Type":"ContainerDied","Data":"01d614d9e411a9bdcd0437d198516490cba91b48e9202a01d10569a07e2114a4"}
Aug 05 19:32:17.385744 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:17.385718    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn"
Aug 05 19:32:17.472740 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:17.472701    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7c552d-6379-482e-a2dd-4aa7c69751cc-maas-api-service-ca\") pod \"8c7c552d-6379-482e-a2dd-4aa7c69751cc\" (UID: \"8c7c552d-6379-482e-a2dd-4aa7c69751cc\") "
Aug 05 19:32:17.473056 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:17.473035    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c7c552d-6379-482e-a2dd-4aa7c69751cc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8c7c552d-6379-482e-a2dd-4aa7c69751cc" (UID: "8c7c552d-6379-482e-a2dd-4aa7c69751cc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:32:17.573815 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:17.573734    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7c552d-6379-482e-a2dd-4aa7c69751cc-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:32:18.261294 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:18.261259    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn" event={"ID":"8c7c552d-6379-482e-a2dd-4aa7c69751cc","Type":"ContainerDied","Data":"8b8dbcafe8c7d9278c05495bb5d82588f22d14ea9bae86a9b46f101c37e5f7a3"}
Aug 05 19:32:18.261482 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:18.261314    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b8dbcafe8c7d9278c05495bb5d82588f22d14ea9bae86a9b46f101c37e5f7a3"
Aug 05 19:32:18.261482 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:18.261276    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn"
Aug 05 19:32:21.322418 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.322384    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"]
Aug 05 19:32:21.322903 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.322641    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p" podUID="d0af63d9-bc48-4ab3-ac08-2a8d69b511a2" containerName="maas-api" containerID="cri-o://782c9a48990e9ebe80b447937e4a6d09fd62e0558857f6af0ab329d164310ff0" gracePeriod=30
Aug 05 19:32:21.567783 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.567756    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:32:21.610092 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.610003    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn"]
Aug 05 19:32:21.612924 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.612756    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-openshift-service-ca\") pod \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\" (UID: \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\") "
Aug 05 19:32:21.612924 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.612803    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bckcv\" (UniqueName: \"kubernetes.io/projected/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-kube-api-access-bckcv\") pod \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\" (UID: \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\") "
Aug 05 19:32:21.612924 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.612859    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-maas-api-tls\") pod \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\" (UID: \"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2\") "
Aug 05 19:32:21.613959 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.613822    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d0af63d9-bc48-4ab3-ac08-2a8d69b511a2" (UID: "d0af63d9-bc48-4ab3-ac08-2a8d69b511a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:32:21.615438 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.615406    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-kube-api-access-bckcv" (OuterVolumeSpecName: "kube-api-access-bckcv") pod "d0af63d9-bc48-4ab3-ac08-2a8d69b511a2" (UID: "d0af63d9-bc48-4ab3-ac08-2a8d69b511a2"). InnerVolumeSpecName "kube-api-access-bckcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:32:21.615438 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.615416    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d0af63d9-bc48-4ab3-ac08-2a8d69b511a2" (UID: "d0af63d9-bc48-4ab3-ac08-2a8d69b511a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:32:21.616685 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.616656    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bf1161af-52cbn"]
Aug 05 19:32:21.714544 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.714514    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:32:21.714544 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.714541    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:32:21.714544 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:21.714553    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bckcv\" (UniqueName: \"kubernetes.io/projected/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2-kube-api-access-bckcv\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:32:22.283039 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:22.282940    2533 generic.go:356] "Generic (PLEG): container finished" podID="d0af63d9-bc48-4ab3-ac08-2a8d69b511a2" containerID="782c9a48990e9ebe80b447937e4a6d09fd62e0558857f6af0ab329d164310ff0" exitCode=0
Aug 05 19:32:22.283039 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:22.283005    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"
Aug 05 19:32:22.283039 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:22.283029    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p" event={"ID":"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2","Type":"ContainerDied","Data":"782c9a48990e9ebe80b447937e4a6d09fd62e0558857f6af0ab329d164310ff0"}
Aug 05 19:32:22.283284 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:22.283101    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p" event={"ID":"d0af63d9-bc48-4ab3-ac08-2a8d69b511a2","Type":"ContainerDied","Data":"4670121db22480759699b766a8429d9adfe161307087bd81bd3c4d220df00cc1"}
Aug 05 19:32:22.283284 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:22.283134    2533 scope.go:117] "RemoveContainer" containerID="782c9a48990e9ebe80b447937e4a6d09fd62e0558857f6af0ab329d164310ff0"
Aug 05 19:32:22.293204 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:22.293183    2533 scope.go:117] "RemoveContainer" containerID="782c9a48990e9ebe80b447937e4a6d09fd62e0558857f6af0ab329d164310ff0"
Aug 05 19:32:22.293541 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:32:22.293517    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"782c9a48990e9ebe80b447937e4a6d09fd62e0558857f6af0ab329d164310ff0\": container with ID starting with 782c9a48990e9ebe80b447937e4a6d09fd62e0558857f6af0ab329d164310ff0 not found: ID does not exist" containerID="782c9a48990e9ebe80b447937e4a6d09fd62e0558857f6af0ab329d164310ff0"
Aug 05 19:32:22.293615 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:22.293557    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"782c9a48990e9ebe80b447937e4a6d09fd62e0558857f6af0ab329d164310ff0"} err="failed to get container status \"782c9a48990e9ebe80b447937e4a6d09fd62e0558857f6af0ab329d164310ff0\": rpc error: code = NotFound desc = could not find container \"782c9a48990e9ebe80b447937e4a6d09fd62e0558857f6af0ab329d164310ff0\": container with ID starting with 782c9a48990e9ebe80b447937e4a6d09fd62e0558857f6af0ab329d164310ff0 not found: ID does not exist"
Aug 05 19:32:22.308149 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:22.308115    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"]
Aug 05 19:32:22.318809 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:22.318780    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bf1161af-6cdc59d8b6-z2s8p"]
Aug 05 19:32:23.014282 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:23.014247    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c7c552d-6379-482e-a2dd-4aa7c69751cc" path="/var/lib/kubelet/pods/8c7c552d-6379-482e-a2dd-4aa7c69751cc/volumes"
Aug 05 19:32:23.014671 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:23.014636    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0af63d9-bc48-4ab3-ac08-2a8d69b511a2" path="/var/lib/kubelet/pods/d0af63d9-bc48-4ab3-ac08-2a8d69b511a2/volumes"
Aug 05 19:32:25.736954 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.736904    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"]
Aug 05 19:32:25.737355 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.737328    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0af63d9-bc48-4ab3-ac08-2a8d69b511a2" containerName="maas-api"
Aug 05 19:32:25.737355 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.737341    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0af63d9-bc48-4ab3-ac08-2a8d69b511a2" containerName="maas-api"
Aug 05 19:32:25.737355 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.737350    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7c552d-6379-482e-a2dd-4aa7c69751cc" containerName="revoke-keys"
Aug 05 19:32:25.737355 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.737355    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7c552d-6379-482e-a2dd-4aa7c69751cc" containerName="revoke-keys"
Aug 05 19:32:25.737486 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.737412    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c7c552d-6379-482e-a2dd-4aa7c69751cc" containerName="revoke-keys"
Aug 05 19:32:25.737486 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.737423    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0af63d9-bc48-4ab3-ac08-2a8d69b511a2" containerName="maas-api"
Aug 05 19:32:25.741725 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.741706    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:25.744713 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.744693    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e3501887-serving-cert\""
Aug 05 19:32:25.756155 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.756130    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"]
Aug 05 19:32:25.854080 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.854047    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/016a2b39-6e40-464c-b13a-a768cc797761-openshift-service-ca\") pod \"maas-api-e2e-ait-e3501887-67445895bb-sj2t4\" (UID: \"016a2b39-6e40-464c-b13a-a768cc797761\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:25.854233 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.854101    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2kdq\" (UniqueName: \"kubernetes.io/projected/016a2b39-6e40-464c-b13a-a768cc797761-kube-api-access-f2kdq\") pod \"maas-api-e2e-ait-e3501887-67445895bb-sj2t4\" (UID: \"016a2b39-6e40-464c-b13a-a768cc797761\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:25.854233 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.854202    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/016a2b39-6e40-464c-b13a-a768cc797761-maas-api-tls\") pod \"maas-api-e2e-ait-e3501887-67445895bb-sj2t4\" (UID: \"016a2b39-6e40-464c-b13a-a768cc797761\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:25.955004 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.954959    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/016a2b39-6e40-464c-b13a-a768cc797761-maas-api-tls\") pod \"maas-api-e2e-ait-e3501887-67445895bb-sj2t4\" (UID: \"016a2b39-6e40-464c-b13a-a768cc797761\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:25.955196 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.955110    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/016a2b39-6e40-464c-b13a-a768cc797761-openshift-service-ca\") pod \"maas-api-e2e-ait-e3501887-67445895bb-sj2t4\" (UID: \"016a2b39-6e40-464c-b13a-a768cc797761\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:25.955196 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.955157    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2kdq\" (UniqueName: \"kubernetes.io/projected/016a2b39-6e40-464c-b13a-a768cc797761-kube-api-access-f2kdq\") pod \"maas-api-e2e-ait-e3501887-67445895bb-sj2t4\" (UID: \"016a2b39-6e40-464c-b13a-a768cc797761\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:25.955296 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:32:25.955159    2533 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-serving-cert: secret "maas-api-e2e-ait-e3501887-serving-cert" not found
Aug 05 19:32:25.955334 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:32:25.955312    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/016a2b39-6e40-464c-b13a-a768cc797761-maas-api-tls podName:016a2b39-6e40-464c-b13a-a768cc797761 nodeName:}" failed. No retries permitted until 2026-08-05 19:32:26.455289528 +0000 UTC m=+1847.945224579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/016a2b39-6e40-464c-b13a-a768cc797761-maas-api-tls") pod "maas-api-e2e-ait-e3501887-67445895bb-sj2t4" (UID: "016a2b39-6e40-464c-b13a-a768cc797761") : secret "maas-api-e2e-ait-e3501887-serving-cert" not found
Aug 05 19:32:25.955772 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.955753    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/016a2b39-6e40-464c-b13a-a768cc797761-openshift-service-ca\") pod \"maas-api-e2e-ait-e3501887-67445895bb-sj2t4\" (UID: \"016a2b39-6e40-464c-b13a-a768cc797761\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:25.964851 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:25.964826    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2kdq\" (UniqueName: \"kubernetes.io/projected/016a2b39-6e40-464c-b13a-a768cc797761-kube-api-access-f2kdq\") pod \"maas-api-e2e-ait-e3501887-67445895bb-sj2t4\" (UID: \"016a2b39-6e40-464c-b13a-a768cc797761\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:26.462040 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:26.461979    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/016a2b39-6e40-464c-b13a-a768cc797761-maas-api-tls\") pod \"maas-api-e2e-ait-e3501887-67445895bb-sj2t4\" (UID: \"016a2b39-6e40-464c-b13a-a768cc797761\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:26.464408 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:26.464371    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/016a2b39-6e40-464c-b13a-a768cc797761-maas-api-tls\") pod \"maas-api-e2e-ait-e3501887-67445895bb-sj2t4\" (UID: \"016a2b39-6e40-464c-b13a-a768cc797761\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:26.651673 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:26.651631    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:26.794548 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:26.794519    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"]
Aug 05 19:32:26.796048 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:32:26.796019    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016a2b39_6e40_464c_b13a_a768cc797761.slice/crio-2bbc437c37b8e498c959a087f16dba1482ae89686d04efeea32e55c319c6e14b WatchSource:0}: Error finding container 2bbc437c37b8e498c959a087f16dba1482ae89686d04efeea32e55c319c6e14b: Status 404 returned error can't find the container with id 2bbc437c37b8e498c959a087f16dba1482ae89686d04efeea32e55c319c6e14b
Aug 05 19:32:27.311727 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:27.311689    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4" event={"ID":"016a2b39-6e40-464c-b13a-a768cc797761","Type":"ContainerStarted","Data":"d41952ddaf2b411b75fd5a5f92380080a1aef5a3d93e670532c06e890bf76dea"}
Aug 05 19:32:27.311910 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:27.311747    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4" event={"ID":"016a2b39-6e40-464c-b13a-a768cc797761","Type":"ContainerStarted","Data":"2bbc437c37b8e498c959a087f16dba1482ae89686d04efeea32e55c319c6e14b"}
Aug 05 19:32:27.311910 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:27.311795    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:27.340912 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:27.340859    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4" podStartSLOduration=1.922643385 podStartE2EDuration="2.340839923s" totalImagesPullingTime="418.196538ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:32:27.338107676 +0000 UTC m=+1848.828042773" watchObservedRunningTime="2026-08-05 19:32:27.340839923 +0000 UTC m=+1848.830774997"
Aug 05 19:32:33.323776 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:33.323744    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:50.491651 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:50.491599    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq"]
Aug 05 19:32:50.501495 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:50.501432    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq"
Aug 05 19:32:50.503874 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:50.503838    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq"]
Aug 05 19:32:50.504732 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:50.504708    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:32:50.568649 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:50.568613    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12257f14-2b3e-4097-8e7a-181a87d7815c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e3501887-g9zxq\" (UID: \"12257f14-2b3e-4097-8e7a-181a87d7815c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq"
Aug 05 19:32:50.670102 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:50.670057    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12257f14-2b3e-4097-8e7a-181a87d7815c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e3501887-g9zxq\" (UID: \"12257f14-2b3e-4097-8e7a-181a87d7815c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq"
Aug 05 19:32:50.670711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:50.670691    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12257f14-2b3e-4097-8e7a-181a87d7815c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e3501887-g9zxq\" (UID: \"12257f14-2b3e-4097-8e7a-181a87d7815c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq"
Aug 05 19:32:50.813646 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:50.813554    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq"
Aug 05 19:32:50.954419 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:50.954380    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq"]
Aug 05 19:32:50.958291 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:32:50.958261    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12257f14_2b3e_4097_8e7a_181a87d7815c.slice/crio-825033655ee9091a5da4261132285daa8346067cc8531587d6f5b44dce997b8c WatchSource:0}: Error finding container 825033655ee9091a5da4261132285daa8346067cc8531587d6f5b44dce997b8c: Status 404 returned error can't find the container with id 825033655ee9091a5da4261132285daa8346067cc8531587d6f5b44dce997b8c
Aug 05 19:32:51.440019 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:51.439955    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq" event={"ID":"12257f14-2b3e-4097-8e7a-181a87d7815c","Type":"ContainerStarted","Data":"17f56f745d58d7ec46bcd0ad451caf6b7b0a06a838eceecec2107a3070a4837c"}
Aug 05 19:32:51.440019 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:51.440026    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq" event={"ID":"12257f14-2b3e-4097-8e7a-181a87d7815c","Type":"ContainerStarted","Data":"825033655ee9091a5da4261132285daa8346067cc8531587d6f5b44dce997b8c"}
Aug 05 19:32:51.461111 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:51.461037    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq" podStartSLOduration=1.461017485 podStartE2EDuration="1.461017485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:32:51.460121391 +0000 UTC m=+1872.950056503" watchObservedRunningTime="2026-08-05 19:32:51.461017485 +0000 UTC m=+1872.950952554"
Aug 05 19:32:52.446352 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:52.446315    2533 generic.go:356] "Generic (PLEG): container finished" podID="12257f14-2b3e-4097-8e7a-181a87d7815c" containerID="17f56f745d58d7ec46bcd0ad451caf6b7b0a06a838eceecec2107a3070a4837c" exitCode=0
Aug 05 19:32:52.446751 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:52.446376    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq" event={"ID":"12257f14-2b3e-4097-8e7a-181a87d7815c","Type":"ContainerDied","Data":"17f56f745d58d7ec46bcd0ad451caf6b7b0a06a838eceecec2107a3070a4837c"}
Aug 05 19:32:53.582393 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:53.582364    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq"
Aug 05 19:32:53.594733 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:53.594706    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12257f14-2b3e-4097-8e7a-181a87d7815c-maas-api-service-ca\") pod \"12257f14-2b3e-4097-8e7a-181a87d7815c\" (UID: \"12257f14-2b3e-4097-8e7a-181a87d7815c\") "
Aug 05 19:32:53.595087 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:53.595061    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12257f14-2b3e-4097-8e7a-181a87d7815c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "12257f14-2b3e-4097-8e7a-181a87d7815c" (UID: "12257f14-2b3e-4097-8e7a-181a87d7815c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:32:53.695594 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:53.695550    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12257f14-2b3e-4097-8e7a-181a87d7815c-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:32:54.458039 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:54.458011    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq"
Aug 05 19:32:54.458214 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:54.458041    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq" event={"ID":"12257f14-2b3e-4097-8e7a-181a87d7815c","Type":"ContainerDied","Data":"825033655ee9091a5da4261132285daa8346067cc8531587d6f5b44dce997b8c"}
Aug 05 19:32:54.458214 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:54.458089    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="825033655ee9091a5da4261132285daa8346067cc8531587d6f5b44dce997b8c"
Aug 05 19:32:56.704036 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:56.703984    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"]
Aug 05 19:32:56.704521 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:56.704291    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4" podUID="016a2b39-6e40-464c-b13a-a768cc797761" containerName="maas-api" containerID="cri-o://d41952ddaf2b411b75fd5a5f92380080a1aef5a3d93e670532c06e890bf76dea" gracePeriod=30
Aug 05 19:32:56.959176 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:56.959108    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:57.022227 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.022194    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/016a2b39-6e40-464c-b13a-a768cc797761-maas-api-tls\") pod \"016a2b39-6e40-464c-b13a-a768cc797761\" (UID: \"016a2b39-6e40-464c-b13a-a768cc797761\") "
Aug 05 19:32:57.022416 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.022232    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/016a2b39-6e40-464c-b13a-a768cc797761-openshift-service-ca\") pod \"016a2b39-6e40-464c-b13a-a768cc797761\" (UID: \"016a2b39-6e40-464c-b13a-a768cc797761\") "
Aug 05 19:32:57.022416 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.022366    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2kdq\" (UniqueName: \"kubernetes.io/projected/016a2b39-6e40-464c-b13a-a768cc797761-kube-api-access-f2kdq\") pod \"016a2b39-6e40-464c-b13a-a768cc797761\" (UID: \"016a2b39-6e40-464c-b13a-a768cc797761\") "
Aug 05 19:32:57.022630 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.022607    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016a2b39-6e40-464c-b13a-a768cc797761-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "016a2b39-6e40-464c-b13a-a768cc797761" (UID: "016a2b39-6e40-464c-b13a-a768cc797761"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:32:57.022716 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.022685    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/016a2b39-6e40-464c-b13a-a768cc797761-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:32:57.024432 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.024407    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016a2b39-6e40-464c-b13a-a768cc797761-kube-api-access-f2kdq" (OuterVolumeSpecName: "kube-api-access-f2kdq") pod "016a2b39-6e40-464c-b13a-a768cc797761" (UID: "016a2b39-6e40-464c-b13a-a768cc797761"). InnerVolumeSpecName "kube-api-access-f2kdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:32:57.024614 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.024594    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016a2b39-6e40-464c-b13a-a768cc797761-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "016a2b39-6e40-464c-b13a-a768cc797761" (UID: "016a2b39-6e40-464c-b13a-a768cc797761"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:32:57.060233 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.060191    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq"]
Aug 05 19:32:57.072687 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.072655    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3501887-g9zxq"]
Aug 05 19:32:57.124079 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.124035    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2kdq\" (UniqueName: \"kubernetes.io/projected/016a2b39-6e40-464c-b13a-a768cc797761-kube-api-access-f2kdq\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:32:57.124079 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.124064    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/016a2b39-6e40-464c-b13a-a768cc797761-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:32:57.476112 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.476077    2533 generic.go:356] "Generic (PLEG): container finished" podID="016a2b39-6e40-464c-b13a-a768cc797761" containerID="d41952ddaf2b411b75fd5a5f92380080a1aef5a3d93e670532c06e890bf76dea" exitCode=0
Aug 05 19:32:57.476295 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.476124    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"
Aug 05 19:32:57.476295 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.476159    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4" event={"ID":"016a2b39-6e40-464c-b13a-a768cc797761","Type":"ContainerDied","Data":"d41952ddaf2b411b75fd5a5f92380080a1aef5a3d93e670532c06e890bf76dea"}
Aug 05 19:32:57.476295 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.476214    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4" event={"ID":"016a2b39-6e40-464c-b13a-a768cc797761","Type":"ContainerDied","Data":"2bbc437c37b8e498c959a087f16dba1482ae89686d04efeea32e55c319c6e14b"}
Aug 05 19:32:57.476295 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.476238    2533 scope.go:117] "RemoveContainer" containerID="d41952ddaf2b411b75fd5a5f92380080a1aef5a3d93e670532c06e890bf76dea"
Aug 05 19:32:57.488346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.488325    2533 scope.go:117] "RemoveContainer" containerID="d41952ddaf2b411b75fd5a5f92380080a1aef5a3d93e670532c06e890bf76dea"
Aug 05 19:32:57.488670 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:32:57.488647    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d41952ddaf2b411b75fd5a5f92380080a1aef5a3d93e670532c06e890bf76dea\": container with ID starting with d41952ddaf2b411b75fd5a5f92380080a1aef5a3d93e670532c06e890bf76dea not found: ID does not exist" containerID="d41952ddaf2b411b75fd5a5f92380080a1aef5a3d93e670532c06e890bf76dea"
Aug 05 19:32:57.488733 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.488680    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d41952ddaf2b411b75fd5a5f92380080a1aef5a3d93e670532c06e890bf76dea"} err="failed to get container status \"d41952ddaf2b411b75fd5a5f92380080a1aef5a3d93e670532c06e890bf76dea\": rpc error: code = NotFound desc = could not find container \"d41952ddaf2b411b75fd5a5f92380080a1aef5a3d93e670532c06e890bf76dea\": container with ID starting with d41952ddaf2b411b75fd5a5f92380080a1aef5a3d93e670532c06e890bf76dea not found: ID does not exist"
Aug 05 19:32:57.504419 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.504361    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"]
Aug 05 19:32:57.506947 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:57.506919    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3501887-67445895bb-sj2t4"]
Aug 05 19:32:59.012869 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:59.012837    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016a2b39-6e40-464c-b13a-a768cc797761" path="/var/lib/kubelet/pods/016a2b39-6e40-464c-b13a-a768cc797761/volumes"
Aug 05 19:32:59.013289 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:32:59.013219    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12257f14-2b3e-4097-8e7a-181a87d7815c" path="/var/lib/kubelet/pods/12257f14-2b3e-4097-8e7a-181a87d7815c/volumes"
Aug 05 19:33:03.000400 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.000317    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"]
Aug 05 19:33:03.000867 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.000847    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016a2b39-6e40-464c-b13a-a768cc797761" containerName="maas-api"
Aug 05 19:33:03.000958 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.000871    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="016a2b39-6e40-464c-b13a-a768cc797761" containerName="maas-api"
Aug 05 19:33:03.000958 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.000898    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12257f14-2b3e-4097-8e7a-181a87d7815c" containerName="revoke-keys"
Aug 05 19:33:03.000958 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.000907    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="12257f14-2b3e-4097-8e7a-181a87d7815c" containerName="revoke-keys"
Aug 05 19:33:03.001142 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.001060    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="12257f14-2b3e-4097-8e7a-181a87d7815c" containerName="revoke-keys"
Aug 05 19:33:03.001142 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.001080    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="016a2b39-6e40-464c-b13a-a768cc797761" containerName="maas-api"
Aug 05 19:33:03.005372 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.005351    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:03.008142 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.008121    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-61891be0-serving-cert\""
Aug 05 19:33:03.027048 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.027014    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"]
Aug 05 19:33:03.086349 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.086304    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f62lg\" (UniqueName: \"kubernetes.io/projected/ca06d4f0-ad49-4386-9abb-92927a6a988d-kube-api-access-f62lg\") pod \"maas-api-e2e-derive-61891be0-7c9557c596-4wwbk\" (UID: \"ca06d4f0-ad49-4386-9abb-92927a6a988d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:03.086538 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.086363    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca06d4f0-ad49-4386-9abb-92927a6a988d-maas-api-tls\") pod \"maas-api-e2e-derive-61891be0-7c9557c596-4wwbk\" (UID: \"ca06d4f0-ad49-4386-9abb-92927a6a988d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:03.086538 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.086404    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca06d4f0-ad49-4386-9abb-92927a6a988d-openshift-service-ca\") pod \"maas-api-e2e-derive-61891be0-7c9557c596-4wwbk\" (UID: \"ca06d4f0-ad49-4386-9abb-92927a6a988d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:03.187662 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.187620    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f62lg\" (UniqueName: \"kubernetes.io/projected/ca06d4f0-ad49-4386-9abb-92927a6a988d-kube-api-access-f62lg\") pod \"maas-api-e2e-derive-61891be0-7c9557c596-4wwbk\" (UID: \"ca06d4f0-ad49-4386-9abb-92927a6a988d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:03.187843 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.187672    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca06d4f0-ad49-4386-9abb-92927a6a988d-maas-api-tls\") pod \"maas-api-e2e-derive-61891be0-7c9557c596-4wwbk\" (UID: \"ca06d4f0-ad49-4386-9abb-92927a6a988d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:03.187843 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.187701    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca06d4f0-ad49-4386-9abb-92927a6a988d-openshift-service-ca\") pod \"maas-api-e2e-derive-61891be0-7c9557c596-4wwbk\" (UID: \"ca06d4f0-ad49-4386-9abb-92927a6a988d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:03.187979 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:33:03.187837    2533 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-serving-cert: secret "maas-api-e2e-derive-61891be0-serving-cert" not found
Aug 05 19:33:03.187979 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:33:03.187920    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca06d4f0-ad49-4386-9abb-92927a6a988d-maas-api-tls podName:ca06d4f0-ad49-4386-9abb-92927a6a988d nodeName:}" failed. No retries permitted until 2026-08-05 19:33:03.687897433 +0000 UTC m=+1885.177832497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca06d4f0-ad49-4386-9abb-92927a6a988d-maas-api-tls") pod "maas-api-e2e-derive-61891be0-7c9557c596-4wwbk" (UID: "ca06d4f0-ad49-4386-9abb-92927a6a988d") : secret "maas-api-e2e-derive-61891be0-serving-cert" not found
Aug 05 19:33:03.188452 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.188428    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca06d4f0-ad49-4386-9abb-92927a6a988d-openshift-service-ca\") pod \"maas-api-e2e-derive-61891be0-7c9557c596-4wwbk\" (UID: \"ca06d4f0-ad49-4386-9abb-92927a6a988d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:03.204291 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.204259    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f62lg\" (UniqueName: \"kubernetes.io/projected/ca06d4f0-ad49-4386-9abb-92927a6a988d-kube-api-access-f62lg\") pod \"maas-api-e2e-derive-61891be0-7c9557c596-4wwbk\" (UID: \"ca06d4f0-ad49-4386-9abb-92927a6a988d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:03.692695 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.692660    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca06d4f0-ad49-4386-9abb-92927a6a988d-maas-api-tls\") pod \"maas-api-e2e-derive-61891be0-7c9557c596-4wwbk\" (UID: \"ca06d4f0-ad49-4386-9abb-92927a6a988d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:03.695155 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.695132    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca06d4f0-ad49-4386-9abb-92927a6a988d-maas-api-tls\") pod \"maas-api-e2e-derive-61891be0-7c9557c596-4wwbk\" (UID: \"ca06d4f0-ad49-4386-9abb-92927a6a988d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:03.916195 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:03.916062    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:04.064071 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:04.064043    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"]
Aug 05 19:33:04.066525 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:33:04.066497    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca06d4f0_ad49_4386_9abb_92927a6a988d.slice/crio-a805d9ad891c36605a8dcad5fd875945cb22da7c710a0c1684036a144e352224 WatchSource:0}: Error finding container a805d9ad891c36605a8dcad5fd875945cb22da7c710a0c1684036a144e352224: Status 404 returned error can't find the container with id a805d9ad891c36605a8dcad5fd875945cb22da7c710a0c1684036a144e352224
Aug 05 19:33:04.513972 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:04.513937    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk" event={"ID":"ca06d4f0-ad49-4386-9abb-92927a6a988d","Type":"ContainerStarted","Data":"a805d9ad891c36605a8dcad5fd875945cb22da7c710a0c1684036a144e352224"}
Aug 05 19:33:05.520687 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:05.520651    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk" event={"ID":"ca06d4f0-ad49-4386-9abb-92927a6a988d","Type":"ContainerStarted","Data":"47c36a21366587ff14302694080259fae14457caaa70c1e3173b4b06608053f1"}
Aug 05 19:33:05.521098 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:05.520774    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:05.542101 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:05.542031    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk" podStartSLOduration=3.05032327 podStartE2EDuration="3.542009833s" totalImagesPullingTime="491.686563ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:33:05.541452308 +0000 UTC m=+1887.031387415" watchObservedRunningTime="2026-08-05 19:33:05.542009833 +0000 UTC m=+1887.031944898"
Aug 05 19:33:11.538882 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:11.538851    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:26.694198 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:26.694157    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx"]
Aug 05 19:33:26.697912 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:26.697892    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx"
Aug 05 19:33:26.700459 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:26.700440    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:33:26.705707 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:26.705671    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx"]
Aug 05 19:33:26.711193 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:26.711163    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a083177a-5be5-4f15-99dc-b7c97b2dbb28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-61891be0-wh6dx\" (UID: \"a083177a-5be5-4f15-99dc-b7c97b2dbb28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx"
Aug 05 19:33:26.811871 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:26.811830    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a083177a-5be5-4f15-99dc-b7c97b2dbb28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-61891be0-wh6dx\" (UID: \"a083177a-5be5-4f15-99dc-b7c97b2dbb28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx"
Aug 05 19:33:26.812530 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:26.812508    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a083177a-5be5-4f15-99dc-b7c97b2dbb28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-61891be0-wh6dx\" (UID: \"a083177a-5be5-4f15-99dc-b7c97b2dbb28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx"
Aug 05 19:33:27.010302 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:27.010224    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx"
Aug 05 19:33:27.146489 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:27.146433    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx"]
Aug 05 19:33:27.149683 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:33:27.149649    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda083177a_5be5_4f15_99dc_b7c97b2dbb28.slice/crio-14898b92706fc8fb7d672f4e1d636dcb88ded05fc0407c1f22b17c55ce64c88e WatchSource:0}: Error finding container 14898b92706fc8fb7d672f4e1d636dcb88ded05fc0407c1f22b17c55ce64c88e: Status 404 returned error can't find the container with id 14898b92706fc8fb7d672f4e1d636dcb88ded05fc0407c1f22b17c55ce64c88e
Aug 05 19:33:27.649593 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:27.649492    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx" event={"ID":"a083177a-5be5-4f15-99dc-b7c97b2dbb28","Type":"ContainerStarted","Data":"dc006c70992e074c24a321bb2afe2724221ab2094b22802ebe47c73a400f8999"}
Aug 05 19:33:27.649593 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:27.649549    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx" event={"ID":"a083177a-5be5-4f15-99dc-b7c97b2dbb28","Type":"ContainerStarted","Data":"14898b92706fc8fb7d672f4e1d636dcb88ded05fc0407c1f22b17c55ce64c88e"}
Aug 05 19:33:27.667144 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:27.667093    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx" podStartSLOduration=1.667070024 podStartE2EDuration="1.667070024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:33:27.664871376 +0000 UTC m=+1909.154806451" watchObservedRunningTime="2026-08-05 19:33:27.667070024 +0000 UTC m=+1909.157005097"
Aug 05 19:33:28.655707 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:28.655676    2533 generic.go:356] "Generic (PLEG): container finished" podID="a083177a-5be5-4f15-99dc-b7c97b2dbb28" containerID="dc006c70992e074c24a321bb2afe2724221ab2094b22802ebe47c73a400f8999" exitCode=0
Aug 05 19:33:28.656177 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:28.655766    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx" event={"ID":"a083177a-5be5-4f15-99dc-b7c97b2dbb28","Type":"ContainerDied","Data":"dc006c70992e074c24a321bb2afe2724221ab2094b22802ebe47c73a400f8999"}
Aug 05 19:33:29.803919 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:29.803891    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx"
Aug 05 19:33:29.834470 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:29.834441    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a083177a-5be5-4f15-99dc-b7c97b2dbb28-maas-api-service-ca\") pod \"a083177a-5be5-4f15-99dc-b7c97b2dbb28\" (UID: \"a083177a-5be5-4f15-99dc-b7c97b2dbb28\") "
Aug 05 19:33:29.834873 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:29.834847    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a083177a-5be5-4f15-99dc-b7c97b2dbb28-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a083177a-5be5-4f15-99dc-b7c97b2dbb28" (UID: "a083177a-5be5-4f15-99dc-b7c97b2dbb28"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:33:29.935275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:29.935243    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a083177a-5be5-4f15-99dc-b7c97b2dbb28-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:33:30.668287 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:30.668260    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx"
Aug 05 19:33:30.668487 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:30.668305    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx" event={"ID":"a083177a-5be5-4f15-99dc-b7c97b2dbb28","Type":"ContainerDied","Data":"14898b92706fc8fb7d672f4e1d636dcb88ded05fc0407c1f22b17c55ce64c88e"}
Aug 05 19:33:30.668487 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:30.668360    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14898b92706fc8fb7d672f4e1d636dcb88ded05fc0407c1f22b17c55ce64c88e"
Aug 05 19:33:33.936173 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:33.936128    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"]
Aug 05 19:33:33.936653 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:33.936373    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk" podUID="ca06d4f0-ad49-4386-9abb-92927a6a988d" containerName="maas-api" containerID="cri-o://47c36a21366587ff14302694080259fae14457caaa70c1e3173b4b06608053f1" gracePeriod=30
Aug 05 19:33:34.205462 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.205433    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:34.266943 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.266913    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca06d4f0-ad49-4386-9abb-92927a6a988d-openshift-service-ca\") pod \"ca06d4f0-ad49-4386-9abb-92927a6a988d\" (UID: \"ca06d4f0-ad49-4386-9abb-92927a6a988d\") "
Aug 05 19:33:34.266943 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.266946    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca06d4f0-ad49-4386-9abb-92927a6a988d-maas-api-tls\") pod \"ca06d4f0-ad49-4386-9abb-92927a6a988d\" (UID: \"ca06d4f0-ad49-4386-9abb-92927a6a988d\") "
Aug 05 19:33:34.267338 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.267314    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca06d4f0-ad49-4386-9abb-92927a6a988d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca06d4f0-ad49-4386-9abb-92927a6a988d" (UID: "ca06d4f0-ad49-4386-9abb-92927a6a988d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:33:34.269129 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.269092    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca06d4f0-ad49-4386-9abb-92927a6a988d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca06d4f0-ad49-4386-9abb-92927a6a988d" (UID: "ca06d4f0-ad49-4386-9abb-92927a6a988d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:33:34.367802 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.367761    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f62lg\" (UniqueName: \"kubernetes.io/projected/ca06d4f0-ad49-4386-9abb-92927a6a988d-kube-api-access-f62lg\") pod \"ca06d4f0-ad49-4386-9abb-92927a6a988d\" (UID: \"ca06d4f0-ad49-4386-9abb-92927a6a988d\") "
Aug 05 19:33:34.368064 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.368046    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca06d4f0-ad49-4386-9abb-92927a6a988d-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:33:34.368127 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.368070    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca06d4f0-ad49-4386-9abb-92927a6a988d-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:33:34.369789 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.369754    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca06d4f0-ad49-4386-9abb-92927a6a988d-kube-api-access-f62lg" (OuterVolumeSpecName: "kube-api-access-f62lg") pod "ca06d4f0-ad49-4386-9abb-92927a6a988d" (UID: "ca06d4f0-ad49-4386-9abb-92927a6a988d"). InnerVolumeSpecName "kube-api-access-f62lg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:33:34.390386 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.390355    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx"]
Aug 05 19:33:34.401272 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.401239    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-61891be0-wh6dx"]
Aug 05 19:33:34.468926 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.468843    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f62lg\" (UniqueName: \"kubernetes.io/projected/ca06d4f0-ad49-4386-9abb-92927a6a988d-kube-api-access-f62lg\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:33:34.692043 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.692003    2533 generic.go:356] "Generic (PLEG): container finished" podID="ca06d4f0-ad49-4386-9abb-92927a6a988d" containerID="47c36a21366587ff14302694080259fae14457caaa70c1e3173b4b06608053f1" exitCode=0
Aug 05 19:33:34.692203 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.692054    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"
Aug 05 19:33:34.692203 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.692090    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk" event={"ID":"ca06d4f0-ad49-4386-9abb-92927a6a988d","Type":"ContainerDied","Data":"47c36a21366587ff14302694080259fae14457caaa70c1e3173b4b06608053f1"}
Aug 05 19:33:34.692203 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.692144    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk" event={"ID":"ca06d4f0-ad49-4386-9abb-92927a6a988d","Type":"ContainerDied","Data":"a805d9ad891c36605a8dcad5fd875945cb22da7c710a0c1684036a144e352224"}
Aug 05 19:33:34.692203 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.692167    2533 scope.go:117] "RemoveContainer" containerID="47c36a21366587ff14302694080259fae14457caaa70c1e3173b4b06608053f1"
Aug 05 19:33:34.701403 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.701384    2533 scope.go:117] "RemoveContainer" containerID="47c36a21366587ff14302694080259fae14457caaa70c1e3173b4b06608053f1"
Aug 05 19:33:34.701698 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:33:34.701678    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47c36a21366587ff14302694080259fae14457caaa70c1e3173b4b06608053f1\": container with ID starting with 47c36a21366587ff14302694080259fae14457caaa70c1e3173b4b06608053f1 not found: ID does not exist" containerID="47c36a21366587ff14302694080259fae14457caaa70c1e3173b4b06608053f1"
Aug 05 19:33:34.701763 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.701711    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47c36a21366587ff14302694080259fae14457caaa70c1e3173b4b06608053f1"} err="failed to get container status \"47c36a21366587ff14302694080259fae14457caaa70c1e3173b4b06608053f1\": rpc error: code = NotFound desc = could not find container \"47c36a21366587ff14302694080259fae14457caaa70c1e3173b4b06608053f1\": container with ID starting with 47c36a21366587ff14302694080259fae14457caaa70c1e3173b4b06608053f1 not found: ID does not exist"
Aug 05 19:33:34.728794 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.728705    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"]
Aug 05 19:33:34.732730 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:34.732703    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-61891be0-7c9557c596-4wwbk"]
Aug 05 19:33:35.013723 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:35.013641    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a083177a-5be5-4f15-99dc-b7c97b2dbb28" path="/var/lib/kubelet/pods/a083177a-5be5-4f15-99dc-b7c97b2dbb28/volumes"
Aug 05 19:33:35.014102 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:33:35.014038    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca06d4f0-ad49-4386-9abb-92927a6a988d" path="/var/lib/kubelet/pods/ca06d4f0-ad49-4386-9abb-92927a6a988d/volumes"
Aug 05 19:35:37.308408 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.308369    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"]
Aug 05 19:35:37.310887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.308736    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca06d4f0-ad49-4386-9abb-92927a6a988d" containerName="maas-api"
Aug 05 19:35:37.310887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.308747    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca06d4f0-ad49-4386-9abb-92927a6a988d" containerName="maas-api"
Aug 05 19:35:37.310887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.308758    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a083177a-5be5-4f15-99dc-b7c97b2dbb28" containerName="revoke-keys"
Aug 05 19:35:37.310887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.308763    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="a083177a-5be5-4f15-99dc-b7c97b2dbb28" containerName="revoke-keys"
Aug 05 19:35:37.310887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.308814    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="a083177a-5be5-4f15-99dc-b7c97b2dbb28" containerName="revoke-keys"
Aug 05 19:35:37.310887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.308823    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca06d4f0-ad49-4386-9abb-92927a6a988d" containerName="maas-api"
Aug 05 19:35:37.311899 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.311880    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:35:37.314426 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.314405    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-82a4c5b4-serving-cert\""
Aug 05 19:35:37.324351 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.324325    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"]
Aug 05 19:35:37.352693 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.352658    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fbrl\" (UniqueName: \"kubernetes.io/projected/60c21a4b-b0d1-4083-beec-85a2797a0ea0-kube-api-access-8fbrl\") pod \"maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf\" (UID: \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:35:37.352693 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.352698    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c21a4b-b0d1-4083-beec-85a2797a0ea0-maas-api-tls\") pod \"maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf\" (UID: \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:35:37.352910 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.352766    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c21a4b-b0d1-4083-beec-85a2797a0ea0-openshift-service-ca\") pod \"maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf\" (UID: \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:35:37.453220 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.453178    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fbrl\" (UniqueName: \"kubernetes.io/projected/60c21a4b-b0d1-4083-beec-85a2797a0ea0-kube-api-access-8fbrl\") pod \"maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf\" (UID: \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:35:37.453220 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.453223    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c21a4b-b0d1-4083-beec-85a2797a0ea0-maas-api-tls\") pod \"maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf\" (UID: \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:35:37.453441 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.453268    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c21a4b-b0d1-4083-beec-85a2797a0ea0-openshift-service-ca\") pod \"maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf\" (UID: \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:35:37.453484 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:35:37.453429    2533 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-serving-cert: secret "maas-api-e2e-mt-82a4c5b4-serving-cert" not found
Aug 05 19:35:37.453537 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:35:37.453524    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60c21a4b-b0d1-4083-beec-85a2797a0ea0-maas-api-tls podName:60c21a4b-b0d1-4083-beec-85a2797a0ea0 nodeName:}" failed. No retries permitted until 2026-08-05 19:35:37.9535018 +0000 UTC m=+2039.443436857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/60c21a4b-b0d1-4083-beec-85a2797a0ea0-maas-api-tls") pod "maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf" (UID: "60c21a4b-b0d1-4083-beec-85a2797a0ea0") : secret "maas-api-e2e-mt-82a4c5b4-serving-cert" not found
Aug 05 19:35:37.453885 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.453869    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c21a4b-b0d1-4083-beec-85a2797a0ea0-openshift-service-ca\") pod \"maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf\" (UID: \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:35:37.462721 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.462695    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fbrl\" (UniqueName: \"kubernetes.io/projected/60c21a4b-b0d1-4083-beec-85a2797a0ea0-kube-api-access-8fbrl\") pod \"maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf\" (UID: \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:35:37.956812 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.956774    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c21a4b-b0d1-4083-beec-85a2797a0ea0-maas-api-tls\") pod \"maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf\" (UID: \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:35:37.959294 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:37.959258    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c21a4b-b0d1-4083-beec-85a2797a0ea0-maas-api-tls\") pod \"maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf\" (UID: \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:35:38.222397 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:38.222293    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:35:38.361043 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:38.361018    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"]
Aug 05 19:35:38.362909 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:35:38.362878    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c21a4b_b0d1_4083_beec_85a2797a0ea0.slice/crio-494035cd2287decca0b44ec73675e6573219ad69432070c6bc935f649d7be13e WatchSource:0}: Error finding container 494035cd2287decca0b44ec73675e6573219ad69432070c6bc935f649d7be13e: Status 404 returned error can't find the container with id 494035cd2287decca0b44ec73675e6573219ad69432070c6bc935f649d7be13e
Aug 05 19:35:38.370646 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:38.370617    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf" event={"ID":"60c21a4b-b0d1-4083-beec-85a2797a0ea0","Type":"ContainerStarted","Data":"494035cd2287decca0b44ec73675e6573219ad69432070c6bc935f649d7be13e"}
Aug 05 19:35:39.377400 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:39.377358    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf" event={"ID":"60c21a4b-b0d1-4083-beec-85a2797a0ea0","Type":"ContainerStarted","Data":"d6f4447e750af6d03d001f12ca9598bceb8ccc36593446e1029a5a7c0733514e"}
Aug 05 19:35:39.377849 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:39.377444    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:35:39.398586 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:39.398530    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf" podStartSLOduration=1.956306608 podStartE2EDuration="2.398511169s" totalImagesPullingTime="442.204561ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:35:39.396810987 +0000 UTC m=+2040.886746063" watchObservedRunningTime="2026-08-05 19:35:39.398511169 +0000 UTC m=+2040.888446243"
Aug 05 19:35:45.389710 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:35:45.389678    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:36:08.388895 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:08.388809    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx"]
Aug 05 19:36:08.393591 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:08.393469    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx"
Aug 05 19:36:08.396888 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:08.396671    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:36:08.400586 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:08.400550    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx"]
Aug 05 19:36:08.532936 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:08.532894    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx\" (UID: \"2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx"
Aug 05 19:36:08.634367 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:08.634329    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx\" (UID: \"2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx"
Aug 05 19:36:08.635050 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:08.635027    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx\" (UID: \"2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx"
Aug 05 19:36:08.707956 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:08.707915    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx"
Aug 05 19:36:08.844081 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:08.844022    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx"]
Aug 05 19:36:08.847073 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:36:08.847039    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2febd0b0_b7b2_4c91_9fc7_92b0eb4b8add.slice/crio-8d17b9645d7f1fcaba0a54a27e79b74db4b0581b0b773234cbf9eb652cf6613f WatchSource:0}: Error finding container 8d17b9645d7f1fcaba0a54a27e79b74db4b0581b0b773234cbf9eb652cf6613f: Status 404 returned error can't find the container with id 8d17b9645d7f1fcaba0a54a27e79b74db4b0581b0b773234cbf9eb652cf6613f
Aug 05 19:36:09.551623 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:09.551596    2533 generic.go:356] "Generic (PLEG): container finished" podID="2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add" containerID="1c48445fc98c8c0375cadd1fd6a4b58272cae9cd05b7bef2eb54ac8ab8643570" exitCode=0
Aug 05 19:36:09.551951 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:09.551658    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx" event={"ID":"2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add","Type":"ContainerDied","Data":"1c48445fc98c8c0375cadd1fd6a4b58272cae9cd05b7bef2eb54ac8ab8643570"}
Aug 05 19:36:09.551951 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:09.551708    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx" event={"ID":"2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add","Type":"ContainerStarted","Data":"8d17b9645d7f1fcaba0a54a27e79b74db4b0581b0b773234cbf9eb652cf6613f"}
Aug 05 19:36:10.692750 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:10.692718    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx"
Aug 05 19:36:10.854078 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:10.853952    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add-maas-api-service-ca\") pod \"2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add\" (UID: \"2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add\") "
Aug 05 19:36:10.854357 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:10.854328    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add" (UID: "2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:36:10.955146 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:10.955107    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:36:11.563521 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:11.563489    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx"
Aug 05 19:36:11.563726 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:11.563537    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx" event={"ID":"2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add","Type":"ContainerDied","Data":"8d17b9645d7f1fcaba0a54a27e79b74db4b0581b0b773234cbf9eb652cf6613f"}
Aug 05 19:36:11.563726 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:11.563589    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d17b9645d7f1fcaba0a54a27e79b74db4b0581b0b773234cbf9eb652cf6613f"
Aug 05 19:36:18.831695 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:18.831667    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"]
Aug 05 19:36:18.832311 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:18.831863    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf" podUID="60c21a4b-b0d1-4083-beec-85a2797a0ea0" containerName="maas-api" containerID="cri-o://d6f4447e750af6d03d001f12ca9598bceb8ccc36593446e1029a5a7c0733514e" gracePeriod=30
Aug 05 19:36:19.066285 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.066256    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx"]
Aug 05 19:36:19.070658 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.070627    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-82a4c5b4-l68zx"]
Aug 05 19:36:19.083763 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.083623    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:36:19.230609 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.230574    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fbrl\" (UniqueName: \"kubernetes.io/projected/60c21a4b-b0d1-4083-beec-85a2797a0ea0-kube-api-access-8fbrl\") pod \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\" (UID: \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\") "
Aug 05 19:36:19.230783 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.230635    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c21a4b-b0d1-4083-beec-85a2797a0ea0-maas-api-tls\") pod \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\" (UID: \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\") "
Aug 05 19:36:19.230783 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.230682    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c21a4b-b0d1-4083-beec-85a2797a0ea0-openshift-service-ca\") pod \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\" (UID: \"60c21a4b-b0d1-4083-beec-85a2797a0ea0\") "
Aug 05 19:36:19.231121 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.231078    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60c21a4b-b0d1-4083-beec-85a2797a0ea0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "60c21a4b-b0d1-4083-beec-85a2797a0ea0" (UID: "60c21a4b-b0d1-4083-beec-85a2797a0ea0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:36:19.232664 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.232640    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60c21a4b-b0d1-4083-beec-85a2797a0ea0-kube-api-access-8fbrl" (OuterVolumeSpecName: "kube-api-access-8fbrl") pod "60c21a4b-b0d1-4083-beec-85a2797a0ea0" (UID: "60c21a4b-b0d1-4083-beec-85a2797a0ea0"). InnerVolumeSpecName "kube-api-access-8fbrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:36:19.232751 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.232710    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60c21a4b-b0d1-4083-beec-85a2797a0ea0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "60c21a4b-b0d1-4083-beec-85a2797a0ea0" (UID: "60c21a4b-b0d1-4083-beec-85a2797a0ea0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:36:19.331519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.331476    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c21a4b-b0d1-4083-beec-85a2797a0ea0-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:36:19.331519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.331510    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c21a4b-b0d1-4083-beec-85a2797a0ea0-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:36:19.331519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.331520    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fbrl\" (UniqueName: \"kubernetes.io/projected/60c21a4b-b0d1-4083-beec-85a2797a0ea0-kube-api-access-8fbrl\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:36:19.607999 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.607962    2533 generic.go:356] "Generic (PLEG): container finished" podID="60c21a4b-b0d1-4083-beec-85a2797a0ea0" containerID="d6f4447e750af6d03d001f12ca9598bceb8ccc36593446e1029a5a7c0733514e" exitCode=0
Aug 05 19:36:19.608201 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.608021    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf" event={"ID":"60c21a4b-b0d1-4083-beec-85a2797a0ea0","Type":"ContainerDied","Data":"d6f4447e750af6d03d001f12ca9598bceb8ccc36593446e1029a5a7c0733514e"}
Aug 05 19:36:19.608201 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.608081    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf" event={"ID":"60c21a4b-b0d1-4083-beec-85a2797a0ea0","Type":"ContainerDied","Data":"494035cd2287decca0b44ec73675e6573219ad69432070c6bc935f649d7be13e"}
Aug 05 19:36:19.608201 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.608035    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"
Aug 05 19:36:19.608201 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.608103    2533 scope.go:117] "RemoveContainer" containerID="d6f4447e750af6d03d001f12ca9598bceb8ccc36593446e1029a5a7c0733514e"
Aug 05 19:36:19.618047 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.618026    2533 scope.go:117] "RemoveContainer" containerID="d6f4447e750af6d03d001f12ca9598bceb8ccc36593446e1029a5a7c0733514e"
Aug 05 19:36:19.618324 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:36:19.618303    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6f4447e750af6d03d001f12ca9598bceb8ccc36593446e1029a5a7c0733514e\": container with ID starting with d6f4447e750af6d03d001f12ca9598bceb8ccc36593446e1029a5a7c0733514e not found: ID does not exist" containerID="d6f4447e750af6d03d001f12ca9598bceb8ccc36593446e1029a5a7c0733514e"
Aug 05 19:36:19.618394 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.618335    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6f4447e750af6d03d001f12ca9598bceb8ccc36593446e1029a5a7c0733514e"} err="failed to get container status \"d6f4447e750af6d03d001f12ca9598bceb8ccc36593446e1029a5a7c0733514e\": rpc error: code = NotFound desc = could not find container \"d6f4447e750af6d03d001f12ca9598bceb8ccc36593446e1029a5a7c0733514e\": container with ID starting with d6f4447e750af6d03d001f12ca9598bceb8ccc36593446e1029a5a7c0733514e not found: ID does not exist"
Aug 05 19:36:19.631338 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.631305    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"]
Aug 05 19:36:19.636490 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:19.636454    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-82a4c5b4-6446647b67-4hljf"]
Aug 05 19:36:21.012024 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:21.011969    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add" path="/var/lib/kubelet/pods/2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add/volumes"
Aug 05 19:36:21.012463 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:36:21.012439    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60c21a4b-b0d1-4083-beec-85a2797a0ea0" path="/var/lib/kubelet/pods/60c21a4b-b0d1-4083-beec-85a2797a0ea0/volumes"
Aug 05 19:38:39.200484 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:39.200437    2533 scope.go:117] "RemoveContainer" containerID="fb5f52a963eac2aa67ab82c0f211df08242190294e84e80b3f904d7961b757a4"
Aug 05 19:38:39.212511 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:39.212487    2533 scope.go:117] "RemoveContainer" containerID="01d614d9e411a9bdcd0437d198516490cba91b48e9202a01d10569a07e2114a4"
Aug 05 19:38:45.271553 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.271516    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"]
Aug 05 19:38:45.272079 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.272064    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add" containerName="revoke-keys"
Aug 05 19:38:45.272133 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.272083    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add" containerName="revoke-keys"
Aug 05 19:38:45.272133 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.272110    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c21a4b-b0d1-4083-beec-85a2797a0ea0" containerName="maas-api"
Aug 05 19:38:45.272133 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.272118    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c21a4b-b0d1-4083-beec-85a2797a0ea0" containerName="maas-api"
Aug 05 19:38:45.272233 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.272221    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="60c21a4b-b0d1-4083-beec-85a2797a0ea0" containerName="maas-api"
Aug 05 19:38:45.272267 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.272237    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="2febd0b0-b7b2-4c91-9fc7-92b0eb4b8add" containerName="revoke-keys"
Aug 05 19:38:45.275588 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.275567    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:38:45.277677 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.277652    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b2d0ff34-serving-cert\""
Aug 05 19:38:45.282374 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.282345    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"]
Aug 05 19:38:45.359566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.359522    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed229ed3-d0bb-464c-adec-beac79a96a9e-openshift-service-ca\") pod \"maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz\" (UID: \"ed229ed3-d0bb-464c-adec-beac79a96a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:38:45.359743 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.359573    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjkxw\" (UniqueName: \"kubernetes.io/projected/ed229ed3-d0bb-464c-adec-beac79a96a9e-kube-api-access-gjkxw\") pod \"maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz\" (UID: \"ed229ed3-d0bb-464c-adec-beac79a96a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:38:45.359743 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.359654    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed229ed3-d0bb-464c-adec-beac79a96a9e-maas-api-tls\") pod \"maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz\" (UID: \"ed229ed3-d0bb-464c-adec-beac79a96a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:38:45.460322 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.460284    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed229ed3-d0bb-464c-adec-beac79a96a9e-maas-api-tls\") pod \"maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz\" (UID: \"ed229ed3-d0bb-464c-adec-beac79a96a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:38:45.460509 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.460359    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed229ed3-d0bb-464c-adec-beac79a96a9e-openshift-service-ca\") pod \"maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz\" (UID: \"ed229ed3-d0bb-464c-adec-beac79a96a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:38:45.460509 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.460382    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjkxw\" (UniqueName: \"kubernetes.io/projected/ed229ed3-d0bb-464c-adec-beac79a96a9e-kube-api-access-gjkxw\") pod \"maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz\" (UID: \"ed229ed3-d0bb-464c-adec-beac79a96a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:38:45.460509 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:38:45.460456    2533 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-serving-cert: secret "maas-api-e2e-mt-b2d0ff34-serving-cert" not found
Aug 05 19:38:45.460637 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:38:45.460552    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed229ed3-d0bb-464c-adec-beac79a96a9e-maas-api-tls podName:ed229ed3-d0bb-464c-adec-beac79a96a9e nodeName:}" failed. No retries permitted until 2026-08-05 19:38:45.96053103 +0000 UTC m=+2227.450466082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ed229ed3-d0bb-464c-adec-beac79a96a9e-maas-api-tls") pod "maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz" (UID: "ed229ed3-d0bb-464c-adec-beac79a96a9e") : secret "maas-api-e2e-mt-b2d0ff34-serving-cert" not found
Aug 05 19:38:45.461106 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.461087    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed229ed3-d0bb-464c-adec-beac79a96a9e-openshift-service-ca\") pod \"maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz\" (UID: \"ed229ed3-d0bb-464c-adec-beac79a96a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:38:45.469873 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.469841    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjkxw\" (UniqueName: \"kubernetes.io/projected/ed229ed3-d0bb-464c-adec-beac79a96a9e-kube-api-access-gjkxw\") pod \"maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz\" (UID: \"ed229ed3-d0bb-464c-adec-beac79a96a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:38:45.965646 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.965591    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed229ed3-d0bb-464c-adec-beac79a96a9e-maas-api-tls\") pod \"maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz\" (UID: \"ed229ed3-d0bb-464c-adec-beac79a96a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:38:45.968333 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:45.968304    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed229ed3-d0bb-464c-adec-beac79a96a9e-maas-api-tls\") pod \"maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz\" (UID: \"ed229ed3-d0bb-464c-adec-beac79a96a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:38:46.187796 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:46.187752    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:38:46.331681 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:46.331654    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"]
Aug 05 19:38:46.333455 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:38:46.333413    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded229ed3_d0bb_464c_adec_beac79a96a9e.slice/crio-6c860e1d1730043a5daf47ddb058aa16ef73d4e1dff562aa941d856a35f92e01 WatchSource:0}: Error finding container 6c860e1d1730043a5daf47ddb058aa16ef73d4e1dff562aa941d856a35f92e01: Status 404 returned error can't find the container with id 6c860e1d1730043a5daf47ddb058aa16ef73d4e1dff562aa941d856a35f92e01
Aug 05 19:38:46.335012 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:46.334971    2533 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 19:38:46.406175 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:46.406136    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz" event={"ID":"ed229ed3-d0bb-464c-adec-beac79a96a9e","Type":"ContainerStarted","Data":"6c860e1d1730043a5daf47ddb058aa16ef73d4e1dff562aa941d856a35f92e01"}
Aug 05 19:38:47.413359 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:47.413318    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz" event={"ID":"ed229ed3-d0bb-464c-adec-beac79a96a9e","Type":"ContainerStarted","Data":"708acf20054550876d5b64594706a133c2d2a6ab71d3a03c2d2c1e2aefdba712"}
Aug 05 19:38:47.413752 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:47.413440    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:38:47.431702 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:47.431641    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz" podStartSLOduration=2.035497762 podStartE2EDuration="2.431626623s" totalImagesPullingTime="396.128861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:38:47.429040445 +0000 UTC m=+2228.918975537" watchObservedRunningTime="2026-08-05 19:38:47.431626623 +0000 UTC m=+2228.921561697"
Aug 05 19:38:53.424216 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:38:53.424184    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:39:39.237401 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:39.237325    2533 scope.go:117] "RemoveContainer" containerID="dc006c70992e074c24a321bb2afe2724221ab2094b22802ebe47c73a400f8999"
Aug 05 19:39:39.245766 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:39.245744    2533 scope.go:117] "RemoveContainer" containerID="17f56f745d58d7ec46bcd0ad451caf6b7b0a06a838eceecec2107a3070a4837c"
Aug 05 19:39:48.409326 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:48.409289    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w"]
Aug 05 19:39:48.412710 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:48.412690    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w"
Aug 05 19:39:48.415076 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:48.415043    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:39:48.420368 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:48.420330    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w"]
Aug 05 19:39:48.512982 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:48.512940    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d8bb1f7-575d-4c0d-8945-8bd169390d48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w\" (UID: \"0d8bb1f7-575d-4c0d-8945-8bd169390d48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w"
Aug 05 19:39:48.613945 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:48.613909    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d8bb1f7-575d-4c0d-8945-8bd169390d48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w\" (UID: \"0d8bb1f7-575d-4c0d-8945-8bd169390d48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w"
Aug 05 19:39:48.614577 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:48.614556    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d8bb1f7-575d-4c0d-8945-8bd169390d48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w\" (UID: \"0d8bb1f7-575d-4c0d-8945-8bd169390d48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w"
Aug 05 19:39:48.725877 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:48.725842    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w"
Aug 05 19:39:48.863792 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:48.863759    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w"]
Aug 05 19:39:48.865511 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:39:48.865481    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d8bb1f7_575d_4c0d_8945_8bd169390d48.slice/crio-363831b2f98dea542c81e7c26d8791125973737796d799e0561cce5b34420811 WatchSource:0}: Error finding container 363831b2f98dea542c81e7c26d8791125973737796d799e0561cce5b34420811: Status 404 returned error can't find the container with id 363831b2f98dea542c81e7c26d8791125973737796d799e0561cce5b34420811
Aug 05 19:39:49.770146 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:49.770108    2533 generic.go:356] "Generic (PLEG): container finished" podID="0d8bb1f7-575d-4c0d-8945-8bd169390d48" containerID="9a2eb626ee2dffe4cc9a84a1de21210bfda4796f26f08a384b2a46e1cd945965" exitCode=0
Aug 05 19:39:49.770550 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:49.770200    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w" event={"ID":"0d8bb1f7-575d-4c0d-8945-8bd169390d48","Type":"ContainerDied","Data":"9a2eb626ee2dffe4cc9a84a1de21210bfda4796f26f08a384b2a46e1cd945965"}
Aug 05 19:39:49.770550 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:49.770259    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w" event={"ID":"0d8bb1f7-575d-4c0d-8945-8bd169390d48","Type":"ContainerStarted","Data":"363831b2f98dea542c81e7c26d8791125973737796d799e0561cce5b34420811"}
Aug 05 19:39:50.904679 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:50.904652    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w"
Aug 05 19:39:50.935621 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:50.935586    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d8bb1f7-575d-4c0d-8945-8bd169390d48-maas-api-service-ca\") pod \"0d8bb1f7-575d-4c0d-8945-8bd169390d48\" (UID: \"0d8bb1f7-575d-4c0d-8945-8bd169390d48\") "
Aug 05 19:39:50.935921 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:50.935900    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d8bb1f7-575d-4c0d-8945-8bd169390d48-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0d8bb1f7-575d-4c0d-8945-8bd169390d48" (UID: "0d8bb1f7-575d-4c0d-8945-8bd169390d48"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:39:51.036663 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:51.036573    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d8bb1f7-575d-4c0d-8945-8bd169390d48-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:39:51.782161 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:51.782129    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w"
Aug 05 19:39:51.782346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:51.782162    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w" event={"ID":"0d8bb1f7-575d-4c0d-8945-8bd169390d48","Type":"ContainerDied","Data":"363831b2f98dea542c81e7c26d8791125973737796d799e0561cce5b34420811"}
Aug 05 19:39:51.782346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:39:51.782213    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="363831b2f98dea542c81e7c26d8791125973737796d799e0561cce5b34420811"
Aug 05 19:40:03.834387 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:03.834348    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"]
Aug 05 19:40:03.834871 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:03.834582    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz" podUID="ed229ed3-d0bb-464c-adec-beac79a96a9e" containerName="maas-api" containerID="cri-o://708acf20054550876d5b64594706a133c2d2a6ab71d3a03c2d2c1e2aefdba712" gracePeriod=30
Aug 05 19:40:04.039179 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.039145    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w"]
Aug 05 19:40:04.043263 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.043232    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2d0ff34-7jx2w"]
Aug 05 19:40:04.090078 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.090011    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:40:04.156060 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.156020    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjkxw\" (UniqueName: \"kubernetes.io/projected/ed229ed3-d0bb-464c-adec-beac79a96a9e-kube-api-access-gjkxw\") pod \"ed229ed3-d0bb-464c-adec-beac79a96a9e\" (UID: \"ed229ed3-d0bb-464c-adec-beac79a96a9e\") "
Aug 05 19:40:04.156237 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.156092    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed229ed3-d0bb-464c-adec-beac79a96a9e-maas-api-tls\") pod \"ed229ed3-d0bb-464c-adec-beac79a96a9e\" (UID: \"ed229ed3-d0bb-464c-adec-beac79a96a9e\") "
Aug 05 19:40:04.156237 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.156123    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed229ed3-d0bb-464c-adec-beac79a96a9e-openshift-service-ca\") pod \"ed229ed3-d0bb-464c-adec-beac79a96a9e\" (UID: \"ed229ed3-d0bb-464c-adec-beac79a96a9e\") "
Aug 05 19:40:04.156566 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.156539    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed229ed3-d0bb-464c-adec-beac79a96a9e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed229ed3-d0bb-464c-adec-beac79a96a9e" (UID: "ed229ed3-d0bb-464c-adec-beac79a96a9e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:40:04.158257 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.158228    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed229ed3-d0bb-464c-adec-beac79a96a9e-kube-api-access-gjkxw" (OuterVolumeSpecName: "kube-api-access-gjkxw") pod "ed229ed3-d0bb-464c-adec-beac79a96a9e" (UID: "ed229ed3-d0bb-464c-adec-beac79a96a9e"). InnerVolumeSpecName "kube-api-access-gjkxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:40:04.158395 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.158262    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed229ed3-d0bb-464c-adec-beac79a96a9e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed229ed3-d0bb-464c-adec-beac79a96a9e" (UID: "ed229ed3-d0bb-464c-adec-beac79a96a9e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:40:04.257768 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.257730    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjkxw\" (UniqueName: \"kubernetes.io/projected/ed229ed3-d0bb-464c-adec-beac79a96a9e-kube-api-access-gjkxw\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:40:04.257768 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.257763    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed229ed3-d0bb-464c-adec-beac79a96a9e-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:40:04.257768 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.257773    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed229ed3-d0bb-464c-adec-beac79a96a9e-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:40:04.857960 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.857929    2533 generic.go:356] "Generic (PLEG): container finished" podID="ed229ed3-d0bb-464c-adec-beac79a96a9e" containerID="708acf20054550876d5b64594706a133c2d2a6ab71d3a03c2d2c1e2aefdba712" exitCode=0
Aug 05 19:40:04.858423 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.857973    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"
Aug 05 19:40:04.858423 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.857976    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz" event={"ID":"ed229ed3-d0bb-464c-adec-beac79a96a9e","Type":"ContainerDied","Data":"708acf20054550876d5b64594706a133c2d2a6ab71d3a03c2d2c1e2aefdba712"}
Aug 05 19:40:04.858423 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.858110    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz" event={"ID":"ed229ed3-d0bb-464c-adec-beac79a96a9e","Type":"ContainerDied","Data":"6c860e1d1730043a5daf47ddb058aa16ef73d4e1dff562aa941d856a35f92e01"}
Aug 05 19:40:04.858423 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.858139    2533 scope.go:117] "RemoveContainer" containerID="708acf20054550876d5b64594706a133c2d2a6ab71d3a03c2d2c1e2aefdba712"
Aug 05 19:40:04.867860 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.867839    2533 scope.go:117] "RemoveContainer" containerID="708acf20054550876d5b64594706a133c2d2a6ab71d3a03c2d2c1e2aefdba712"
Aug 05 19:40:04.868168 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:40:04.868150    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"708acf20054550876d5b64594706a133c2d2a6ab71d3a03c2d2c1e2aefdba712\": container with ID starting with 708acf20054550876d5b64594706a133c2d2a6ab71d3a03c2d2c1e2aefdba712 not found: ID does not exist" containerID="708acf20054550876d5b64594706a133c2d2a6ab71d3a03c2d2c1e2aefdba712"
Aug 05 19:40:04.868221 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.868183    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"708acf20054550876d5b64594706a133c2d2a6ab71d3a03c2d2c1e2aefdba712"} err="failed to get container status \"708acf20054550876d5b64594706a133c2d2a6ab71d3a03c2d2c1e2aefdba712\": rpc error: code = NotFound desc = could not find container \"708acf20054550876d5b64594706a133c2d2a6ab71d3a03c2d2c1e2aefdba712\": container with ID starting with 708acf20054550876d5b64594706a133c2d2a6ab71d3a03c2d2c1e2aefdba712 not found: ID does not exist"
Aug 05 19:40:04.878488 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.878450    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"]
Aug 05 19:40:04.881897 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:04.881869    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b2d0ff34-69c77ccd77-vd7wz"]
Aug 05 19:40:05.012489 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:05.012446    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d8bb1f7-575d-4c0d-8945-8bd169390d48" path="/var/lib/kubelet/pods/0d8bb1f7-575d-4c0d-8945-8bd169390d48/volumes"
Aug 05 19:40:05.012845 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:40:05.012832    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed229ed3-d0bb-464c-adec-beac79a96a9e" path="/var/lib/kubelet/pods/ed229ed3-d0bb-464c-adec-beac79a96a9e/volumes"
Aug 05 19:42:04.498536 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.498463    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"]
Aug 05 19:42:04.498962 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.498873    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8bb1f7-575d-4c0d-8945-8bd169390d48" containerName="revoke-keys"
Aug 05 19:42:04.498962 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.498887    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8bb1f7-575d-4c0d-8945-8bd169390d48" containerName="revoke-keys"
Aug 05 19:42:04.498962 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.498915    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed229ed3-d0bb-464c-adec-beac79a96a9e" containerName="maas-api"
Aug 05 19:42:04.498962 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.498921    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed229ed3-d0bb-464c-adec-beac79a96a9e" containerName="maas-api"
Aug 05 19:42:04.499160 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.498971    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed229ed3-d0bb-464c-adec-beac79a96a9e" containerName="maas-api"
Aug 05 19:42:04.499160 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.498979    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d8bb1f7-575d-4c0d-8945-8bd169390d48" containerName="revoke-keys"
Aug 05 19:42:04.502184 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.502164    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:04.504352 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.504332    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-8dc955-serving-cert\""
Aug 05 19:42:04.517542 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.517513    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"]
Aug 05 19:42:04.550233 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.550194    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxbmm\" (UniqueName: \"kubernetes.io/projected/52ee871e-f544-40c3-b6fe-ab808c053ca0-kube-api-access-qxbmm\") pod \"maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt\" (UID: \"52ee871e-f544-40c3-b6fe-ab808c053ca0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:04.550233 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.550231    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52ee871e-f544-40c3-b6fe-ab808c053ca0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt\" (UID: \"52ee871e-f544-40c3-b6fe-ab808c053ca0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:04.550443 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.550316    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52ee871e-f544-40c3-b6fe-ab808c053ca0-maas-api-tls\") pod \"maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt\" (UID: \"52ee871e-f544-40c3-b6fe-ab808c053ca0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:04.651124 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.651063    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxbmm\" (UniqueName: \"kubernetes.io/projected/52ee871e-f544-40c3-b6fe-ab808c053ca0-kube-api-access-qxbmm\") pod \"maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt\" (UID: \"52ee871e-f544-40c3-b6fe-ab808c053ca0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:04.651124 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.651127    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52ee871e-f544-40c3-b6fe-ab808c053ca0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt\" (UID: \"52ee871e-f544-40c3-b6fe-ab808c053ca0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:04.651352 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.651178    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52ee871e-f544-40c3-b6fe-ab808c053ca0-maas-api-tls\") pod \"maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt\" (UID: \"52ee871e-f544-40c3-b6fe-ab808c053ca0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:04.651352 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:42:04.651309    2533 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-serving-cert: secret "maas-api-e2e-inf-a-8dc955-serving-cert" not found
Aug 05 19:42:04.651429 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:42:04.651357    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ee871e-f544-40c3-b6fe-ab808c053ca0-maas-api-tls podName:52ee871e-f544-40c3-b6fe-ab808c053ca0 nodeName:}" failed. No retries permitted until 2026-08-05 19:42:05.151342207 +0000 UTC m=+2426.641277259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/52ee871e-f544-40c3-b6fe-ab808c053ca0-maas-api-tls") pod "maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt" (UID: "52ee871e-f544-40c3-b6fe-ab808c053ca0") : secret "maas-api-e2e-inf-a-8dc955-serving-cert" not found
Aug 05 19:42:04.651871 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.651849    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52ee871e-f544-40c3-b6fe-ab808c053ca0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt\" (UID: \"52ee871e-f544-40c3-b6fe-ab808c053ca0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:04.660708 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:04.660672    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxbmm\" (UniqueName: \"kubernetes.io/projected/52ee871e-f544-40c3-b6fe-ab808c053ca0-kube-api-access-qxbmm\") pod \"maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt\" (UID: \"52ee871e-f544-40c3-b6fe-ab808c053ca0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:05.156228 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:05.156191    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52ee871e-f544-40c3-b6fe-ab808c053ca0-maas-api-tls\") pod \"maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt\" (UID: \"52ee871e-f544-40c3-b6fe-ab808c053ca0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:05.158637 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:05.158608    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52ee871e-f544-40c3-b6fe-ab808c053ca0-maas-api-tls\") pod \"maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt\" (UID: \"52ee871e-f544-40c3-b6fe-ab808c053ca0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:05.412652 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:05.412553    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:05.553160 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:05.553133    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"]
Aug 05 19:42:05.555480 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:42:05.555446    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ee871e_f544_40c3_b6fe_ab808c053ca0.slice/crio-551be48e674440dec1dae1a3e85b85019cfd1acc6b993208d16ec169034c4fea WatchSource:0}: Error finding container 551be48e674440dec1dae1a3e85b85019cfd1acc6b993208d16ec169034c4fea: Status 404 returned error can't find the container with id 551be48e674440dec1dae1a3e85b85019cfd1acc6b993208d16ec169034c4fea
Aug 05 19:42:06.504102 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:06.504063    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt" event={"ID":"52ee871e-f544-40c3-b6fe-ab808c053ca0","Type":"ContainerStarted","Data":"b9bbd74bcd4c5df8680944ace8656245c6874aa6f075b953199bec1cd9607cbf"}
Aug 05 19:42:06.504311 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:06.504134    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt" event={"ID":"52ee871e-f544-40c3-b6fe-ab808c053ca0","Type":"ContainerStarted","Data":"551be48e674440dec1dae1a3e85b85019cfd1acc6b993208d16ec169034c4fea"}
Aug 05 19:42:06.504311 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:06.504183    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:06.521169 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:06.521014    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt" podStartSLOduration=2.006593867 podStartE2EDuration="2.520969035s" totalImagesPullingTime="514.375168ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:42:06.520546019 +0000 UTC m=+2428.010481122" watchObservedRunningTime="2026-08-05 19:42:06.520969035 +0000 UTC m=+2428.010904110"
Aug 05 19:42:12.515151 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:12.515119    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:42:32.484251 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.484214    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"]
Aug 05 19:42:32.487818 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.487797    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:42:32.489889 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.489871    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c87762-serving-cert\""
Aug 05 19:42:32.498629 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.498599    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"]
Aug 05 19:42:32.614797 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.614759    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8gf5\" (UniqueName: \"kubernetes.io/projected/8fa600af-2dfb-4f09-be79-c7f75337e4ea-kube-api-access-f8gf5\") pod \"maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w\" (UID: \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:42:32.615017 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.614811    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa600af-2dfb-4f09-be79-c7f75337e4ea-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w\" (UID: \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:42:32.615017 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.614833    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa600af-2dfb-4f09-be79-c7f75337e4ea-maas-api-tls\") pod \"maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w\" (UID: \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:42:32.715764 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.715722    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8gf5\" (UniqueName: \"kubernetes.io/projected/8fa600af-2dfb-4f09-be79-c7f75337e4ea-kube-api-access-f8gf5\") pod \"maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w\" (UID: \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:42:32.715952 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.715781    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa600af-2dfb-4f09-be79-c7f75337e4ea-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w\" (UID: \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:42:32.715952 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.715803    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa600af-2dfb-4f09-be79-c7f75337e4ea-maas-api-tls\") pod \"maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w\" (UID: \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:42:32.716553 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.716520    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa600af-2dfb-4f09-be79-c7f75337e4ea-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w\" (UID: \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:42:32.718249 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.718219    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa600af-2dfb-4f09-be79-c7f75337e4ea-maas-api-tls\") pod \"maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w\" (UID: \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:42:32.723770 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.723739    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8gf5\" (UniqueName: \"kubernetes.io/projected/8fa600af-2dfb-4f09-be79-c7f75337e4ea-kube-api-access-f8gf5\") pod \"maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w\" (UID: \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:42:32.800669 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.800577    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:42:32.944317 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:32.944290    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"]
Aug 05 19:42:32.945412 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:42:32.945387    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa600af_2dfb_4f09_be79_c7f75337e4ea.slice/crio-fb0b8ed886b8ba0641e738a5905ac0bc494dcb78d6b0dae826713db2f31bf0a9 WatchSource:0}: Error finding container fb0b8ed886b8ba0641e738a5905ac0bc494dcb78d6b0dae826713db2f31bf0a9: Status 404 returned error can't find the container with id fb0b8ed886b8ba0641e738a5905ac0bc494dcb78d6b0dae826713db2f31bf0a9
Aug 05 19:42:33.656057 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:33.655964    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w" event={"ID":"8fa600af-2dfb-4f09-be79-c7f75337e4ea","Type":"ContainerStarted","Data":"9f90ffae0678c31ad89837b8004bf9058f61eca9f2e2d61dc0b7f4e27349d9bb"}
Aug 05 19:42:33.656057 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:33.656026    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w" event={"ID":"8fa600af-2dfb-4f09-be79-c7f75337e4ea","Type":"ContainerStarted","Data":"fb0b8ed886b8ba0641e738a5905ac0bc494dcb78d6b0dae826713db2f31bf0a9"}
Aug 05 19:42:33.656057 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:33.656047    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:42:33.674610 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:33.674554    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w" podStartSLOduration=1.329516135 podStartE2EDuration="1.674537146s" totalImagesPullingTime="345.021011ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:42:33.673295621 +0000 UTC m=+2455.163230713" watchObservedRunningTime="2026-08-05 19:42:33.674537146 +0000 UTC m=+2455.164472220"
Aug 05 19:42:39.299190 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:39.294494    2533 scope.go:117] "RemoveContainer" containerID="1c48445fc98c8c0375cadd1fd6a4b58272cae9cd05b7bef2eb54ac8ab8643570"
Aug 05 19:42:39.666871 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:42:39.666788    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:44:11.706839 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:11.706793    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q"]
Aug 05 19:44:11.710569 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:11.710545    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q"
Aug 05 19:44:11.712963 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:11.712936    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:44:11.717706 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:11.717679    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q"]
Aug 05 19:44:11.819470 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:11.819426    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f81a57-6262-4edb-a79e-3fa7995bf253-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q\" (UID: \"c8f81a57-6262-4edb-a79e-3fa7995bf253\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q"
Aug 05 19:44:11.920105 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:11.920066    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f81a57-6262-4edb-a79e-3fa7995bf253-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q\" (UID: \"c8f81a57-6262-4edb-a79e-3fa7995bf253\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q"
Aug 05 19:44:11.920686 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:11.920667    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f81a57-6262-4edb-a79e-3fa7995bf253-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q\" (UID: \"c8f81a57-6262-4edb-a79e-3fa7995bf253\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q"
Aug 05 19:44:12.023220 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:12.023133    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q"
Aug 05 19:44:12.160934 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:12.160894    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q"]
Aug 05 19:44:12.164296 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:44:12.164260    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f81a57_6262_4edb_a79e_3fa7995bf253.slice/crio-9538de384c322a08e0d2b82b0dc6d992be1fa55150a6ded18a359b8063859b4f WatchSource:0}: Error finding container 9538de384c322a08e0d2b82b0dc6d992be1fa55150a6ded18a359b8063859b4f: Status 404 returned error can't find the container with id 9538de384c322a08e0d2b82b0dc6d992be1fa55150a6ded18a359b8063859b4f
Aug 05 19:44:12.185794 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:12.185764    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q" event={"ID":"c8f81a57-6262-4edb-a79e-3fa7995bf253","Type":"ContainerStarted","Data":"9538de384c322a08e0d2b82b0dc6d992be1fa55150a6ded18a359b8063859b4f"}
Aug 05 19:44:13.193117 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:13.193027    2533 generic.go:356] "Generic (PLEG): container finished" podID="c8f81a57-6262-4edb-a79e-3fa7995bf253" containerID="72b1681077f1d87dc6269a2121612b6367ebee36ab99051c5b649ebdc7c551f3" exitCode=0
Aug 05 19:44:13.193117 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:13.193104    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q" event={"ID":"c8f81a57-6262-4edb-a79e-3fa7995bf253","Type":"ContainerDied","Data":"72b1681077f1d87dc6269a2121612b6367ebee36ab99051c5b649ebdc7c551f3"}
Aug 05 19:44:14.329796 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:14.329763    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q"
Aug 05 19:44:14.343363 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:14.343300    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f81a57-6262-4edb-a79e-3fa7995bf253-maas-api-service-ca\") pod \"c8f81a57-6262-4edb-a79e-3fa7995bf253\" (UID: \"c8f81a57-6262-4edb-a79e-3fa7995bf253\") "
Aug 05 19:44:14.344041 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:14.344015    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8f81a57-6262-4edb-a79e-3fa7995bf253-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8f81a57-6262-4edb-a79e-3fa7995bf253" (UID: "c8f81a57-6262-4edb-a79e-3fa7995bf253"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:44:14.444184 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:14.444145    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8f81a57-6262-4edb-a79e-3fa7995bf253-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:44:15.204372 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:15.204340    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q"
Aug 05 19:44:15.204540 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:15.204340    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q" event={"ID":"c8f81a57-6262-4edb-a79e-3fa7995bf253","Type":"ContainerDied","Data":"9538de384c322a08e0d2b82b0dc6d992be1fa55150a6ded18a359b8063859b4f"}
Aug 05 19:44:15.204540 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:15.204469    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9538de384c322a08e0d2b82b0dc6d992be1fa55150a6ded18a359b8063859b4f"
Aug 05 19:44:22.236008 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.235957    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"]
Aug 05 19:44:22.236591 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.236236    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt" podUID="52ee871e-f544-40c3-b6fe-ab808c053ca0" containerName="maas-api" containerID="cri-o://b9bbd74bcd4c5df8680944ace8656245c6874aa6f075b953199bec1cd9607cbf" gracePeriod=30
Aug 05 19:44:22.451333 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.451294    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q"]
Aug 05 19:44:22.453577 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.453546    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8dc955-vxb4q"]
Aug 05 19:44:22.491823 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.491755    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:44:22.509662 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.509628    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52ee871e-f544-40c3-b6fe-ab808c053ca0-openshift-service-ca\") pod \"52ee871e-f544-40c3-b6fe-ab808c053ca0\" (UID: \"52ee871e-f544-40c3-b6fe-ab808c053ca0\") "
Aug 05 19:44:22.509869 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.509690    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52ee871e-f544-40c3-b6fe-ab808c053ca0-maas-api-tls\") pod \"52ee871e-f544-40c3-b6fe-ab808c053ca0\" (UID: \"52ee871e-f544-40c3-b6fe-ab808c053ca0\") "
Aug 05 19:44:22.509869 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.509829    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxbmm\" (UniqueName: \"kubernetes.io/projected/52ee871e-f544-40c3-b6fe-ab808c053ca0-kube-api-access-qxbmm\") pod \"52ee871e-f544-40c3-b6fe-ab808c053ca0\" (UID: \"52ee871e-f544-40c3-b6fe-ab808c053ca0\") "
Aug 05 19:44:22.510238 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.510181    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52ee871e-f544-40c3-b6fe-ab808c053ca0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "52ee871e-f544-40c3-b6fe-ab808c053ca0" (UID: "52ee871e-f544-40c3-b6fe-ab808c053ca0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:44:22.512177 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.512147    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52ee871e-f544-40c3-b6fe-ab808c053ca0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "52ee871e-f544-40c3-b6fe-ab808c053ca0" (UID: "52ee871e-f544-40c3-b6fe-ab808c053ca0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:44:22.512338 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.512178    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52ee871e-f544-40c3-b6fe-ab808c053ca0-kube-api-access-qxbmm" (OuterVolumeSpecName: "kube-api-access-qxbmm") pod "52ee871e-f544-40c3-b6fe-ab808c053ca0" (UID: "52ee871e-f544-40c3-b6fe-ab808c053ca0"). InnerVolumeSpecName "kube-api-access-qxbmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:44:22.610772 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.610722    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxbmm\" (UniqueName: \"kubernetes.io/projected/52ee871e-f544-40c3-b6fe-ab808c053ca0-kube-api-access-qxbmm\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:44:22.610772 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.610763    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52ee871e-f544-40c3-b6fe-ab808c053ca0-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:44:22.610772 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:22.610774    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52ee871e-f544-40c3-b6fe-ab808c053ca0-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:44:23.013543 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:23.013508    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8f81a57-6262-4edb-a79e-3fa7995bf253" path="/var/lib/kubelet/pods/c8f81a57-6262-4edb-a79e-3fa7995bf253/volumes"
Aug 05 19:44:23.249870 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:23.249833    2533 generic.go:356] "Generic (PLEG): container finished" podID="52ee871e-f544-40c3-b6fe-ab808c053ca0" containerID="b9bbd74bcd4c5df8680944ace8656245c6874aa6f075b953199bec1cd9607cbf" exitCode=0
Aug 05 19:44:23.250389 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:23.249901    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"
Aug 05 19:44:23.250389 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:23.249925    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt" event={"ID":"52ee871e-f544-40c3-b6fe-ab808c053ca0","Type":"ContainerDied","Data":"b9bbd74bcd4c5df8680944ace8656245c6874aa6f075b953199bec1cd9607cbf"}
Aug 05 19:44:23.250389 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:23.249984    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt" event={"ID":"52ee871e-f544-40c3-b6fe-ab808c053ca0","Type":"ContainerDied","Data":"551be48e674440dec1dae1a3e85b85019cfd1acc6b993208d16ec169034c4fea"}
Aug 05 19:44:23.250389 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:23.250029    2533 scope.go:117] "RemoveContainer" containerID="b9bbd74bcd4c5df8680944ace8656245c6874aa6f075b953199bec1cd9607cbf"
Aug 05 19:44:23.259185 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:23.259166    2533 scope.go:117] "RemoveContainer" containerID="b9bbd74bcd4c5df8680944ace8656245c6874aa6f075b953199bec1cd9607cbf"
Aug 05 19:44:23.259499 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:44:23.259477    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9bbd74bcd4c5df8680944ace8656245c6874aa6f075b953199bec1cd9607cbf\": container with ID starting with b9bbd74bcd4c5df8680944ace8656245c6874aa6f075b953199bec1cd9607cbf not found: ID does not exist" containerID="b9bbd74bcd4c5df8680944ace8656245c6874aa6f075b953199bec1cd9607cbf"
Aug 05 19:44:23.259573 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:23.259507    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9bbd74bcd4c5df8680944ace8656245c6874aa6f075b953199bec1cd9607cbf"} err="failed to get container status \"b9bbd74bcd4c5df8680944ace8656245c6874aa6f075b953199bec1cd9607cbf\": rpc error: code = NotFound desc = could not find container \"b9bbd74bcd4c5df8680944ace8656245c6874aa6f075b953199bec1cd9607cbf\": container with ID starting with b9bbd74bcd4c5df8680944ace8656245c6874aa6f075b953199bec1cd9607cbf not found: ID does not exist"
Aug 05 19:44:23.267505 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:23.267436    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"]
Aug 05 19:44:23.269682 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:23.269662    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8dc955-66864fb88d-ftkwt"]
Aug 05 19:44:25.019337 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:25.019289    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52ee871e-f544-40c3-b6fe-ab808c053ca0" path="/var/lib/kubelet/pods/52ee871e-f544-40c3-b6fe-ab808c053ca0/volumes"
Aug 05 19:44:29.262324 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.262286    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm"]
Aug 05 19:44:29.262826 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.262661    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52ee871e-f544-40c3-b6fe-ab808c053ca0" containerName="maas-api"
Aug 05 19:44:29.262826 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.262672    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="52ee871e-f544-40c3-b6fe-ab808c053ca0" containerName="maas-api"
Aug 05 19:44:29.262826 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.262688    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f81a57-6262-4edb-a79e-3fa7995bf253" containerName="revoke-keys"
Aug 05 19:44:29.262826 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.262694    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f81a57-6262-4edb-a79e-3fa7995bf253" containerName="revoke-keys"
Aug 05 19:44:29.262826 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.262754    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f81a57-6262-4edb-a79e-3fa7995bf253" containerName="revoke-keys"
Aug 05 19:44:29.262826 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.262763    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="52ee871e-f544-40c3-b6fe-ab808c053ca0" containerName="maas-api"
Aug 05 19:44:29.267379 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.267359    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm"
Aug 05 19:44:29.270116 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.270097    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:44:29.288979 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.288950    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm"]
Aug 05 19:44:29.369490 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.369436    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb0045-0f57-49d6-9c72-46da7dc7a4bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm\" (UID: \"e9bb0045-0f57-49d6-9c72-46da7dc7a4bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm"
Aug 05 19:44:29.469914 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.469874    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb0045-0f57-49d6-9c72-46da7dc7a4bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm\" (UID: \"e9bb0045-0f57-49d6-9c72-46da7dc7a4bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm"
Aug 05 19:44:29.470582 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.470556    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb0045-0f57-49d6-9c72-46da7dc7a4bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm\" (UID: \"e9bb0045-0f57-49d6-9c72-46da7dc7a4bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm"
Aug 05 19:44:29.577750 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.577652    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm"
Aug 05 19:44:29.721507 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:29.721472    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm"]
Aug 05 19:44:29.722937 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:44:29.722910    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9bb0045_0f57_49d6_9c72_46da7dc7a4bc.slice/crio-1092c38d9225e8d18976cda9ca432407fcc195f71df9608066b6a5442c87e710 WatchSource:0}: Error finding container 1092c38d9225e8d18976cda9ca432407fcc195f71df9608066b6a5442c87e710: Status 404 returned error can't find the container with id 1092c38d9225e8d18976cda9ca432407fcc195f71df9608066b6a5442c87e710
Aug 05 19:44:30.291403 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:30.291306    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm" event={"ID":"e9bb0045-0f57-49d6-9c72-46da7dc7a4bc","Type":"ContainerStarted","Data":"ee6da7b960c7e728441041a08ec45a000856d88e32a1595609f3e410b8e5efb3"}
Aug 05 19:44:30.291403 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:30.291362    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm" event={"ID":"e9bb0045-0f57-49d6-9c72-46da7dc7a4bc","Type":"ContainerStarted","Data":"1092c38d9225e8d18976cda9ca432407fcc195f71df9608066b6a5442c87e710"}
Aug 05 19:44:30.307468 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:30.307414    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm" podStartSLOduration=1.307392513 podStartE2EDuration="1.307392513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:44:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:44:30.305224396 +0000 UTC m=+2571.795159495" watchObservedRunningTime="2026-08-05 19:44:30.307392513 +0000 UTC m=+2571.797327586"
Aug 05 19:44:31.298756 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:31.298721    2533 generic.go:356] "Generic (PLEG): container finished" podID="e9bb0045-0f57-49d6-9c72-46da7dc7a4bc" containerID="ee6da7b960c7e728441041a08ec45a000856d88e32a1595609f3e410b8e5efb3" exitCode=0
Aug 05 19:44:31.299272 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:31.298802    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm" event={"ID":"e9bb0045-0f57-49d6-9c72-46da7dc7a4bc","Type":"ContainerDied","Data":"ee6da7b960c7e728441041a08ec45a000856d88e32a1595609f3e410b8e5efb3"}
Aug 05 19:44:32.439577 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:32.439551    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm"
Aug 05 19:44:32.500704 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:32.500666    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb0045-0f57-49d6-9c72-46da7dc7a4bc-maas-api-service-ca\") pod \"e9bb0045-0f57-49d6-9c72-46da7dc7a4bc\" (UID: \"e9bb0045-0f57-49d6-9c72-46da7dc7a4bc\") "
Aug 05 19:44:32.501062 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:32.501039    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9bb0045-0f57-49d6-9c72-46da7dc7a4bc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9bb0045-0f57-49d6-9c72-46da7dc7a4bc" (UID: "e9bb0045-0f57-49d6-9c72-46da7dc7a4bc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:44:32.602105 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:32.601979    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9bb0045-0f57-49d6-9c72-46da7dc7a4bc-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:44:33.311472 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:33.311373    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm" event={"ID":"e9bb0045-0f57-49d6-9c72-46da7dc7a4bc","Type":"ContainerDied","Data":"1092c38d9225e8d18976cda9ca432407fcc195f71df9608066b6a5442c87e710"}
Aug 05 19:44:33.311472 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:33.311434    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1092c38d9225e8d18976cda9ca432407fcc195f71df9608066b6a5442c87e710"
Aug 05 19:44:33.311472 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:33.311392    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm"
Aug 05 19:44:39.822269 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:39.822235    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"]
Aug 05 19:44:39.822808 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:39.822444    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w" podUID="8fa600af-2dfb-4f09-be79-c7f75337e4ea" containerName="maas-api" containerID="cri-o://9f90ffae0678c31ad89837b8004bf9058f61eca9f2e2d61dc0b7f4e27349d9bb" gracePeriod=30
Aug 05 19:44:40.031348 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.031311    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm"]
Aug 05 19:44:40.033533 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.033509    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c87762-g2hdm"]
Aug 05 19:44:40.277925 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.277896    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:44:40.350234 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.350198    2533 generic.go:356] "Generic (PLEG): container finished" podID="8fa600af-2dfb-4f09-be79-c7f75337e4ea" containerID="9f90ffae0678c31ad89837b8004bf9058f61eca9f2e2d61dc0b7f4e27349d9bb" exitCode=0
Aug 05 19:44:40.350414 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.350244    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"
Aug 05 19:44:40.350414 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.350281    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w" event={"ID":"8fa600af-2dfb-4f09-be79-c7f75337e4ea","Type":"ContainerDied","Data":"9f90ffae0678c31ad89837b8004bf9058f61eca9f2e2d61dc0b7f4e27349d9bb"}
Aug 05 19:44:40.350414 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.350335    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w" event={"ID":"8fa600af-2dfb-4f09-be79-c7f75337e4ea","Type":"ContainerDied","Data":"fb0b8ed886b8ba0641e738a5905ac0bc494dcb78d6b0dae826713db2f31bf0a9"}
Aug 05 19:44:40.350414 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.350358    2533 scope.go:117] "RemoveContainer" containerID="9f90ffae0678c31ad89837b8004bf9058f61eca9f2e2d61dc0b7f4e27349d9bb"
Aug 05 19:44:40.359022 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.359002    2533 scope.go:117] "RemoveContainer" containerID="9f90ffae0678c31ad89837b8004bf9058f61eca9f2e2d61dc0b7f4e27349d9bb"
Aug 05 19:44:40.359273 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:44:40.359254    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f90ffae0678c31ad89837b8004bf9058f61eca9f2e2d61dc0b7f4e27349d9bb\": container with ID starting with 9f90ffae0678c31ad89837b8004bf9058f61eca9f2e2d61dc0b7f4e27349d9bb not found: ID does not exist" containerID="9f90ffae0678c31ad89837b8004bf9058f61eca9f2e2d61dc0b7f4e27349d9bb"
Aug 05 19:44:40.359327 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.359281    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f90ffae0678c31ad89837b8004bf9058f61eca9f2e2d61dc0b7f4e27349d9bb"} err="failed to get container status \"9f90ffae0678c31ad89837b8004bf9058f61eca9f2e2d61dc0b7f4e27349d9bb\": rpc error: code = NotFound desc = could not find container \"9f90ffae0678c31ad89837b8004bf9058f61eca9f2e2d61dc0b7f4e27349d9bb\": container with ID starting with 9f90ffae0678c31ad89837b8004bf9058f61eca9f2e2d61dc0b7f4e27349d9bb not found: ID does not exist"
Aug 05 19:44:40.379477 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.379451    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8gf5\" (UniqueName: \"kubernetes.io/projected/8fa600af-2dfb-4f09-be79-c7f75337e4ea-kube-api-access-f8gf5\") pod \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\" (UID: \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\") "
Aug 05 19:44:40.379601 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.379491    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa600af-2dfb-4f09-be79-c7f75337e4ea-openshift-service-ca\") pod \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\" (UID: \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\") "
Aug 05 19:44:40.379601 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.379514    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa600af-2dfb-4f09-be79-c7f75337e4ea-maas-api-tls\") pod \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\" (UID: \"8fa600af-2dfb-4f09-be79-c7f75337e4ea\") "
Aug 05 19:44:40.379909 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.379884    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa600af-2dfb-4f09-be79-c7f75337e4ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8fa600af-2dfb-4f09-be79-c7f75337e4ea" (UID: "8fa600af-2dfb-4f09-be79-c7f75337e4ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:44:40.381571 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.381550    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fa600af-2dfb-4f09-be79-c7f75337e4ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8fa600af-2dfb-4f09-be79-c7f75337e4ea" (UID: "8fa600af-2dfb-4f09-be79-c7f75337e4ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:44:40.381648 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.381557    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa600af-2dfb-4f09-be79-c7f75337e4ea-kube-api-access-f8gf5" (OuterVolumeSpecName: "kube-api-access-f8gf5") pod "8fa600af-2dfb-4f09-be79-c7f75337e4ea" (UID: "8fa600af-2dfb-4f09-be79-c7f75337e4ea"). InnerVolumeSpecName "kube-api-access-f8gf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:44:40.480497 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.480461    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8gf5\" (UniqueName: \"kubernetes.io/projected/8fa600af-2dfb-4f09-be79-c7f75337e4ea-kube-api-access-f8gf5\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:44:40.480497 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.480494    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa600af-2dfb-4f09-be79-c7f75337e4ea-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:44:40.480497 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.480506    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa600af-2dfb-4f09-be79-c7f75337e4ea-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:44:40.672498 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.672458    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"]
Aug 05 19:44:40.675468 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:40.675442    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c87762-67c74ddcb-dqf9w"]
Aug 05 19:44:41.013061 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:41.013029    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fa600af-2dfb-4f09-be79-c7f75337e4ea" path="/var/lib/kubelet/pods/8fa600af-2dfb-4f09-be79-c7f75337e4ea/volumes"
Aug 05 19:44:41.013442 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:41.013374    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9bb0045-0f57-49d6-9c72-46da7dc7a4bc" path="/var/lib/kubelet/pods/e9bb0045-0f57-49d6-9c72-46da7dc7a4bc/volumes"
Aug 05 19:44:51.253914 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.253879    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"]
Aug 05 19:44:51.254562 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.254280    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa600af-2dfb-4f09-be79-c7f75337e4ea" containerName="maas-api"
Aug 05 19:44:51.254562 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.254294    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa600af-2dfb-4f09-be79-c7f75337e4ea" containerName="maas-api"
Aug 05 19:44:51.254562 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.254308    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9bb0045-0f57-49d6-9c72-46da7dc7a4bc" containerName="revoke-keys"
Aug 05 19:44:51.254562 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.254313    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9bb0045-0f57-49d6-9c72-46da7dc7a4bc" containerName="revoke-keys"
Aug 05 19:44:51.254562 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.254381    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fa600af-2dfb-4f09-be79-c7f75337e4ea" containerName="maas-api"
Aug 05 19:44:51.254562 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.254389    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9bb0045-0f57-49d6-9c72-46da7dc7a4bc" containerName="revoke-keys"
Aug 05 19:44:51.256690 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.256668    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:44:51.259004 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.258966    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-94093f-serving-cert\""
Aug 05 19:44:51.268678 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.267698    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"]
Aug 05 19:44:51.387573 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.387536    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2x9q\" (UniqueName: \"kubernetes.io/projected/705eef8d-a7bd-42d0-9506-4da189f0d96e-kube-api-access-z2x9q\") pod \"maas-api-e2e-api-a-94093f-8b8695c6-nplkq\" (UID: \"705eef8d-a7bd-42d0-9506-4da189f0d96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:44:51.387751 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.387598    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/705eef8d-a7bd-42d0-9506-4da189f0d96e-openshift-service-ca\") pod \"maas-api-e2e-api-a-94093f-8b8695c6-nplkq\" (UID: \"705eef8d-a7bd-42d0-9506-4da189f0d96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:44:51.387751 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.387624    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/705eef8d-a7bd-42d0-9506-4da189f0d96e-maas-api-tls\") pod \"maas-api-e2e-api-a-94093f-8b8695c6-nplkq\" (UID: \"705eef8d-a7bd-42d0-9506-4da189f0d96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:44:51.488519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.488480    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2x9q\" (UniqueName: \"kubernetes.io/projected/705eef8d-a7bd-42d0-9506-4da189f0d96e-kube-api-access-z2x9q\") pod \"maas-api-e2e-api-a-94093f-8b8695c6-nplkq\" (UID: \"705eef8d-a7bd-42d0-9506-4da189f0d96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:44:51.488722 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.488538    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/705eef8d-a7bd-42d0-9506-4da189f0d96e-openshift-service-ca\") pod \"maas-api-e2e-api-a-94093f-8b8695c6-nplkq\" (UID: \"705eef8d-a7bd-42d0-9506-4da189f0d96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:44:51.488722 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.488559    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/705eef8d-a7bd-42d0-9506-4da189f0d96e-maas-api-tls\") pod \"maas-api-e2e-api-a-94093f-8b8695c6-nplkq\" (UID: \"705eef8d-a7bd-42d0-9506-4da189f0d96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:44:51.488722 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:44:51.488660    2533 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-serving-cert: secret "maas-api-e2e-api-a-94093f-serving-cert" not found
Aug 05 19:44:51.488722 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:44:51.488721    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/705eef8d-a7bd-42d0-9506-4da189f0d96e-maas-api-tls podName:705eef8d-a7bd-42d0-9506-4da189f0d96e nodeName:}" failed. No retries permitted until 2026-08-05 19:44:51.988706746 +0000 UTC m=+2593.478641799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/705eef8d-a7bd-42d0-9506-4da189f0d96e-maas-api-tls") pod "maas-api-e2e-api-a-94093f-8b8695c6-nplkq" (UID: "705eef8d-a7bd-42d0-9506-4da189f0d96e") : secret "maas-api-e2e-api-a-94093f-serving-cert" not found
Aug 05 19:44:51.489313 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.489285    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/705eef8d-a7bd-42d0-9506-4da189f0d96e-openshift-service-ca\") pod \"maas-api-e2e-api-a-94093f-8b8695c6-nplkq\" (UID: \"705eef8d-a7bd-42d0-9506-4da189f0d96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:44:51.496906 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.496882    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2x9q\" (UniqueName: \"kubernetes.io/projected/705eef8d-a7bd-42d0-9506-4da189f0d96e-kube-api-access-z2x9q\") pod \"maas-api-e2e-api-a-94093f-8b8695c6-nplkq\" (UID: \"705eef8d-a7bd-42d0-9506-4da189f0d96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:44:51.993356 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.993318    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/705eef8d-a7bd-42d0-9506-4da189f0d96e-maas-api-tls\") pod \"maas-api-e2e-api-a-94093f-8b8695c6-nplkq\" (UID: \"705eef8d-a7bd-42d0-9506-4da189f0d96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:44:51.996218 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:51.996190    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/705eef8d-a7bd-42d0-9506-4da189f0d96e-maas-api-tls\") pod \"maas-api-e2e-api-a-94093f-8b8695c6-nplkq\" (UID: \"705eef8d-a7bd-42d0-9506-4da189f0d96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:44:52.170090 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:52.170046    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:44:52.310960 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:52.310922    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"]
Aug 05 19:44:52.312779 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:44:52.312753    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod705eef8d_a7bd_42d0_9506_4da189f0d96e.slice/crio-23274ba12d7e3ed454a6c36cbb9d696fcab759bcccac744cbe7f6456cf4e4741 WatchSource:0}: Error finding container 23274ba12d7e3ed454a6c36cbb9d696fcab759bcccac744cbe7f6456cf4e4741: Status 404 returned error can't find the container with id 23274ba12d7e3ed454a6c36cbb9d696fcab759bcccac744cbe7f6456cf4e4741
Aug 05 19:44:52.314579 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:52.314565    2533 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 19:44:52.417056 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:52.417019    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq" event={"ID":"705eef8d-a7bd-42d0-9506-4da189f0d96e","Type":"ContainerStarted","Data":"23274ba12d7e3ed454a6c36cbb9d696fcab759bcccac744cbe7f6456cf4e4741"}
Aug 05 19:44:53.424528 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:53.424490    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq" event={"ID":"705eef8d-a7bd-42d0-9506-4da189f0d96e","Type":"ContainerStarted","Data":"e0d2cfda648f97871baa561515104b6d3e779e948d0e911c4ccba8405db7864b"}
Aug 05 19:44:53.425028 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:53.424582    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:44:53.443832 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:53.443769    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq" podStartSLOduration=1.930241367 podStartE2EDuration="2.443751786s" totalImagesPullingTime="513.510419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:44:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:44:53.441822005 +0000 UTC m=+2594.931757080" watchObservedRunningTime="2026-08-05 19:44:53.443751786 +0000 UTC m=+2594.933686888"
Aug 05 19:44:59.434970 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:44:59.434940    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:45:00.135689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:00.135650    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765985-2tpg2"]
Aug 05 19:45:00.139177 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:00.139152    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94093f-29765985-gbtln"]
Aug 05 19:45:00.139339 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:00.139271    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765985-2tpg2"
Aug 05 19:45:00.141500 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:00.141479    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:45:00.142377 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:00.142359    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94093f-29765985-gbtln"
Aug 05 19:45:00.147252 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:00.147184    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765985-2tpg2"]
Aug 05 19:45:00.150494 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:00.150469    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94093f-29765985-gbtln"]
Aug 05 19:45:00.153945 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:00.153922    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765985-2tpg2"
Aug 05 19:45:00.162231 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:00.162210    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94093f-29765985-gbtln"
Aug 05 19:45:00.305328 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:00.305295    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765985-2tpg2"]
Aug 05 19:45:00.306750 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:45:00.306722    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebea0f90_d1d4_4556_8248_0ff1daca8644.slice/crio-d63948f8c47706b2d1864feafd9f0bab6d105b7edc2bd5a50880fd1be2a09afe WatchSource:0}: Error finding container d63948f8c47706b2d1864feafd9f0bab6d105b7edc2bd5a50880fd1be2a09afe: Status 404 returned error can't find the container with id d63948f8c47706b2d1864feafd9f0bab6d105b7edc2bd5a50880fd1be2a09afe
Aug 05 19:45:00.329858 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:00.329833    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94093f-29765985-gbtln"]
Aug 05 19:45:00.332145 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:45:00.332119    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd058434_facd_450b_adac_8ebe0094cd69.slice/crio-7a7c9dea09aaac67311bd763559f51cff352d411fba24e940ae0e826e83f4693 WatchSource:0}: Error finding container 7a7c9dea09aaac67311bd763559f51cff352d411fba24e940ae0e826e83f4693: Status 404 returned error can't find the container with id 7a7c9dea09aaac67311bd763559f51cff352d411fba24e940ae0e826e83f4693
Aug 05 19:45:00.463166 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:00.463133    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94093f-29765985-gbtln" event={"ID":"fd058434-facd-450b-adac-8ebe0094cd69","Type":"ContainerStarted","Data":"7a7c9dea09aaac67311bd763559f51cff352d411fba24e940ae0e826e83f4693"}
Aug 05 19:45:00.464488 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:00.464460    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765985-2tpg2" event={"ID":"ebea0f90-d1d4-4556-8248-0ff1daca8644","Type":"ContainerStarted","Data":"d63948f8c47706b2d1864feafd9f0bab6d105b7edc2bd5a50880fd1be2a09afe"}
Aug 05 19:45:01.471796 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:01.471762    2533 generic.go:356] "Generic (PLEG): container finished" podID="ebea0f90-d1d4-4556-8248-0ff1daca8644" containerID="766fd13fd5f8748008b1aa623ce34b18945c138a6861401c636df50c1ed3a7cf" exitCode=0
Aug 05 19:45:01.472220 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:01.471853    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765985-2tpg2" event={"ID":"ebea0f90-d1d4-4556-8248-0ff1daca8644","Type":"ContainerDied","Data":"766fd13fd5f8748008b1aa623ce34b18945c138a6861401c636df50c1ed3a7cf"}
Aug 05 19:45:01.473380 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:01.473354    2533 generic.go:356] "Generic (PLEG): container finished" podID="fd058434-facd-450b-adac-8ebe0094cd69" containerID="20b7cf7531ea70aa3b8b6a389c1844a2193e1e38771a2f21ec36a957f2ced1bd" exitCode=0
Aug 05 19:45:01.473501 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:01.473414    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94093f-29765985-gbtln" event={"ID":"fd058434-facd-450b-adac-8ebe0094cd69","Type":"ContainerDied","Data":"20b7cf7531ea70aa3b8b6a389c1844a2193e1e38771a2f21ec36a957f2ced1bd"}
Aug 05 19:45:02.610508 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:02.610479    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94093f-29765985-gbtln"
Aug 05 19:45:02.660422 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:02.658769    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765985-2tpg2"
Aug 05 19:45:03.486873 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:03.486834    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94093f-29765985-gbtln"
Aug 05 19:45:03.486873 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:03.486856    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94093f-29765985-gbtln" event={"ID":"fd058434-facd-450b-adac-8ebe0094cd69","Type":"ContainerDied","Data":"7a7c9dea09aaac67311bd763559f51cff352d411fba24e940ae0e826e83f4693"}
Aug 05 19:45:03.487187 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:03.486911    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a7c9dea09aaac67311bd763559f51cff352d411fba24e940ae0e826e83f4693"
Aug 05 19:45:03.488164 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:03.488141    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765985-2tpg2"
Aug 05 19:45:03.488292 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:03.488177    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765985-2tpg2" event={"ID":"ebea0f90-d1d4-4556-8248-0ff1daca8644","Type":"ContainerDied","Data":"d63948f8c47706b2d1864feafd9f0bab6d105b7edc2bd5a50880fd1be2a09afe"}
Aug 05 19:45:03.488292 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:03.488227    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d63948f8c47706b2d1864feafd9f0bab6d105b7edc2bd5a50880fd1be2a09afe"
Aug 05 19:45:19.401238 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.401199    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"]
Aug 05 19:45:19.401841 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.401563    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebea0f90-d1d4-4556-8248-0ff1daca8644" containerName="cleanup"
Aug 05 19:45:19.401841 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.401574    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebea0f90-d1d4-4556-8248-0ff1daca8644" containerName="cleanup"
Aug 05 19:45:19.401841 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.401590    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd058434-facd-450b-adac-8ebe0094cd69" containerName="cleanup"
Aug 05 19:45:19.401841 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.401596    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd058434-facd-450b-adac-8ebe0094cd69" containerName="cleanup"
Aug 05 19:45:19.401841 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.401654    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebea0f90-d1d4-4556-8248-0ff1daca8644" containerName="cleanup"
Aug 05 19:45:19.401841 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.401665    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd058434-facd-450b-adac-8ebe0094cd69" containerName="cleanup"
Aug 05 19:45:19.404710 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.404686    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:19.406916 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.406889    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a47f42-serving-cert\""
Aug 05 19:45:19.413941 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.413909    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"]
Aug 05 19:45:19.546061 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.546013    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c637b062-64dc-4591-a5ec-395f06c865a1-maas-api-tls\") pod \"maas-api-e2e-api-b-a47f42-984c895c8-b8hvp\" (UID: \"c637b062-64dc-4591-a5ec-395f06c865a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:19.546061 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.546066    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j8kg\" (UniqueName: \"kubernetes.io/projected/c637b062-64dc-4591-a5ec-395f06c865a1-kube-api-access-5j8kg\") pod \"maas-api-e2e-api-b-a47f42-984c895c8-b8hvp\" (UID: \"c637b062-64dc-4591-a5ec-395f06c865a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:19.546306 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.546200    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c637b062-64dc-4591-a5ec-395f06c865a1-openshift-service-ca\") pod \"maas-api-e2e-api-b-a47f42-984c895c8-b8hvp\" (UID: \"c637b062-64dc-4591-a5ec-395f06c865a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:19.647665 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.647624    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c637b062-64dc-4591-a5ec-395f06c865a1-openshift-service-ca\") pod \"maas-api-e2e-api-b-a47f42-984c895c8-b8hvp\" (UID: \"c637b062-64dc-4591-a5ec-395f06c865a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:19.647863 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.647803    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c637b062-64dc-4591-a5ec-395f06c865a1-maas-api-tls\") pod \"maas-api-e2e-api-b-a47f42-984c895c8-b8hvp\" (UID: \"c637b062-64dc-4591-a5ec-395f06c865a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:19.647863 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.647842    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j8kg\" (UniqueName: \"kubernetes.io/projected/c637b062-64dc-4591-a5ec-395f06c865a1-kube-api-access-5j8kg\") pod \"maas-api-e2e-api-b-a47f42-984c895c8-b8hvp\" (UID: \"c637b062-64dc-4591-a5ec-395f06c865a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:19.648047 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:45:19.648028    2533 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-serving-cert: secret "maas-api-e2e-api-b-a47f42-serving-cert" not found
Aug 05 19:45:19.648186 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:45:19.648102    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c637b062-64dc-4591-a5ec-395f06c865a1-maas-api-tls podName:c637b062-64dc-4591-a5ec-395f06c865a1 nodeName:}" failed. No retries permitted until 2026-08-05 19:45:20.148079845 +0000 UTC m=+2621.638014904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c637b062-64dc-4591-a5ec-395f06c865a1-maas-api-tls") pod "maas-api-e2e-api-b-a47f42-984c895c8-b8hvp" (UID: "c637b062-64dc-4591-a5ec-395f06c865a1") : secret "maas-api-e2e-api-b-a47f42-serving-cert" not found
Aug 05 19:45:19.648534 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.648511    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c637b062-64dc-4591-a5ec-395f06c865a1-openshift-service-ca\") pod \"maas-api-e2e-api-b-a47f42-984c895c8-b8hvp\" (UID: \"c637b062-64dc-4591-a5ec-395f06c865a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:19.661977 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:19.661915    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j8kg\" (UniqueName: \"kubernetes.io/projected/c637b062-64dc-4591-a5ec-395f06c865a1-kube-api-access-5j8kg\") pod \"maas-api-e2e-api-b-a47f42-984c895c8-b8hvp\" (UID: \"c637b062-64dc-4591-a5ec-395f06c865a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:20.151657 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:20.151615    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c637b062-64dc-4591-a5ec-395f06c865a1-maas-api-tls\") pod \"maas-api-e2e-api-b-a47f42-984c895c8-b8hvp\" (UID: \"c637b062-64dc-4591-a5ec-395f06c865a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:20.154207 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:20.154181    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c637b062-64dc-4591-a5ec-395f06c865a1-maas-api-tls\") pod \"maas-api-e2e-api-b-a47f42-984c895c8-b8hvp\" (UID: \"c637b062-64dc-4591-a5ec-395f06c865a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:20.317139 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:20.317097    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:20.461733 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:20.461708    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"]
Aug 05 19:45:20.464230 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:45:20.464188    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc637b062_64dc_4591_a5ec_395f06c865a1.slice/crio-4e6ca05bc9485f0ae6813f27bc2ec6c4389607d132527abcaf4eb86a0f728bf7 WatchSource:0}: Error finding container 4e6ca05bc9485f0ae6813f27bc2ec6c4389607d132527abcaf4eb86a0f728bf7: Status 404 returned error can't find the container with id 4e6ca05bc9485f0ae6813f27bc2ec6c4389607d132527abcaf4eb86a0f728bf7
Aug 05 19:45:20.584689 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:20.584655    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp" event={"ID":"c637b062-64dc-4591-a5ec-395f06c865a1","Type":"ContainerStarted","Data":"4e6ca05bc9485f0ae6813f27bc2ec6c4389607d132527abcaf4eb86a0f728bf7"}
Aug 05 19:45:21.591430 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:21.591387    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp" event={"ID":"c637b062-64dc-4591-a5ec-395f06c865a1","Type":"ContainerStarted","Data":"ac074fc52a6edd3615a465ec1b2177cf1ed331b186b02c19af3ba849d3e9249e"}
Aug 05 19:45:21.591864 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:21.591464    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:21.611489 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:21.611436    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp" podStartSLOduration=2.271534406 podStartE2EDuration="2.611420152s" totalImagesPullingTime="339.885746ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:45:21.610521607 +0000 UTC m=+2623.100456703" watchObservedRunningTime="2026-08-05 19:45:21.611420152 +0000 UTC m=+2623.101355225"
Aug 05 19:45:27.602279 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:27.602248    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:45:45.985827 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:45.985791    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c"]
Aug 05 19:45:45.990528 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:45.990506    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c"
Aug 05 19:45:45.992949 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:45.992923    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:45:45.997139 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:45.997055    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c"]
Aug 05 19:45:46.094536 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:46.094488    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fab5f8d0-aca5-45e0-bf23-b67800d20a23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-94093f-n7z9c\" (UID: \"fab5f8d0-aca5-45e0-bf23-b67800d20a23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c"
Aug 05 19:45:46.195785 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:46.195746    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fab5f8d0-aca5-45e0-bf23-b67800d20a23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-94093f-n7z9c\" (UID: \"fab5f8d0-aca5-45e0-bf23-b67800d20a23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c"
Aug 05 19:45:46.196424 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:46.196401    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fab5f8d0-aca5-45e0-bf23-b67800d20a23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-94093f-n7z9c\" (UID: \"fab5f8d0-aca5-45e0-bf23-b67800d20a23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c"
Aug 05 19:45:46.303301 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:46.303214    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c"
Aug 05 19:45:46.446049 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:46.446014    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c"]
Aug 05 19:45:46.447253 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:45:46.447217    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab5f8d0_aca5_45e0_bf23_b67800d20a23.slice/crio-787c5d9ce6be8165be110d8de632e3ea4809c69f53af94a47eec0e85e2204635 WatchSource:0}: Error finding container 787c5d9ce6be8165be110d8de632e3ea4809c69f53af94a47eec0e85e2204635: Status 404 returned error can't find the container with id 787c5d9ce6be8165be110d8de632e3ea4809c69f53af94a47eec0e85e2204635
Aug 05 19:45:46.746684 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:46.746650    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c" event={"ID":"fab5f8d0-aca5-45e0-bf23-b67800d20a23","Type":"ContainerStarted","Data":"787c5d9ce6be8165be110d8de632e3ea4809c69f53af94a47eec0e85e2204635"}
Aug 05 19:45:47.754286 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:47.754249    2533 generic.go:356] "Generic (PLEG): container finished" podID="fab5f8d0-aca5-45e0-bf23-b67800d20a23" containerID="53a94025ab85fce19da9ecc3ec7c409ff6221855b0a342baa63e1eec7a5d7862" exitCode=0
Aug 05 19:45:47.754705 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:47.754306    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c" event={"ID":"fab5f8d0-aca5-45e0-bf23-b67800d20a23","Type":"ContainerDied","Data":"53a94025ab85fce19da9ecc3ec7c409ff6221855b0a342baa63e1eec7a5d7862"}
Aug 05 19:45:48.893211 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:48.893184    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c"
Aug 05 19:45:48.921779 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:48.921745    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fab5f8d0-aca5-45e0-bf23-b67800d20a23-maas-api-service-ca\") pod \"fab5f8d0-aca5-45e0-bf23-b67800d20a23\" (UID: \"fab5f8d0-aca5-45e0-bf23-b67800d20a23\") "
Aug 05 19:45:48.922120 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:48.922099    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fab5f8d0-aca5-45e0-bf23-b67800d20a23-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fab5f8d0-aca5-45e0-bf23-b67800d20a23" (UID: "fab5f8d0-aca5-45e0-bf23-b67800d20a23"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:45:49.022432 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:49.022403    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fab5f8d0-aca5-45e0-bf23-b67800d20a23-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:45:49.766498 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:49.766468    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c"
Aug 05 19:45:49.766688 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:49.766503    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c" event={"ID":"fab5f8d0-aca5-45e0-bf23-b67800d20a23","Type":"ContainerDied","Data":"787c5d9ce6be8165be110d8de632e3ea4809c69f53af94a47eec0e85e2204635"}
Aug 05 19:45:49.766688 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:45:49.766559    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="787c5d9ce6be8165be110d8de632e3ea4809c69f53af94a47eec0e85e2204635"
Aug 05 19:46:01.540364 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.540309    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"]
Aug 05 19:46:01.540997 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.540581    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq" podUID="705eef8d-a7bd-42d0-9506-4da189f0d96e" containerName="maas-api" containerID="cri-o://e0d2cfda648f97871baa561515104b6d3e779e948d0e911c4ccba8405db7864b" gracePeriod=30
Aug 05 19:46:01.572109 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.572075    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94093f-29765985-gbtln"]
Aug 05 19:46:01.574497 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.574473    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94093f-29765985-gbtln"]
Aug 05 19:46:01.740972 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.740941    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c"]
Aug 05 19:46:01.743228 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.743201    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-94093f-n7z9c"]
Aug 05 19:46:01.797319 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.797246    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:46:01.833728 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.833696    2533 generic.go:356] "Generic (PLEG): container finished" podID="705eef8d-a7bd-42d0-9506-4da189f0d96e" containerID="e0d2cfda648f97871baa561515104b6d3e779e948d0e911c4ccba8405db7864b" exitCode=0
Aug 05 19:46:01.833923 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.833745    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"
Aug 05 19:46:01.833923 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.833782    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq" event={"ID":"705eef8d-a7bd-42d0-9506-4da189f0d96e","Type":"ContainerDied","Data":"e0d2cfda648f97871baa561515104b6d3e779e948d0e911c4ccba8405db7864b"}
Aug 05 19:46:01.833923 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.833849    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq" event={"ID":"705eef8d-a7bd-42d0-9506-4da189f0d96e","Type":"ContainerDied","Data":"23274ba12d7e3ed454a6c36cbb9d696fcab759bcccac744cbe7f6456cf4e4741"}
Aug 05 19:46:01.833923 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.833886    2533 scope.go:117] "RemoveContainer" containerID="e0d2cfda648f97871baa561515104b6d3e779e948d0e911c4ccba8405db7864b"
Aug 05 19:46:01.844619 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.844598    2533 scope.go:117] "RemoveContainer" containerID="e0d2cfda648f97871baa561515104b6d3e779e948d0e911c4ccba8405db7864b"
Aug 05 19:46:01.844981 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:46:01.844959    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0d2cfda648f97871baa561515104b6d3e779e948d0e911c4ccba8405db7864b\": container with ID starting with e0d2cfda648f97871baa561515104b6d3e779e948d0e911c4ccba8405db7864b not found: ID does not exist" containerID="e0d2cfda648f97871baa561515104b6d3e779e948d0e911c4ccba8405db7864b"
Aug 05 19:46:01.845060 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.845010    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0d2cfda648f97871baa561515104b6d3e779e948d0e911c4ccba8405db7864b"} err="failed to get container status \"e0d2cfda648f97871baa561515104b6d3e779e948d0e911c4ccba8405db7864b\": rpc error: code = NotFound desc = could not find container \"e0d2cfda648f97871baa561515104b6d3e779e948d0e911c4ccba8405db7864b\": container with ID starting with e0d2cfda648f97871baa561515104b6d3e779e948d0e911c4ccba8405db7864b not found: ID does not exist"
Aug 05 19:46:01.941250 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.941209    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/705eef8d-a7bd-42d0-9506-4da189f0d96e-maas-api-tls\") pod \"705eef8d-a7bd-42d0-9506-4da189f0d96e\" (UID: \"705eef8d-a7bd-42d0-9506-4da189f0d96e\") "
Aug 05 19:46:01.941439 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.941266    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/705eef8d-a7bd-42d0-9506-4da189f0d96e-openshift-service-ca\") pod \"705eef8d-a7bd-42d0-9506-4da189f0d96e\" (UID: \"705eef8d-a7bd-42d0-9506-4da189f0d96e\") "
Aug 05 19:46:01.941439 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.941287    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2x9q\" (UniqueName: \"kubernetes.io/projected/705eef8d-a7bd-42d0-9506-4da189f0d96e-kube-api-access-z2x9q\") pod \"705eef8d-a7bd-42d0-9506-4da189f0d96e\" (UID: \"705eef8d-a7bd-42d0-9506-4da189f0d96e\") "
Aug 05 19:46:01.941620 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.941595    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/705eef8d-a7bd-42d0-9506-4da189f0d96e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "705eef8d-a7bd-42d0-9506-4da189f0d96e" (UID: "705eef8d-a7bd-42d0-9506-4da189f0d96e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:46:01.943438 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.943413    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/705eef8d-a7bd-42d0-9506-4da189f0d96e-kube-api-access-z2x9q" (OuterVolumeSpecName: "kube-api-access-z2x9q") pod "705eef8d-a7bd-42d0-9506-4da189f0d96e" (UID: "705eef8d-a7bd-42d0-9506-4da189f0d96e"). InnerVolumeSpecName "kube-api-access-z2x9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:46:01.943583 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:01.943562    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/705eef8d-a7bd-42d0-9506-4da189f0d96e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "705eef8d-a7bd-42d0-9506-4da189f0d96e" (UID: "705eef8d-a7bd-42d0-9506-4da189f0d96e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:46:02.042486 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:02.042454    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/705eef8d-a7bd-42d0-9506-4da189f0d96e-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:46:02.042486 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:02.042482    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/705eef8d-a7bd-42d0-9506-4da189f0d96e-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:46:02.042486 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:02.042491    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2x9q\" (UniqueName: \"kubernetes.io/projected/705eef8d-a7bd-42d0-9506-4da189f0d96e-kube-api-access-z2x9q\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:46:02.156454 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:02.156418    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"]
Aug 05 19:46:02.160346 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:02.160313    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-94093f-8b8695c6-nplkq"]
Aug 05 19:46:03.013160 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:03.013121    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="705eef8d-a7bd-42d0-9506-4da189f0d96e" path="/var/lib/kubelet/pods/705eef8d-a7bd-42d0-9506-4da189f0d96e/volumes"
Aug 05 19:46:03.013651 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:03.013457    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fab5f8d0-aca5-45e0-bf23-b67800d20a23" path="/var/lib/kubelet/pods/fab5f8d0-aca5-45e0-bf23-b67800d20a23/volumes"
Aug 05 19:46:03.013712 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:03.013683    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd058434-facd-450b-adac-8ebe0094cd69" path="/var/lib/kubelet/pods/fd058434-facd-450b-adac-8ebe0094cd69/volumes"
Aug 05 19:46:08.332799 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.332762    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs"]
Aug 05 19:46:08.333301 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.333155    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="705eef8d-a7bd-42d0-9506-4da189f0d96e" containerName="maas-api"
Aug 05 19:46:08.333301 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.333168    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="705eef8d-a7bd-42d0-9506-4da189f0d96e" containerName="maas-api"
Aug 05 19:46:08.333301 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.333176    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fab5f8d0-aca5-45e0-bf23-b67800d20a23" containerName="revoke-keys"
Aug 05 19:46:08.333301 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.333182    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="fab5f8d0-aca5-45e0-bf23-b67800d20a23" containerName="revoke-keys"
Aug 05 19:46:08.333301 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.333255    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="705eef8d-a7bd-42d0-9506-4da189f0d96e" containerName="maas-api"
Aug 05 19:46:08.333301 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.333265    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="fab5f8d0-aca5-45e0-bf23-b67800d20a23" containerName="revoke-keys"
Aug 05 19:46:08.338000 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.337953    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs"
Aug 05 19:46:08.340460 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.340326    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:46:08.343179 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.343150    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs"]
Aug 05 19:46:08.402695 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.402658    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83f7ae93-ad06-4ce1-8740-1f4247c3880a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs\" (UID: \"83f7ae93-ad06-4ce1-8740-1f4247c3880a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs"
Aug 05 19:46:08.503606 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.503558    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83f7ae93-ad06-4ce1-8740-1f4247c3880a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs\" (UID: \"83f7ae93-ad06-4ce1-8740-1f4247c3880a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs"
Aug 05 19:46:08.504286 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.504264    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83f7ae93-ad06-4ce1-8740-1f4247c3880a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs\" (UID: \"83f7ae93-ad06-4ce1-8740-1f4247c3880a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs"
Aug 05 19:46:08.651173 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.651061    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs"
Aug 05 19:46:08.790268 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.790233    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs"]
Aug 05 19:46:08.791651 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:46:08.791627    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f7ae93_ad06_4ce1_8740_1f4247c3880a.slice/crio-d82a2da9e2da9512d37ac94a3cb8f140e2bca2a1b4d84932c9e18b4e7f2539b6 WatchSource:0}: Error finding container d82a2da9e2da9512d37ac94a3cb8f140e2bca2a1b4d84932c9e18b4e7f2539b6: Status 404 returned error can't find the container with id d82a2da9e2da9512d37ac94a3cb8f140e2bca2a1b4d84932c9e18b4e7f2539b6
Aug 05 19:46:08.878429 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:08.878387    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs" event={"ID":"83f7ae93-ad06-4ce1-8740-1f4247c3880a","Type":"ContainerStarted","Data":"d82a2da9e2da9512d37ac94a3cb8f140e2bca2a1b4d84932c9e18b4e7f2539b6"}
Aug 05 19:46:09.886024 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:09.885911    2533 generic.go:356] "Generic (PLEG): container finished" podID="83f7ae93-ad06-4ce1-8740-1f4247c3880a" containerID="77ea3b92acd2bf88c55b8daeb72bc330f3408857ae4cc8ac702a9cd2d3a2819a" exitCode=0
Aug 05 19:46:09.886024 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:09.885957    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs" event={"ID":"83f7ae93-ad06-4ce1-8740-1f4247c3880a","Type":"ContainerDied","Data":"77ea3b92acd2bf88c55b8daeb72bc330f3408857ae4cc8ac702a9cd2d3a2819a"}
Aug 05 19:46:11.025564 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:11.025535    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs"
Aug 05 19:46:11.130201 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:11.130159    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83f7ae93-ad06-4ce1-8740-1f4247c3880a-maas-api-service-ca\") pod \"83f7ae93-ad06-4ce1-8740-1f4247c3880a\" (UID: \"83f7ae93-ad06-4ce1-8740-1f4247c3880a\") "
Aug 05 19:46:11.130545 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:11.130519    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83f7ae93-ad06-4ce1-8740-1f4247c3880a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "83f7ae93-ad06-4ce1-8740-1f4247c3880a" (UID: "83f7ae93-ad06-4ce1-8740-1f4247c3880a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:46:11.231757 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:11.231718    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83f7ae93-ad06-4ce1-8740-1f4247c3880a-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:46:11.898835 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:11.898800    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs"
Aug 05 19:46:11.898835 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:11.898824    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs" event={"ID":"83f7ae93-ad06-4ce1-8740-1f4247c3880a","Type":"ContainerDied","Data":"d82a2da9e2da9512d37ac94a3cb8f140e2bca2a1b4d84932c9e18b4e7f2539b6"}
Aug 05 19:46:11.899133 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:11.898875    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d82a2da9e2da9512d37ac94a3cb8f140e2bca2a1b4d84932c9e18b4e7f2539b6"
Aug 05 19:46:23.762153 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:23.762118    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"]
Aug 05 19:46:23.762641 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:23.762384    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp" podUID="c637b062-64dc-4591-a5ec-395f06c865a1" containerName="maas-api" containerID="cri-o://ac074fc52a6edd3615a465ec1b2177cf1ed331b186b02c19af3ba849d3e9249e" gracePeriod=30
Aug 05 19:46:23.965721 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:23.965680    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs"]
Aug 05 19:46:23.974225 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:23.974185    2533 generic.go:356] "Generic (PLEG): container finished" podID="c637b062-64dc-4591-a5ec-395f06c865a1" containerID="ac074fc52a6edd3615a465ec1b2177cf1ed331b186b02c19af3ba849d3e9249e" exitCode=0
Aug 05 19:46:23.974548 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:23.974350    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp" event={"ID":"c637b062-64dc-4591-a5ec-395f06c865a1","Type":"ContainerDied","Data":"ac074fc52a6edd3615a465ec1b2177cf1ed331b186b02c19af3ba849d3e9249e"}
Aug 05 19:46:23.978051 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:23.978023    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a47f42-xvwbs"]
Aug 05 19:46:24.018564 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:24.018492    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:46:24.049740 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:24.049705    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c637b062-64dc-4591-a5ec-395f06c865a1-openshift-service-ca\") pod \"c637b062-64dc-4591-a5ec-395f06c865a1\" (UID: \"c637b062-64dc-4591-a5ec-395f06c865a1\") "
Aug 05 19:46:24.049740 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:24.049745    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j8kg\" (UniqueName: \"kubernetes.io/projected/c637b062-64dc-4591-a5ec-395f06c865a1-kube-api-access-5j8kg\") pod \"c637b062-64dc-4591-a5ec-395f06c865a1\" (UID: \"c637b062-64dc-4591-a5ec-395f06c865a1\") "
Aug 05 19:46:24.049948 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:24.049805    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c637b062-64dc-4591-a5ec-395f06c865a1-maas-api-tls\") pod \"c637b062-64dc-4591-a5ec-395f06c865a1\" (UID: \"c637b062-64dc-4591-a5ec-395f06c865a1\") "
Aug 05 19:46:24.050238 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:24.050206    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c637b062-64dc-4591-a5ec-395f06c865a1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c637b062-64dc-4591-a5ec-395f06c865a1" (UID: "c637b062-64dc-4591-a5ec-395f06c865a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:46:24.052015 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:24.051974    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c637b062-64dc-4591-a5ec-395f06c865a1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c637b062-64dc-4591-a5ec-395f06c865a1" (UID: "c637b062-64dc-4591-a5ec-395f06c865a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:46:24.052118 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:24.052036    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c637b062-64dc-4591-a5ec-395f06c865a1-kube-api-access-5j8kg" (OuterVolumeSpecName: "kube-api-access-5j8kg") pod "c637b062-64dc-4591-a5ec-395f06c865a1" (UID: "c637b062-64dc-4591-a5ec-395f06c865a1"). InnerVolumeSpecName "kube-api-access-5j8kg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:46:24.151528 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:24.151494    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c637b062-64dc-4591-a5ec-395f06c865a1-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:46:24.151528 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:24.151525    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j8kg\" (UniqueName: \"kubernetes.io/projected/c637b062-64dc-4591-a5ec-395f06c865a1-kube-api-access-5j8kg\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:46:24.151528 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:24.151535    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c637b062-64dc-4591-a5ec-395f06c865a1-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:46:24.981365 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:24.981332    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"
Aug 05 19:46:24.981829 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:24.981368    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp" event={"ID":"c637b062-64dc-4591-a5ec-395f06c865a1","Type":"ContainerDied","Data":"4e6ca05bc9485f0ae6813f27bc2ec6c4389607d132527abcaf4eb86a0f728bf7"}
Aug 05 19:46:24.981829 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:24.981429    2533 scope.go:117] "RemoveContainer" containerID="ac074fc52a6edd3615a465ec1b2177cf1ed331b186b02c19af3ba849d3e9249e"
Aug 05 19:46:25.003462 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:25.003430    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"]
Aug 05 19:46:25.013242 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:25.013203    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83f7ae93-ad06-4ce1-8740-1f4247c3880a" path="/var/lib/kubelet/pods/83f7ae93-ad06-4ce1-8740-1f4247c3880a/volumes"
Aug 05 19:46:25.013505 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:25.013490    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a47f42-984c895c8-b8hvp"]
Aug 05 19:46:27.012537 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:27.012504    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c637b062-64dc-4591-a5ec-395f06c865a1" path="/var/lib/kubelet/pods/c637b062-64dc-4591-a5ec-395f06c865a1/volumes"
Aug 05 19:46:34.844660 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:34.844581    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"]
Aug 05 19:46:34.845182 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:34.844969    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83f7ae93-ad06-4ce1-8740-1f4247c3880a" containerName="revoke-keys"
Aug 05 19:46:34.845182 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:34.844981    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="83f7ae93-ad06-4ce1-8740-1f4247c3880a" containerName="revoke-keys"
Aug 05 19:46:34.845182 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:34.845008    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c637b062-64dc-4591-a5ec-395f06c865a1" containerName="maas-api"
Aug 05 19:46:34.845182 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:34.845015    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="c637b062-64dc-4591-a5ec-395f06c865a1" containerName="maas-api"
Aug 05 19:46:34.845182 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:34.845086    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="83f7ae93-ad06-4ce1-8740-1f4247c3880a" containerName="revoke-keys"
Aug 05 19:46:34.845182 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:34.845095    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="c637b062-64dc-4591-a5ec-395f06c865a1" containerName="maas-api"
Aug 05 19:46:34.849668 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:34.849642    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 19:46:34.852023 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:34.851980    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-6a2d7d-serving-cert\""
Aug 05 19:46:34.860129 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:34.860099    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"]
Aug 05 19:46:34.950909 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:34.950867    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82b25882-a39e-4a75-9b0b-0e08fe96966a-maas-api-tls\") pod \"maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw\" (UID: \"82b25882-a39e-4a75-9b0b-0e08fe96966a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 19:46:34.951137 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:34.950935    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b25882-a39e-4a75-9b0b-0e08fe96966a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw\" (UID: \"82b25882-a39e-4a75-9b0b-0e08fe96966a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 19:46:34.951137 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:34.951020    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g7nm\" (UniqueName: \"kubernetes.io/projected/82b25882-a39e-4a75-9b0b-0e08fe96966a-kube-api-access-2g7nm\") pod \"maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw\" (UID: \"82b25882-a39e-4a75-9b0b-0e08fe96966a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 19:46:35.052142 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:35.052097    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g7nm\" (UniqueName: \"kubernetes.io/projected/82b25882-a39e-4a75-9b0b-0e08fe96966a-kube-api-access-2g7nm\") pod \"maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw\" (UID: \"82b25882-a39e-4a75-9b0b-0e08fe96966a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 19:46:35.052310 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:35.052166    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82b25882-a39e-4a75-9b0b-0e08fe96966a-maas-api-tls\") pod \"maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw\" (UID: \"82b25882-a39e-4a75-9b0b-0e08fe96966a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 19:46:35.052310 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:35.052205    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b25882-a39e-4a75-9b0b-0e08fe96966a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw\" (UID: \"82b25882-a39e-4a75-9b0b-0e08fe96966a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 19:46:35.052801 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:35.052772    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b25882-a39e-4a75-9b0b-0e08fe96966a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw\" (UID: \"82b25882-a39e-4a75-9b0b-0e08fe96966a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 19:46:35.054684 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:35.054662    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82b25882-a39e-4a75-9b0b-0e08fe96966a-maas-api-tls\") pod \"maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw\" (UID: \"82b25882-a39e-4a75-9b0b-0e08fe96966a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 19:46:35.059951 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:35.059924    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g7nm\" (UniqueName: \"kubernetes.io/projected/82b25882-a39e-4a75-9b0b-0e08fe96966a-kube-api-access-2g7nm\") pod \"maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw\" (UID: \"82b25882-a39e-4a75-9b0b-0e08fe96966a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 19:46:35.162252 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:35.162142    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 19:46:35.304092 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:35.304055    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"]
Aug 05 19:46:35.305607 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:46:35.305570    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b25882_a39e_4a75_9b0b_0e08fe96966a.slice/crio-0b980a7cec03230778d0149cb61e510e5f2a4614058c9fbb1254482d5a281044 WatchSource:0}: Error finding container 0b980a7cec03230778d0149cb61e510e5f2a4614058c9fbb1254482d5a281044: Status 404 returned error can't find the container with id 0b980a7cec03230778d0149cb61e510e5f2a4614058c9fbb1254482d5a281044
Aug 05 19:46:36.043401 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:36.043296    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw" event={"ID":"82b25882-a39e-4a75-9b0b-0e08fe96966a","Type":"ContainerStarted","Data":"e1e32dae30db252a6352d213848b57a164bec38d934423245c5dde59e42f00bc"}
Aug 05 19:46:36.043401 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:36.043389    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw" event={"ID":"82b25882-a39e-4a75-9b0b-0e08fe96966a","Type":"ContainerStarted","Data":"0b980a7cec03230778d0149cb61e510e5f2a4614058c9fbb1254482d5a281044"}
Aug 05 19:46:36.043857 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:36.043464    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 19:46:36.063743 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:36.063686    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw" podStartSLOduration=1.620268393 podStartE2EDuration="2.063668963s" totalImagesPullingTime="443.40057ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:46:36.062154197 +0000 UTC m=+2697.552089292" watchObservedRunningTime="2026-08-05 19:46:36.063668963 +0000 UTC m=+2697.553604059"
Aug 05 19:46:39.358407 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:39.358371    2533 scope.go:117] "RemoveContainer" containerID="9a2eb626ee2dffe4cc9a84a1de21210bfda4796f26f08a384b2a46e1cd945965"
Aug 05 19:46:42.053686 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:46:42.053652    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 19:47:03.099195 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.099152    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"]
Aug 05 19:47:03.102273 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.102246    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 19:47:03.104505 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.104484    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-1df35a-serving-cert\""
Aug 05 19:47:03.113735 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.113707    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"]
Aug 05 19:47:03.215254 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.215213    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv\" (UID: \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 19:47:03.215436 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.215268    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57mwl\" (UniqueName: \"kubernetes.io/projected/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-kube-api-access-57mwl\") pod \"maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv\" (UID: \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 19:47:03.215436 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.215287    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-maas-api-tls\") pod \"maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv\" (UID: \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 19:47:03.316230 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.316184    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv\" (UID: \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 19:47:03.316433 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.316256    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57mwl\" (UniqueName: \"kubernetes.io/projected/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-kube-api-access-57mwl\") pod \"maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv\" (UID: \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 19:47:03.316433 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.316283    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-maas-api-tls\") pod \"maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv\" (UID: \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 19:47:03.316826 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.316803    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv\" (UID: \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 19:47:03.318775 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.318751    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-maas-api-tls\") pod \"maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv\" (UID: \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 19:47:03.323977 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.323947    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57mwl\" (UniqueName: \"kubernetes.io/projected/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-kube-api-access-57mwl\") pod \"maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv\" (UID: \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 19:47:03.416431 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.416339    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 19:47:03.558360 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:03.558332    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"]
Aug 05 19:47:03.560839 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:47:03.560798    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fadcc7c_427d_4c91_ad39_959b2f8a2e8f.slice/crio-28ead955d0d9d474b003134c014652316642db52d7e547c0f77e91d5fb7b362b WatchSource:0}: Error finding container 28ead955d0d9d474b003134c014652316642db52d7e547c0f77e91d5fb7b362b: Status 404 returned error can't find the container with id 28ead955d0d9d474b003134c014652316642db52d7e547c0f77e91d5fb7b362b
Aug 05 19:47:04.197571 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:04.197476    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv" event={"ID":"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f","Type":"ContainerStarted","Data":"80dd2a3284624a4a7e0d34a0d37d383b4d28273b6f83185d987e74cfcad1449b"}
Aug 05 19:47:04.197571 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:04.197565    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv" event={"ID":"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f","Type":"ContainerStarted","Data":"28ead955d0d9d474b003134c014652316642db52d7e547c0f77e91d5fb7b362b"}
Aug 05 19:47:04.198101 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:04.197624    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 19:47:04.213844 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:04.213788    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv" podStartSLOduration=0.831980396 podStartE2EDuration="1.213769264s" totalImagesPullingTime="381.788868ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:47:04.212618301 +0000 UTC m=+2725.702553401" watchObservedRunningTime="2026-08-05 19:47:04.213769264 +0000 UTC m=+2725.703704340"
Aug 05 19:47:10.208962 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:47:10.208927    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 19:50:39.415409 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:50:39.415275    2533 scope.go:117] "RemoveContainer" containerID="ee6da7b960c7e728441041a08ec45a000856d88e32a1595609f3e410b8e5efb3"
Aug 05 19:50:39.423891 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:50:39.423866    2533 scope.go:117] "RemoveContainer" containerID="72b1681077f1d87dc6269a2121612b6367ebee36ab99051c5b649ebdc7c551f3"
Aug 05 19:51:39.448485 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:51:39.448402    2533 scope.go:117] "RemoveContainer" containerID="20b7cf7531ea70aa3b8b6a389c1844a2193e1e38771a2f21ec36a957f2ced1bd"
Aug 05 19:52:19.594954 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.594920    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"]
Aug 05 19:52:19.598559 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.598535    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.601822 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.601795    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a2d7d\"/\"openshift-service-ca.crt\""
Aug 05 19:52:19.601978 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.601803    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a2d7d\"/\"sub-test-model-6a2d7d-kserve-self-signed-certs\""
Aug 05 19:52:19.601978 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.601865    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6a2d7d\"/\"kube-root-ca.crt\""
Aug 05 19:52:19.601978 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.601804    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6a2d7d\"/\"default-dockercfg-khw9g\""
Aug 05 19:52:19.607527 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.607498    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"]
Aug 05 19:52:19.704738 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.704704    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-dshm\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.704738 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.704749    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-home\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.705039 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.704856    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-tmp-dir\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.705039 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.704900    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4374aeeb-49dc-47f2-9a45-c50acc5ae429-tls-certs\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.705039 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.704933    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-model-cache\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.705039 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.704970    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjfcl\" (UniqueName: \"kubernetes.io/projected/4374aeeb-49dc-47f2-9a45-c50acc5ae429-kube-api-access-jjfcl\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.805578 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.805539    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-tmp-dir\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.805578 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.805576    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4374aeeb-49dc-47f2-9a45-c50acc5ae429-tls-certs\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.805829 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.805594    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-model-cache\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.805829 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.805712    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfcl\" (UniqueName: \"kubernetes.io/projected/4374aeeb-49dc-47f2-9a45-c50acc5ae429-kube-api-access-jjfcl\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.805829 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.805815    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-dshm\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.806030 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.805864    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-home\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.806030 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.805892    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-model-cache\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.806030 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.805974    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-tmp-dir\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.806182 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.806165    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-home\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.807930 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.807907    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-dshm\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.808200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.808185    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4374aeeb-49dc-47f2-9a45-c50acc5ae429-tls-certs\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.816044 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.816019    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjfcl\" (UniqueName: \"kubernetes.io/projected/4374aeeb-49dc-47f2-9a45-c50acc5ae429-kube-api-access-jjfcl\") pod \"sub-test-model-6a2d7d-kserve-56b477987-cdtvn\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") " pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:19.909220 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:19.909129    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:20.047360 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:20.047335    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"]
Aug 05 19:52:20.049106 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:52:20.049079    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4374aeeb_49dc_47f2_9a45_c50acc5ae429.slice/crio-03108a5de6214eb58ee4d4f1e6f7039e1ccd7ba153506ed66ed656339355e34a WatchSource:0}: Error finding container 03108a5de6214eb58ee4d4f1e6f7039e1ccd7ba153506ed66ed656339355e34a: Status 404 returned error can't find the container with id 03108a5de6214eb58ee4d4f1e6f7039e1ccd7ba153506ed66ed656339355e34a
Aug 05 19:52:20.944770 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:20.944732    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn" event={"ID":"4374aeeb-49dc-47f2-9a45-c50acc5ae429","Type":"ContainerStarted","Data":"221b366f20391f798684d5b24a6dcda771d65c6363a54dd2db62528a0e8eceab"}
Aug 05 19:52:20.945208 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:20.944785    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn" event={"ID":"4374aeeb-49dc-47f2-9a45-c50acc5ae429","Type":"ContainerStarted","Data":"03108a5de6214eb58ee4d4f1e6f7039e1ccd7ba153506ed66ed656339355e34a"}
Aug 05 19:52:20.963039 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:20.962964    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn" podStartSLOduration=1.9629495559999999 podStartE2EDuration="1.962949556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:52:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:52:20.961300564 +0000 UTC m=+3042.451235641" watchObservedRunningTime="2026-08-05 19:52:20.962949556 +0000 UTC m=+3042.452884633"
Aug 05 19:52:29.910189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:29.910142    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:29.910189 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:29.910197    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:29.923104 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:29.923064    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:30.005774 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:30.005740    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:52:39.470730 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:39.470636    2533 scope.go:117] "RemoveContainer" containerID="53a94025ab85fce19da9ecc3ec7c409ff6221855b0a342baa63e1eec7a5d7862"
Aug 05 19:52:39.481542 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:52:39.481511    2533 scope.go:117] "RemoveContainer" containerID="77ea3b92acd2bf88c55b8daeb72bc330f3408857ae4cc8ac702a9cd2d3a2819a"
Aug 05 19:53:46.260931 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:53:46.260876    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"]
Aug 05 19:54:01.280275 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.280190    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn" podUID="4374aeeb-49dc-47f2-9a45-c50acc5ae429" containerName="main" containerID="cri-o://221b366f20391f798684d5b24a6dcda771d65c6363a54dd2db62528a0e8eceab" gracePeriod=45
Aug 05 19:54:01.501512 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.501479    2533 generic.go:356] "Generic (PLEG): container finished" podID="4374aeeb-49dc-47f2-9a45-c50acc5ae429" containerID="221b366f20391f798684d5b24a6dcda771d65c6363a54dd2db62528a0e8eceab" exitCode=0
Aug 05 19:54:01.501705 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.501548    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn" event={"ID":"4374aeeb-49dc-47f2-9a45-c50acc5ae429","Type":"ContainerDied","Data":"221b366f20391f798684d5b24a6dcda771d65c6363a54dd2db62528a0e8eceab"}
Aug 05 19:54:01.525451 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.525420    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:54:01.574515 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.574420    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4374aeeb-49dc-47f2-9a45-c50acc5ae429-tls-certs\") pod \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") "
Aug 05 19:54:01.574515 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.574481    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-home\") pod \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") "
Aug 05 19:54:01.574762 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.574524    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-dshm\") pod \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") "
Aug 05 19:54:01.574762 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.574544    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjfcl\" (UniqueName: \"kubernetes.io/projected/4374aeeb-49dc-47f2-9a45-c50acc5ae429-kube-api-access-jjfcl\") pod \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") "
Aug 05 19:54:01.574762 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.574606    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-model-cache\") pod \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") "
Aug 05 19:54:01.574762 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.574648    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-tmp-dir\") pod \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\" (UID: \"4374aeeb-49dc-47f2-9a45-c50acc5ae429\") "
Aug 05 19:54:01.574966 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.574799    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-home" (OuterVolumeSpecName: "home") pod "4374aeeb-49dc-47f2-9a45-c50acc5ae429" (UID: "4374aeeb-49dc-47f2-9a45-c50acc5ae429"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:54:01.574966 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.574930    2533 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-home\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:54:01.575258 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.575212    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-model-cache" (OuterVolumeSpecName: "model-cache") pod "4374aeeb-49dc-47f2-9a45-c50acc5ae429" (UID: "4374aeeb-49dc-47f2-9a45-c50acc5ae429"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:54:01.575258 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.575234    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4374aeeb-49dc-47f2-9a45-c50acc5ae429" (UID: "4374aeeb-49dc-47f2-9a45-c50acc5ae429"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:54:01.577076 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.577049    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4374aeeb-49dc-47f2-9a45-c50acc5ae429-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4374aeeb-49dc-47f2-9a45-c50acc5ae429" (UID: "4374aeeb-49dc-47f2-9a45-c50acc5ae429"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:54:01.577318 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.577286    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4374aeeb-49dc-47f2-9a45-c50acc5ae429-kube-api-access-jjfcl" (OuterVolumeSpecName: "kube-api-access-jjfcl") pod "4374aeeb-49dc-47f2-9a45-c50acc5ae429" (UID: "4374aeeb-49dc-47f2-9a45-c50acc5ae429"). InnerVolumeSpecName "kube-api-access-jjfcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:54:01.577601 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.577570    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-dshm" (OuterVolumeSpecName: "dshm") pod "4374aeeb-49dc-47f2-9a45-c50acc5ae429" (UID: "4374aeeb-49dc-47f2-9a45-c50acc5ae429"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:54:01.676063 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.676021    2533 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-dshm\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:54:01.676063 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.676058    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjfcl\" (UniqueName: \"kubernetes.io/projected/4374aeeb-49dc-47f2-9a45-c50acc5ae429-kube-api-access-jjfcl\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:54:01.676283 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.676072    2533 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-model-cache\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:54:01.676283 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.676088    2533 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4374aeeb-49dc-47f2-9a45-c50acc5ae429-tmp-dir\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:54:01.676283 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:01.676099    2533 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4374aeeb-49dc-47f2-9a45-c50acc5ae429-tls-certs\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:54:02.508169 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:02.508138    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"
Aug 05 19:54:02.508616 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:02.508174    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn" event={"ID":"4374aeeb-49dc-47f2-9a45-c50acc5ae429","Type":"ContainerDied","Data":"03108a5de6214eb58ee4d4f1e6f7039e1ccd7ba153506ed66ed656339355e34a"}
Aug 05 19:54:02.508616 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:02.508225    2533 scope.go:117] "RemoveContainer" containerID="221b366f20391f798684d5b24a6dcda771d65c6363a54dd2db62528a0e8eceab"
Aug 05 19:54:02.529711 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:02.529678    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"]
Aug 05 19:54:02.535820 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:02.535787    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6a2d7d/sub-test-model-6a2d7d-kserve-56b477987-cdtvn"]
Aug 05 19:54:03.013182 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:54:03.013151    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4374aeeb-49dc-47f2-9a45-c50acc5ae429" path="/var/lib/kubelet/pods/4374aeeb-49dc-47f2-9a45-c50acc5ae429/volumes"
Aug 05 19:56:14.350220 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:14.350181    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7627-139713598673328"]
Aug 05 19:56:14.352748 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:14.350579    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4374aeeb-49dc-47f2-9a45-c50acc5ae429" containerName="main"
Aug 05 19:56:14.352748 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:14.350592    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="4374aeeb-49dc-47f2-9a45-c50acc5ae429" containerName="main"
Aug 05 19:56:14.352748 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:14.350652    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="4374aeeb-49dc-47f2-9a45-c50acc5ae429" containerName="main"
Aug 05 19:56:14.353762 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:14.353744    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598673328"
Aug 05 19:56:14.356374 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:14.356346    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nrk4n\""
Aug 05 19:56:14.359366 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:14.359343    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7627-139713598673328"]
Aug 05 19:56:14.402656 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:14.402617    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6f44\" (UniqueName: \"kubernetes.io/projected/7536f2d8-a9f8-4a0b-bd32-9f3828b6594a-kube-api-access-w6f44\") pod \"test-curl-7627-139713598673328\" (UID: \"7536f2d8-a9f8-4a0b-bd32-9f3828b6594a\") " pod="opendatahub/test-curl-7627-139713598673328"
Aug 05 19:56:14.503328 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:14.503273    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6f44\" (UniqueName: \"kubernetes.io/projected/7536f2d8-a9f8-4a0b-bd32-9f3828b6594a-kube-api-access-w6f44\") pod \"test-curl-7627-139713598673328\" (UID: \"7536f2d8-a9f8-4a0b-bd32-9f3828b6594a\") " pod="opendatahub/test-curl-7627-139713598673328"
Aug 05 19:56:14.511522 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:14.511489    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6f44\" (UniqueName: \"kubernetes.io/projected/7536f2d8-a9f8-4a0b-bd32-9f3828b6594a-kube-api-access-w6f44\") pod \"test-curl-7627-139713598673328\" (UID: \"7536f2d8-a9f8-4a0b-bd32-9f3828b6594a\") " pod="opendatahub/test-curl-7627-139713598673328"
Aug 05 19:56:14.664562 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:14.664474    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598673328"
Aug 05 19:56:14.798507 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:14.798481    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7627-139713598673328"]
Aug 05 19:56:14.800576 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:56:14.800550    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7536f2d8_a9f8_4a0b_bd32_9f3828b6594a.slice/crio-6dca90fa5c1a7c20d4878d5c328e9b86e1c5307fc2c2cc281e0c0833ecae5b34 WatchSource:0}: Error finding container 6dca90fa5c1a7c20d4878d5c328e9b86e1c5307fc2c2cc281e0c0833ecae5b34: Status 404 returned error can't find the container with id 6dca90fa5c1a7c20d4878d5c328e9b86e1c5307fc2c2cc281e0c0833ecae5b34
Aug 05 19:56:14.801817 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:14.801796    2533 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 19:56:15.218478 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:15.218437    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7627-139713598673328" event={"ID":"7536f2d8-a9f8-4a0b-bd32-9f3828b6594a","Type":"ContainerStarted","Data":"6dca90fa5c1a7c20d4878d5c328e9b86e1c5307fc2c2cc281e0c0833ecae5b34"}
Aug 05 19:56:16.225295 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:16.225261    2533 generic.go:356] "Generic (PLEG): container finished" podID="7536f2d8-a9f8-4a0b-bd32-9f3828b6594a" containerID="025bf3d4ef6c3a31fb8a835026c5af242c84188136bf62be3a132776733475af" exitCode=0
Aug 05 19:56:16.225684 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:16.225314    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7627-139713598673328" event={"ID":"7536f2d8-a9f8-4a0b-bd32-9f3828b6594a","Type":"ContainerDied","Data":"025bf3d4ef6c3a31fb8a835026c5af242c84188136bf62be3a132776733475af"}
Aug 05 19:56:17.365147 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.365115    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598673328"
Aug 05 19:56:17.398746 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.398718    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7627-139713598673328_7536f2d8-a9f8-4a0b-bd32-9f3828b6594a/test-curl-7627-139713598673328/0.log"
Aug 05 19:56:17.420546 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.420506    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7627-139713598673328"]
Aug 05 19:56:17.424019 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.423979    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7627-139713598673328"]
Aug 05 19:56:17.430695 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.430667    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6f44\" (UniqueName: \"kubernetes.io/projected/7536f2d8-a9f8-4a0b-bd32-9f3828b6594a-kube-api-access-w6f44\") pod \"7536f2d8-a9f8-4a0b-bd32-9f3828b6594a\" (UID: \"7536f2d8-a9f8-4a0b-bd32-9f3828b6594a\") "
Aug 05 19:56:17.432825 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.432799    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7536f2d8-a9f8-4a0b-bd32-9f3828b6594a-kube-api-access-w6f44" (OuterVolumeSpecName: "kube-api-access-w6f44") pod "7536f2d8-a9f8-4a0b-bd32-9f3828b6594a" (UID: "7536f2d8-a9f8-4a0b-bd32-9f3828b6594a"). InnerVolumeSpecName "kube-api-access-w6f44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:56:17.532142 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.532037    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6f44\" (UniqueName: \"kubernetes.io/projected/7536f2d8-a9f8-4a0b-bd32-9f3828b6594a-kube-api-access-w6f44\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:56:17.577046 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.577010    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7627-139713598508320"]
Aug 05 19:56:17.577393 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.577379    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7536f2d8-a9f8-4a0b-bd32-9f3828b6594a" containerName="test-curl-7627-139713598673328"
Aug 05 19:56:17.577437 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.577394    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="7536f2d8-a9f8-4a0b-bd32-9f3828b6594a" containerName="test-curl-7627-139713598673328"
Aug 05 19:56:17.577472 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.577462    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="7536f2d8-a9f8-4a0b-bd32-9f3828b6594a" containerName="test-curl-7627-139713598673328"
Aug 05 19:56:17.580536 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.580517    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598508320"
Aug 05 19:56:17.586520 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.586491    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7627-139713598508320"]
Aug 05 19:56:17.633374 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.633328    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9snh\" (UniqueName: \"kubernetes.io/projected/7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4-kube-api-access-l9snh\") pod \"test-curl-7627-139713598508320\" (UID: \"7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4\") " pod="opendatahub/test-curl-7627-139713598508320"
Aug 05 19:56:17.734282 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.734237    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9snh\" (UniqueName: \"kubernetes.io/projected/7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4-kube-api-access-l9snh\") pod \"test-curl-7627-139713598508320\" (UID: \"7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4\") " pod="opendatahub/test-curl-7627-139713598508320"
Aug 05 19:56:17.742001 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.741962    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9snh\" (UniqueName: \"kubernetes.io/projected/7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4-kube-api-access-l9snh\") pod \"test-curl-7627-139713598508320\" (UID: \"7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4\") " pod="opendatahub/test-curl-7627-139713598508320"
Aug 05 19:56:17.891487 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:17.891395    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598508320"
Aug 05 19:56:18.024605 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:18.024578    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7627-139713598508320"]
Aug 05 19:56:18.026294 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:56:18.026271    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fa3bb12_25ce_4a6e_ae16_d1676fe4bfb4.slice/crio-1d4dae90d58e751cb28eeb5b07c89f1b759277b1612532c9e688cc410d89a8c5 WatchSource:0}: Error finding container 1d4dae90d58e751cb28eeb5b07c89f1b759277b1612532c9e688cc410d89a8c5: Status 404 returned error can't find the container with id 1d4dae90d58e751cb28eeb5b07c89f1b759277b1612532c9e688cc410d89a8c5
Aug 05 19:56:18.237423 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:18.237383    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7627-139713598508320" event={"ID":"7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4","Type":"ContainerStarted","Data":"1d4dae90d58e751cb28eeb5b07c89f1b759277b1612532c9e688cc410d89a8c5"}
Aug 05 19:56:18.238734 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:18.238708    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6dca90fa5c1a7c20d4878d5c328e9b86e1c5307fc2c2cc281e0c0833ecae5b34"
Aug 05 19:56:18.238734 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:18.238712    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598673328"
Aug 05 19:56:18.249822 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:56:18.249781    2533 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7627-139713598673328\" is forbidden: User \"system:node:ip-10-0-143-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-76.ec2.internal' and this object" podUID="7536f2d8-a9f8-4a0b-bd32-9f3828b6594a" pod="opendatahub/test-curl-7627-139713598673328"
Aug 05 19:56:19.012855 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:56:19.012675    2533 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7627-139713598673328\" is forbidden: User \"system:node:ip-10-0-143-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-76.ec2.internal' and this object" podUID="7536f2d8-a9f8-4a0b-bd32-9f3828b6594a" pod="opendatahub/test-curl-7627-139713598673328"
Aug 05 19:56:19.015624 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:19.015591    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7536f2d8-a9f8-4a0b-bd32-9f3828b6594a" path="/var/lib/kubelet/pods/7536f2d8-a9f8-4a0b-bd32-9f3828b6594a/volumes"
Aug 05 19:56:19.245752 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:19.245717    2533 generic.go:356] "Generic (PLEG): container finished" podID="7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4" containerID="33359e68d2e477fe908cab85c627663a11f78d6917f67530c1b404b4cfb0fa21" exitCode=0
Aug 05 19:56:19.245752 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:19.245758    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7627-139713598508320" event={"ID":"7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4","Type":"ContainerDied","Data":"33359e68d2e477fe908cab85c627663a11f78d6917f67530c1b404b4cfb0fa21"}
Aug 05 19:56:20.384455 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:20.384429    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598508320"
Aug 05 19:56:20.404666 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:20.404633    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7627-139713598508320_7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4/test-curl-7627-139713598508320/0.log"
Aug 05 19:56:20.426953 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:20.426918    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7627-139713598508320"]
Aug 05 19:56:20.430867 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:20.430836    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7627-139713598508320"]
Aug 05 19:56:20.461681 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:20.461653    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9snh\" (UniqueName: \"kubernetes.io/projected/7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4-kube-api-access-l9snh\") pod \"7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4\" (UID: \"7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4\") "
Aug 05 19:56:20.463785 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:20.463755    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4-kube-api-access-l9snh" (OuterVolumeSpecName: "kube-api-access-l9snh") pod "7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4" (UID: "7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4"). InnerVolumeSpecName "kube-api-access-l9snh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:56:20.563595 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:20.563502    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9snh\" (UniqueName: \"kubernetes.io/projected/7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4-kube-api-access-l9snh\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:56:21.012965 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:21.012929    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4" path="/var/lib/kubelet/pods/7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4/volumes"
Aug 05 19:56:21.258835 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:21.258808    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598508320"
Aug 05 19:56:21.258835 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:21.258836    2533 scope.go:117] "RemoveContainer" containerID="33359e68d2e477fe908cab85c627663a11f78d6917f67530c1b404b4cfb0fa21"
Aug 05 19:56:34.149049 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.149006    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"]
Aug 05 19:56:34.149607 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.149585    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4" containerName="test-curl-7627-139713598508320"
Aug 05 19:56:34.149668 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.149611    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4" containerName="test-curl-7627-139713598508320"
Aug 05 19:56:34.149732 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.149719    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fa3bb12-25ce-4a6e-ae16-d1676fe4bfb4" containerName="test-curl-7627-139713598508320"
Aug 05 19:56:34.155559 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.155537    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:34.158269 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.158244    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-c686d7-serving-cert\""
Aug 05 19:56:34.160589 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.160556    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"]
Aug 05 19:56:34.292266 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.292226    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmc6z\" (UniqueName: \"kubernetes.io/projected/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-kube-api-access-wmc6z\") pod \"maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx\" (UID: \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:34.292458 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.292277    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx\" (UID: \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:34.292458 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.292310    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx\" (UID: \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:34.393479 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.393440    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmc6z\" (UniqueName: \"kubernetes.io/projected/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-kube-api-access-wmc6z\") pod \"maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx\" (UID: \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:34.393668 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.393501    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx\" (UID: \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:34.393668 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.393527    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx\" (UID: \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:34.393744 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:56:34.393670    2533 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-serving-cert: secret "maas-api-e2e-ipp-a-c686d7-serving-cert" not found
Aug 05 19:56:34.393780 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:56:34.393749    2533 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-maas-api-tls podName:9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3 nodeName:}" failed. No retries permitted until 2026-08-05 19:56:34.893730259 +0000 UTC m=+3296.383665311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-maas-api-tls") pod "maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx" (UID: "9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3") : secret "maas-api-e2e-ipp-a-c686d7-serving-cert" not found
Aug 05 19:56:34.394199 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.394182    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx\" (UID: \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:34.403251 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.403150    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmc6z\" (UniqueName: \"kubernetes.io/projected/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-kube-api-access-wmc6z\") pod \"maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx\" (UID: \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:34.898403 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.898356    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx\" (UID: \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:34.900881 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:34.900850    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx\" (UID: \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:35.069073 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:35.069032    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:35.211498 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:35.211465    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"]
Aug 05 19:56:35.213392 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:56:35.213369    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0a66ed_12b2_4bcc_be84_6bc8b8cb2ca3.slice/crio-0c34c998d704b09307ee3119d1d3338267c2403dbfcded57f3419cdf537e83c4 WatchSource:0}: Error finding container 0c34c998d704b09307ee3119d1d3338267c2403dbfcded57f3419cdf537e83c4: Status 404 returned error can't find the container with id 0c34c998d704b09307ee3119d1d3338267c2403dbfcded57f3419cdf537e83c4
Aug 05 19:56:35.338500 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:35.338465    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx" event={"ID":"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3","Type":"ContainerStarted","Data":"0c34c998d704b09307ee3119d1d3338267c2403dbfcded57f3419cdf537e83c4"}
Aug 05 19:56:36.349347 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:36.349307    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx" event={"ID":"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3","Type":"ContainerStarted","Data":"47fb572f03e8e7ea401c8da91113a0241a1dbb6b709d48abae7891b1df32069f"}
Aug 05 19:56:36.349852 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:36.349379    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:36.370115 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:36.370061    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx" podStartSLOduration=1.974693663 podStartE2EDuration="2.370044754s" totalImagesPullingTime="395.351091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:56:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:56:36.368581792 +0000 UTC m=+3297.858516908" watchObservedRunningTime="2026-08-05 19:56:36.370044754 +0000 UTC m=+3297.859979828"
Aug 05 19:56:42.360622 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:42.360592    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:56:58.917525 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:58.917486    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"]
Aug 05 19:56:58.921304 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:58.921278    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:58.923539 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:58.923519    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-a1e3e2-openshift-default-dockercfg-qfkjm\""
Aug 05 19:56:58.932750 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:58.932717    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"]
Aug 05 19:56:59.028646 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.028609    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-data\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.028646 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.028644    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-token\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.028861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.028667    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-envoy\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.028861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.028770    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istiod-ca-cert\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.028861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.028803    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcpj9\" (UniqueName: \"kubernetes.io/projected/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-kube-api-access-pcpj9\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.028861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.028826    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-podinfo\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.029080 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.028912    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-credential-socket\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.029080 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.028956    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-workload-certs\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.029080 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.029038    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-workload-socket\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.130254 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.130221    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcpj9\" (UniqueName: \"kubernetes.io/projected/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-kube-api-access-pcpj9\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.130254 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.130258    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-podinfo\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.130519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.130317    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-credential-socket\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.130519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.130364    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-workload-certs\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.130519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.130411    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-workload-socket\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.130519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.130456    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-data\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.130519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.130478    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-token\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.130519 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.130502    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-envoy\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.130837 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.130567    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istiod-ca-cert\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.130837 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.130789    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-credential-socket\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.130940 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.130830    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-workload-certs\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.131180 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.131159    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-workload-socket\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.131294 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.131189    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-data\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.131348 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.131335    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istiod-ca-cert\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.132878 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.132843    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-podinfo\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.133046 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.133028    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-envoy\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.138022 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.137968    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-token\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.138131 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.138047    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcpj9\" (UniqueName: \"kubernetes.io/projected/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-kube-api-access-pcpj9\") pod \"e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") " pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.233810 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.233775    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:56:59.384140 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.384114    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"]
Aug 05 19:56:59.386016 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:56:59.385972    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc6f3e4_ce97_4b16_bb0a_cebb399ed223.slice/crio-96d187653eb1c48a7da417c035d22bb736527d77bfb2c6f97e9f31633c59f427 WatchSource:0}: Error finding container 96d187653eb1c48a7da417c035d22bb736527d77bfb2c6f97e9f31633c59f427: Status 404 returned error can't find the container with id 96d187653eb1c48a7da417c035d22bb736527d77bfb2c6f97e9f31633c59f427
Aug 05 19:56:59.473404 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:56:59.473363    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" event={"ID":"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223","Type":"ContainerStarted","Data":"96d187653eb1c48a7da417c035d22bb736527d77bfb2c6f97e9f31633c59f427"}
Aug 05 19:57:01.998017 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:01.997966    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:57:01.998259 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:01.998054    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:57:01.998259 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:01.998086    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:57:02.491489 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:02.491455    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" event={"ID":"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223","Type":"ContainerStarted","Data":"112c0e01f245b1a455378e09cc623ce15e71624a1c039ad0abf75edf876f398e"}
Aug 05 19:57:02.511193 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:02.511126    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" podStartSLOduration=1.901728405 podStartE2EDuration="4.511107678s" totalImagesPullingTime="2.609379273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:57:02.509318184 +0000 UTC m=+3323.999253272" watchObservedRunningTime="2026-08-05 19:57:02.511107678 +0000 UTC m=+3324.001042752"
Aug 05 19:57:03.234536 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:03.234497    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:57:03.240104 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:03.240075    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:57:03.497629 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:03.497539    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:57:03.498674 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:03.498652    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:57:05.481154 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.481119    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"]
Aug 05 19:57:05.484917 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.484896    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 19:57:05.487292 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.487265    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-a1e3e2-serving-cert\""
Aug 05 19:57:05.496456 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.496429    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"]
Aug 05 19:57:05.596614 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.596567    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4915a18-0792-4aa2-a8d3-102f26415ae9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj\" (UID: \"c4915a18-0792-4aa2-a8d3-102f26415ae9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 19:57:05.596839 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.596623    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tslxd\" (UniqueName: \"kubernetes.io/projected/c4915a18-0792-4aa2-a8d3-102f26415ae9-kube-api-access-tslxd\") pod \"maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj\" (UID: \"c4915a18-0792-4aa2-a8d3-102f26415ae9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 19:57:05.596839 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.596809    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4915a18-0792-4aa2-a8d3-102f26415ae9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj\" (UID: \"c4915a18-0792-4aa2-a8d3-102f26415ae9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 19:57:05.698392 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.698354    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4915a18-0792-4aa2-a8d3-102f26415ae9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj\" (UID: \"c4915a18-0792-4aa2-a8d3-102f26415ae9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 19:57:05.698392 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.698402    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tslxd\" (UniqueName: \"kubernetes.io/projected/c4915a18-0792-4aa2-a8d3-102f26415ae9-kube-api-access-tslxd\") pod \"maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj\" (UID: \"c4915a18-0792-4aa2-a8d3-102f26415ae9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 19:57:05.698628 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.698451    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4915a18-0792-4aa2-a8d3-102f26415ae9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj\" (UID: \"c4915a18-0792-4aa2-a8d3-102f26415ae9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 19:57:05.699153 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.699113    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4915a18-0792-4aa2-a8d3-102f26415ae9-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj\" (UID: \"c4915a18-0792-4aa2-a8d3-102f26415ae9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 19:57:05.700935 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.700914    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4915a18-0792-4aa2-a8d3-102f26415ae9-maas-api-tls\") pod \"maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj\" (UID: \"c4915a18-0792-4aa2-a8d3-102f26415ae9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 19:57:05.708449 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.708420    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tslxd\" (UniqueName: \"kubernetes.io/projected/c4915a18-0792-4aa2-a8d3-102f26415ae9-kube-api-access-tslxd\") pod \"maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj\" (UID: \"c4915a18-0792-4aa2-a8d3-102f26415ae9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 19:57:05.797048 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.796936    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 19:57:05.938905 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:05.938874    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"]
Aug 05 19:57:05.939872 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:57:05.939845    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4915a18_0792_4aa2_a8d3_102f26415ae9.slice/crio-c725cf74d48f7c8dfcf1e5a9afe9c468192c1b3692c35b76dfbb44245c1b4245 WatchSource:0}: Error finding container c725cf74d48f7c8dfcf1e5a9afe9c468192c1b3692c35b76dfbb44245c1b4245: Status 404 returned error can't find the container with id c725cf74d48f7c8dfcf1e5a9afe9c468192c1b3692c35b76dfbb44245c1b4245
Aug 05 19:57:06.519003 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:06.518953    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj" event={"ID":"c4915a18-0792-4aa2-a8d3-102f26415ae9","Type":"ContainerStarted","Data":"6d35d0c5cb1e831da65cb9479a48a9ee7bbc700cc4e2f826e843b692c29362b7"}
Aug 05 19:57:06.519429 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:06.519029    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj" event={"ID":"c4915a18-0792-4aa2-a8d3-102f26415ae9","Type":"ContainerStarted","Data":"c725cf74d48f7c8dfcf1e5a9afe9c468192c1b3692c35b76dfbb44245c1b4245"}
Aug 05 19:57:06.519429 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:06.519109    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 19:57:06.537593 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:06.537537    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj" podStartSLOduration=1.168645902 podStartE2EDuration="1.537520554s" totalImagesPullingTime="368.874652ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:57:06.535877149 +0000 UTC m=+3328.025812267" watchObservedRunningTime="2026-08-05 19:57:06.537520554 +0000 UTC m=+3328.027455656"
Aug 05 19:57:12.533227 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:12.533188    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 19:57:18.499093 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:18.499052    2533 patch_prober.go:28] interesting pod/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Aug 05 19:57:18.499523 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:18.499134    2533 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Aug 05 19:57:18.608056 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:18.607943    2533 generic.go:356] "Generic (PLEG): container finished" podID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerID="112c0e01f245b1a455378e09cc623ce15e71624a1c039ad0abf75edf876f398e" exitCode=0
Aug 05 19:57:18.608056 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:18.608011    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" event={"ID":"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223","Type":"ContainerDied","Data":"112c0e01f245b1a455378e09cc623ce15e71624a1c039ad0abf75edf876f398e"}
Aug 05 19:57:18.608446 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:18.608430    2533 scope.go:117] "RemoveContainer" containerID="112c0e01f245b1a455378e09cc623ce15e71624a1c039ad0abf75edf876f398e"
Aug 05 19:57:18.609530 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:18.609497    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:57:18.609591 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:18.609569    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:57:18.609627 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:18.609602    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:57:19.615536 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:19.615503    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" event={"ID":"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223","Type":"ContainerStarted","Data":"6f66cc77e2746cf4576d2042f719846c84d587a1e28b53b70efaf0623d195018"}
Aug 05 19:57:20.234849 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:20.234813    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:57:20.235093 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:20.235071    2533 patch_prober.go:28] interesting pod/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Aug 05 19:57:20.235154 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:20.235118    2533 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Aug 05 19:57:21.234363 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:21.234322    2533 patch_prober.go:28] interesting pod/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Aug 05 19:57:21.234796 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:21.234375    2533 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Aug 05 19:57:22.234259 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:22.234216    2533 patch_prober.go:28] interesting pod/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Aug 05 19:57:22.234454 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:22.234275    2533 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Aug 05 19:57:23.234870 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:23.234829    2533 patch_prober.go:28] interesting pod/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Aug 05 19:57:23.235333 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:23.234883    2533 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Aug 05 19:57:24.234612 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:24.234572    2533 patch_prober.go:28] interesting pod/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Aug 05 19:57:24.234803 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:24.234651    2533 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Aug 05 19:57:25.238919 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:25.238886    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:57:25.239448 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:25.239333    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:57:25.240036 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:57:25.240013    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 19:58:21.778090 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.778050    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"]
Aug 05 19:58:21.781681 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.781657    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.784489 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.784465    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-75a4be-openshift-default-dockercfg-jsbcq\""
Aug 05 19:58:21.806344 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.806307    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"]
Aug 05 19:58:21.850343 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.850305    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-podinfo\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.850527 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.850379    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-workload-socket\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.850527 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.850397    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-envoy\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.850527 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.850440    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-credential-socket\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.850527 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.850466    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istiod-ca-cert\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.850673 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.850540    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-workload-certs\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.850673 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.850589    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-data\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.850673 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.850616    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7sc9\" (UniqueName: \"kubernetes.io/projected/a654b9f2-6e7c-4c61-8715-9a5064c83b56-kube-api-access-g7sc9\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.850673 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.850660    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-token\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.951943 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.951904    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-credential-socket\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.951943 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.951941    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istiod-ca-cert\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.952200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.951960    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-workload-certs\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.952200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.952011    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-data\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.952200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.952036    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7sc9\" (UniqueName: \"kubernetes.io/projected/a654b9f2-6e7c-4c61-8715-9a5064c83b56-kube-api-access-g7sc9\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.952200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.952074    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-token\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.952200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.952129    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-podinfo\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.952200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.952179    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-workload-socket\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.952200 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.952200    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-envoy\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.952536 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.952461    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-data\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.952536 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.952510    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-workload-certs\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.952699 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.952679    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-credential-socket\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.952768 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.952701    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-workload-socket\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.952932 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.952914    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istiod-ca-cert\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.954463 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.954443    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-envoy\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.954678 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.954658    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-podinfo\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.965298 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.965275    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-token\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:21.968917 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:21.968894    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7sc9\" (UniqueName: \"kubernetes.io/projected/a654b9f2-6e7c-4c61-8715-9a5064c83b56-kube-api-access-g7sc9\") pod \"e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") " pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:22.093053 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:22.092942    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:22.234344 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:22.234318    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"]
Aug 05 19:58:22.235961 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:58:22.235932    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda654b9f2_6e7c_4c61_8715_9a5064c83b56.slice/crio-e53487b536e245c6ecafa583c092d8331245079b06baa990ca422114d6f83cf5 WatchSource:0}: Error finding container e53487b536e245c6ecafa583c092d8331245079b06baa990ca422114d6f83cf5: Status 404 returned error can't find the container with id e53487b536e245c6ecafa583c092d8331245079b06baa990ca422114d6f83cf5
Aug 05 19:58:22.238107 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:22.238074    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:58:22.238201 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:22.238139    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:58:22.238201 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:22.238171    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:58:22.959757 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:22.959711    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" event={"ID":"a654b9f2-6e7c-4c61-8715-9a5064c83b56","Type":"ContainerStarted","Data":"e24d2d80369bec9e0e28eff8dd738f11f5722b7aa059055c7033711e89d44c89"}
Aug 05 19:58:22.960234 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:22.959823    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" event={"ID":"a654b9f2-6e7c-4c61-8715-9a5064c83b56","Type":"ContainerStarted","Data":"e53487b536e245c6ecafa583c092d8331245079b06baa990ca422114d6f83cf5"}
Aug 05 19:58:22.981085 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:22.981033    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" podStartSLOduration=1.9810153480000001 podStartE2EDuration="1.981015348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:58:22.979035654 +0000 UTC m=+3404.468970753" watchObservedRunningTime="2026-08-05 19:58:22.981015348 +0000 UTC m=+3404.470950422"
Aug 05 19:58:23.093801 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:23.093758    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:23.100332 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:23.100297    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:23.966065 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:23.966037    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:23.967117 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:23.967095    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:25.970015 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:25.969954    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"]
Aug 05 19:58:25.975452 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:25.975425    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:25.977879 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:25.977851    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-75a4be-serving-cert\""
Aug 05 19:58:25.985836 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:25.985807    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"]
Aug 05 19:58:26.094599 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.094562    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4cgv\" (UniqueName: \"kubernetes.io/projected/d9dd9cac-02d1-4803-b385-02c74a7f7abc-kube-api-access-f4cgv\") pod \"maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms\" (UID: \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:26.094811 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.094754    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9dd9cac-02d1-4803-b385-02c74a7f7abc-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms\" (UID: \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:26.094811 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.094797    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9dd9cac-02d1-4803-b385-02c74a7f7abc-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms\" (UID: \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:26.195617 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.195584    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4cgv\" (UniqueName: \"kubernetes.io/projected/d9dd9cac-02d1-4803-b385-02c74a7f7abc-kube-api-access-f4cgv\") pod \"maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms\" (UID: \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:26.195808 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.195647    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9dd9cac-02d1-4803-b385-02c74a7f7abc-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms\" (UID: \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:26.195808 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.195675    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9dd9cac-02d1-4803-b385-02c74a7f7abc-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms\" (UID: \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:26.196325 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.196303    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9dd9cac-02d1-4803-b385-02c74a7f7abc-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms\" (UID: \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:26.198182 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.198161    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9dd9cac-02d1-4803-b385-02c74a7f7abc-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms\" (UID: \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:26.203439 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.203409    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4cgv\" (UniqueName: \"kubernetes.io/projected/d9dd9cac-02d1-4803-b385-02c74a7f7abc-kube-api-access-f4cgv\") pod \"maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms\" (UID: \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:26.290281 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.290179    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:26.441650 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.441619    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"]
Aug 05 19:58:26.443607 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:58:26.443583    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9dd9cac_02d1_4803_b385_02c74a7f7abc.slice/crio-32b3c2e8f5d7f7ef50c8ddee877aed10387c87acc00a3376941043daafcda9cc WatchSource:0}: Error finding container 32b3c2e8f5d7f7ef50c8ddee877aed10387c87acc00a3376941043daafcda9cc: Status 404 returned error can't find the container with id 32b3c2e8f5d7f7ef50c8ddee877aed10387c87acc00a3376941043daafcda9cc
Aug 05 19:58:26.986230 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.986190    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms" event={"ID":"d9dd9cac-02d1-4803-b385-02c74a7f7abc","Type":"ContainerStarted","Data":"bfc04c9c55c8076bd0bf73cf33805048c7941e0fda66b138fc4922a50f4c1a98"}
Aug 05 19:58:26.986648 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.986248    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms" event={"ID":"d9dd9cac-02d1-4803-b385-02c74a7f7abc","Type":"ContainerStarted","Data":"32b3c2e8f5d7f7ef50c8ddee877aed10387c87acc00a3376941043daafcda9cc"}
Aug 05 19:58:26.986648 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:26.986392    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:27.006147 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:27.006088    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms" podStartSLOduration=1.675320621 podStartE2EDuration="2.006069842s" totalImagesPullingTime="330.749221ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:58:27.003333588 +0000 UTC m=+3408.493268658" watchObservedRunningTime="2026-08-05 19:58:27.006069842 +0000 UTC m=+3408.496004916"
Aug 05 19:58:32.997814 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:32.997730    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:40.008172 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:40.008130    2533 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 05 19:58:40.008587 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:40.008183    2533 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 05 19:58:41.064687 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:41.064649    2533 generic.go:356] "Generic (PLEG): container finished" podID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerID="e24d2d80369bec9e0e28eff8dd738f11f5722b7aa059055c7033711e89d44c89" exitCode=0
Aug 05 19:58:41.065133 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:41.064722    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" event={"ID":"a654b9f2-6e7c-4c61-8715-9a5064c83b56","Type":"ContainerDied","Data":"e24d2d80369bec9e0e28eff8dd738f11f5722b7aa059055c7033711e89d44c89"}
Aug 05 19:58:41.065199 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:41.065182    2533 scope.go:117] "RemoveContainer" containerID="e24d2d80369bec9e0e28eff8dd738f11f5722b7aa059055c7033711e89d44c89"
Aug 05 19:58:41.066340 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:41.066312    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:58:41.066404 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:41.066378    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:58:41.066441 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:41.066410    2533 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 05 19:58:42.073303 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:42.073259    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" event={"ID":"a654b9f2-6e7c-4c61-8715-9a5064c83b56","Type":"ContainerStarted","Data":"8a8a683fcddb2582e48c8d890a4649e44769b7f5458685f406b717edbae30994"}
Aug 05 19:58:42.093238 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:42.093188    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:42.093525 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:42.093365    2533 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Aug 05 19:58:42.093525 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:42.093421    2533 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Aug 05 19:58:43.093942 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:43.093901    2533 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Aug 05 19:58:43.094407 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:43.093963    2533 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Aug 05 19:58:44.093911 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:44.093873    2533 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Aug 05 19:58:44.094131 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:44.093941    2533 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Aug 05 19:58:45.093752 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:45.093707    2533 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Aug 05 19:58:45.093951 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:45.093772    2533 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Aug 05 19:58:46.093628 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:46.093592    2533 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Aug 05 19:58:46.094090 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:46.093651    2533 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Aug 05 19:58:47.094244 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:47.094207    2533 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Aug 05 19:58:47.094660 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:47.094265    2533 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Aug 05 19:58:48.097738 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:48.097702    2533 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:48.098244 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:48.098026    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:48.098815 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:48.098796    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:58:50.477521 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:50.477480    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r"]
Aug 05 19:58:50.481063 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:50.481044    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r"
Aug 05 19:58:50.483272 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:50.483251    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:58:50.488621 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:50.488591    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r"]
Aug 05 19:58:50.549099 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:50.549052    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fe7400e-4f33-47e8-a51a-a3d60abc62ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r\" (UID: \"5fe7400e-4f33-47e8-a51a-a3d60abc62ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r"
Aug 05 19:58:50.650167 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:50.650132    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fe7400e-4f33-47e8-a51a-a3d60abc62ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r\" (UID: \"5fe7400e-4f33-47e8-a51a-a3d60abc62ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r"
Aug 05 19:58:50.650863 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:50.650841    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fe7400e-4f33-47e8-a51a-a3d60abc62ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r\" (UID: \"5fe7400e-4f33-47e8-a51a-a3d60abc62ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r"
Aug 05 19:58:50.794027 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:50.793921    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r"
Aug 05 19:58:50.944458 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:50.944426    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r"]
Aug 05 19:58:50.946222 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:58:50.946192    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe7400e_4f33_47e8_a51a_a3d60abc62ea.slice/crio-2813a93261bc2433ccedbd1f879d1f69b319fcf68aa118c201dab61412a64af4 WatchSource:0}: Error finding container 2813a93261bc2433ccedbd1f879d1f69b319fcf68aa118c201dab61412a64af4: Status 404 returned error can't find the container with id 2813a93261bc2433ccedbd1f879d1f69b319fcf68aa118c201dab61412a64af4
Aug 05 19:58:51.131589 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:51.131490    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r" event={"ID":"5fe7400e-4f33-47e8-a51a-a3d60abc62ea","Type":"ContainerStarted","Data":"2813a93261bc2433ccedbd1f879d1f69b319fcf68aa118c201dab61412a64af4"}
Aug 05 19:58:52.139110 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:52.139073    2533 generic.go:356] "Generic (PLEG): container finished" podID="5fe7400e-4f33-47e8-a51a-a3d60abc62ea" containerID="a32adfb033d91f2a332cc96a232d61a3569dd0bb6e5e7fe6443432a62a42c6b4" exitCode=0
Aug 05 19:58:52.139564 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:52.139130    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r" event={"ID":"5fe7400e-4f33-47e8-a51a-a3d60abc62ea","Type":"ContainerDied","Data":"a32adfb033d91f2a332cc96a232d61a3569dd0bb6e5e7fe6443432a62a42c6b4"}
Aug 05 19:58:53.277535 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:53.277509    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r"
Aug 05 19:58:53.377331 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:53.377286    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fe7400e-4f33-47e8-a51a-a3d60abc62ea-maas-api-service-ca\") pod \"5fe7400e-4f33-47e8-a51a-a3d60abc62ea\" (UID: \"5fe7400e-4f33-47e8-a51a-a3d60abc62ea\") "
Aug 05 19:58:53.377685 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:53.377658    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fe7400e-4f33-47e8-a51a-a3d60abc62ea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5fe7400e-4f33-47e8-a51a-a3d60abc62ea" (UID: "5fe7400e-4f33-47e8-a51a-a3d60abc62ea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:58:53.478256 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:53.478220    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fe7400e-4f33-47e8-a51a-a3d60abc62ea-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:58:54.150896 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:54.150859    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r" event={"ID":"5fe7400e-4f33-47e8-a51a-a3d60abc62ea","Type":"ContainerDied","Data":"2813a93261bc2433ccedbd1f879d1f69b319fcf68aa118c201dab61412a64af4"}
Aug 05 19:58:54.150896 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:54.150888    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r"
Aug 05 19:58:54.151147 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:54.150913    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2813a93261bc2433ccedbd1f879d1f69b319fcf68aa118c201dab61412a64af4"
Aug 05 19:58:56.597024 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:56.596971    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"]
Aug 05 19:58:56.597531 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:56.597291    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms" podUID="d9dd9cac-02d1-4803-b385-02c74a7f7abc" containerName="maas-api" containerID="cri-o://bfc04c9c55c8076bd0bf73cf33805048c7941e0fda66b138fc4922a50f4c1a98" gracePeriod=30
Aug 05 19:58:56.810413 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:56.810361    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r"]
Aug 05 19:58:56.813129 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:56.813102    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-75a4be-pwm4r"]
Aug 05 19:58:56.867540 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:56.867512    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:56.911890 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:56.911854    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9dd9cac-02d1-4803-b385-02c74a7f7abc-openshift-service-ca\") pod \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\" (UID: \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\") "
Aug 05 19:58:56.912116 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:56.911912    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4cgv\" (UniqueName: \"kubernetes.io/projected/d9dd9cac-02d1-4803-b385-02c74a7f7abc-kube-api-access-f4cgv\") pod \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\" (UID: \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\") "
Aug 05 19:58:56.912116 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:56.911981    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9dd9cac-02d1-4803-b385-02c74a7f7abc-maas-api-tls\") pod \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\" (UID: \"d9dd9cac-02d1-4803-b385-02c74a7f7abc\") "
Aug 05 19:58:56.912332 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:56.912299    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9dd9cac-02d1-4803-b385-02c74a7f7abc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d9dd9cac-02d1-4803-b385-02c74a7f7abc" (UID: "d9dd9cac-02d1-4803-b385-02c74a7f7abc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:58:56.920066 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:56.918634    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9dd9cac-02d1-4803-b385-02c74a7f7abc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d9dd9cac-02d1-4803-b385-02c74a7f7abc" (UID: "d9dd9cac-02d1-4803-b385-02c74a7f7abc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:58:56.921032 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:56.920696    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9dd9cac-02d1-4803-b385-02c74a7f7abc-kube-api-access-f4cgv" (OuterVolumeSpecName: "kube-api-access-f4cgv") pod "d9dd9cac-02d1-4803-b385-02c74a7f7abc" (UID: "d9dd9cac-02d1-4803-b385-02c74a7f7abc"). InnerVolumeSpecName "kube-api-access-f4cgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:58:57.013281 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:57.013247    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9dd9cac-02d1-4803-b385-02c74a7f7abc-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:58:57.013281 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:57.013274    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4cgv\" (UniqueName: \"kubernetes.io/projected/d9dd9cac-02d1-4803-b385-02c74a7f7abc-kube-api-access-f4cgv\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:58:57.013281 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:57.013285    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9dd9cac-02d1-4803-b385-02c74a7f7abc-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:58:57.014798 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:57.014767    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fe7400e-4f33-47e8-a51a-a3d60abc62ea" path="/var/lib/kubelet/pods/5fe7400e-4f33-47e8-a51a-a3d60abc62ea/volumes"
Aug 05 19:58:57.170280 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:57.170191    2533 generic.go:356] "Generic (PLEG): container finished" podID="d9dd9cac-02d1-4803-b385-02c74a7f7abc" containerID="bfc04c9c55c8076bd0bf73cf33805048c7941e0fda66b138fc4922a50f4c1a98" exitCode=0
Aug 05 19:58:57.170280 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:57.170257    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"
Aug 05 19:58:57.170280 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:57.170270    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms" event={"ID":"d9dd9cac-02d1-4803-b385-02c74a7f7abc","Type":"ContainerDied","Data":"bfc04c9c55c8076bd0bf73cf33805048c7941e0fda66b138fc4922a50f4c1a98"}
Aug 05 19:58:57.170508 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:57.170326    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms" event={"ID":"d9dd9cac-02d1-4803-b385-02c74a7f7abc","Type":"ContainerDied","Data":"32b3c2e8f5d7f7ef50c8ddee877aed10387c87acc00a3376941043daafcda9cc"}
Aug 05 19:58:57.170508 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:57.170348    2533 scope.go:117] "RemoveContainer" containerID="bfc04c9c55c8076bd0bf73cf33805048c7941e0fda66b138fc4922a50f4c1a98"
Aug 05 19:58:57.179596 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:57.179577    2533 scope.go:117] "RemoveContainer" containerID="bfc04c9c55c8076bd0bf73cf33805048c7941e0fda66b138fc4922a50f4c1a98"
Aug 05 19:58:57.179898 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:58:57.179875    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfc04c9c55c8076bd0bf73cf33805048c7941e0fda66b138fc4922a50f4c1a98\": container with ID starting with bfc04c9c55c8076bd0bf73cf33805048c7941e0fda66b138fc4922a50f4c1a98 not found: ID does not exist" containerID="bfc04c9c55c8076bd0bf73cf33805048c7941e0fda66b138fc4922a50f4c1a98"
Aug 05 19:58:57.179966 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:57.179910    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfc04c9c55c8076bd0bf73cf33805048c7941e0fda66b138fc4922a50f4c1a98"} err="failed to get container status \"bfc04c9c55c8076bd0bf73cf33805048c7941e0fda66b138fc4922a50f4c1a98\": rpc error: code = NotFound desc = could not find container \"bfc04c9c55c8076bd0bf73cf33805048c7941e0fda66b138fc4922a50f4c1a98\": container with ID starting with bfc04c9c55c8076bd0bf73cf33805048c7941e0fda66b138fc4922a50f4c1a98 not found: ID does not exist"
Aug 05 19:58:57.188951 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:57.188918    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"]
Aug 05 19:58:57.193465 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:57.193435    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-75a4be-56949bdd79-k4gms"]
Aug 05 19:58:59.012436 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:58:59.012400    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9dd9cac-02d1-4803-b385-02c74a7f7abc" path="/var/lib/kubelet/pods/d9dd9cac-02d1-4803-b385-02c74a7f7abc/volumes"
Aug 05 19:59:03.018042 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:03.018007    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"]
Aug 05 19:59:03.018517 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:03.018234    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy" containerID="cri-o://8a8a683fcddb2582e48c8d890a4649e44769b7f5458685f406b717edbae30994" gracePeriod=30
Aug 05 19:59:03.100410 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:03.100367    2533 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 19:59:03.100571 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:03.100441    2533 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 19:59:06.453199 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.453159    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd"]
Aug 05 19:59:06.453682 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.453665    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe7400e-4f33-47e8-a51a-a3d60abc62ea" containerName="revoke-keys"
Aug 05 19:59:06.453682 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.453682    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe7400e-4f33-47e8-a51a-a3d60abc62ea" containerName="revoke-keys"
Aug 05 19:59:06.453807 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.453707    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9dd9cac-02d1-4803-b385-02c74a7f7abc" containerName="maas-api"
Aug 05 19:59:06.453807 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.453713    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9dd9cac-02d1-4803-b385-02c74a7f7abc" containerName="maas-api"
Aug 05 19:59:06.453807 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.453785    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9dd9cac-02d1-4803-b385-02c74a7f7abc" containerName="maas-api"
Aug 05 19:59:06.453807 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.453794    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fe7400e-4f33-47e8-a51a-a3d60abc62ea" containerName="revoke-keys"
Aug 05 19:59:06.458697 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.458673    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd"
Aug 05 19:59:06.461016 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.460971    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 19:59:06.463957 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.463930    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd"]
Aug 05 19:59:06.608922 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.608870    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6eba85d2-6a62-4f5d-87a2-1b8ce5abaada-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd\" (UID: \"6eba85d2-6a62-4f5d-87a2-1b8ce5abaada\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd"
Aug 05 19:59:06.709748 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.709649    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6eba85d2-6a62-4f5d-87a2-1b8ce5abaada-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd\" (UID: \"6eba85d2-6a62-4f5d-87a2-1b8ce5abaada\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd"
Aug 05 19:59:06.710436 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.710409    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6eba85d2-6a62-4f5d-87a2-1b8ce5abaada-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd\" (UID: \"6eba85d2-6a62-4f5d-87a2-1b8ce5abaada\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd"
Aug 05 19:59:06.773405 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.773369    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd"
Aug 05 19:59:06.920060 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:06.920031    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd"]
Aug 05 19:59:06.921630 ip-10-0-143-76 kubenswrapper[2533]: W0805 19:59:06.921604    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eba85d2_6a62_4f5d_87a2_1b8ce5abaada.slice/crio-3a66cca871bf6668cbecd79ecbb10ff452ffcb841b2e4abc32bcb425793608b9 WatchSource:0}: Error finding container 3a66cca871bf6668cbecd79ecbb10ff452ffcb841b2e4abc32bcb425793608b9: Status 404 returned error can't find the container with id 3a66cca871bf6668cbecd79ecbb10ff452ffcb841b2e4abc32bcb425793608b9
Aug 05 19:59:07.227352 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:07.227257    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd" event={"ID":"6eba85d2-6a62-4f5d-87a2-1b8ce5abaada","Type":"ContainerStarted","Data":"3a66cca871bf6668cbecd79ecbb10ff452ffcb841b2e4abc32bcb425793608b9"}
Aug 05 19:59:08.235044 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.235010    2533 generic.go:356] "Generic (PLEG): container finished" podID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerID="8a8a683fcddb2582e48c8d890a4649e44769b7f5458685f406b717edbae30994" exitCode=0
Aug 05 19:59:08.235468 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.235084    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" event={"ID":"a654b9f2-6e7c-4c61-8715-9a5064c83b56","Type":"ContainerDied","Data":"8a8a683fcddb2582e48c8d890a4649e44769b7f5458685f406b717edbae30994"}
Aug 05 19:59:08.235468 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.235168    2533 scope.go:117] "RemoveContainer" containerID="e24d2d80369bec9e0e28eff8dd738f11f5722b7aa059055c7033711e89d44c89"
Aug 05 19:59:08.236956 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.236927    2533 generic.go:356] "Generic (PLEG): container finished" podID="6eba85d2-6a62-4f5d-87a2-1b8ce5abaada" containerID="0f04639839c860487a34042e717cb055849db91eddb1bfe9d18eda8e35782364" exitCode=0
Aug 05 19:59:08.237094 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.237019    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd" event={"ID":"6eba85d2-6a62-4f5d-87a2-1b8ce5abaada","Type":"ContainerDied","Data":"0f04639839c860487a34042e717cb055849db91eddb1bfe9d18eda8e35782364"}
Aug 05 19:59:08.274559 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.274533    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:59:08.428267 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428231    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-token\") pod \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") "
Aug 05 19:59:08.428433 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428306    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-workload-socket\") pod \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") "
Aug 05 19:59:08.428433 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428334    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istiod-ca-cert\") pod \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") "
Aug 05 19:59:08.428433 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428366    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-data\") pod \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") "
Aug 05 19:59:08.428433 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428399    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-credential-socket\") pod \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") "
Aug 05 19:59:08.428433 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428424    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7sc9\" (UniqueName: \"kubernetes.io/projected/a654b9f2-6e7c-4c61-8715-9a5064c83b56-kube-api-access-g7sc9\") pod \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") "
Aug 05 19:59:08.428685 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428492    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-podinfo\") pod \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") "
Aug 05 19:59:08.428685 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428555    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-workload-certs\") pod \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") "
Aug 05 19:59:08.428685 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428603    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-envoy\") pod \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\" (UID: \"a654b9f2-6e7c-4c61-8715-9a5064c83b56\") "
Aug 05 19:59:08.428685 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428666    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a654b9f2-6e7c-4c61-8715-9a5064c83b56" (UID: "a654b9f2-6e7c-4c61-8715-9a5064c83b56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:59:08.428887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428656    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-data" (OuterVolumeSpecName: "istio-data") pod "a654b9f2-6e7c-4c61-8715-9a5064c83b56" (UID: "a654b9f2-6e7c-4c61-8715-9a5064c83b56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:59:08.428887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428729    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a654b9f2-6e7c-4c61-8715-9a5064c83b56" (UID: "a654b9f2-6e7c-4c61-8715-9a5064c83b56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:59:08.428887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428744    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a654b9f2-6e7c-4c61-8715-9a5064c83b56" (UID: "a654b9f2-6e7c-4c61-8715-9a5064c83b56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:59:08.428887 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.428877    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a654b9f2-6e7c-4c61-8715-9a5064c83b56" (UID: "a654b9f2-6e7c-4c61-8715-9a5064c83b56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:59:08.429134 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.429017    2533 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-workload-socket\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:59:08.429134 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.429039    2533 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istiod-ca-cert\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:59:08.429134 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.429052    2533 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-data\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:59:08.429134 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.429068    2533 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-credential-socket\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:59:08.429134 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.429082    2533 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-workload-certs\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:59:08.430696 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.430674    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a654b9f2-6e7c-4c61-8715-9a5064c83b56" (UID: "a654b9f2-6e7c-4c61-8715-9a5064c83b56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 19:59:08.430696 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.430684    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-token" (OuterVolumeSpecName: "istio-token") pod "a654b9f2-6e7c-4c61-8715-9a5064c83b56" (UID: "a654b9f2-6e7c-4c61-8715-9a5064c83b56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:59:08.430839 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.430731    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a654b9f2-6e7c-4c61-8715-9a5064c83b56-kube-api-access-g7sc9" (OuterVolumeSpecName: "kube-api-access-g7sc9") pod "a654b9f2-6e7c-4c61-8715-9a5064c83b56" (UID: "a654b9f2-6e7c-4c61-8715-9a5064c83b56"). InnerVolumeSpecName "kube-api-access-g7sc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:59:08.430916 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.430899    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a654b9f2-6e7c-4c61-8715-9a5064c83b56" (UID: "a654b9f2-6e7c-4c61-8715-9a5064c83b56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 19:59:08.530258 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.530224    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7sc9\" (UniqueName: \"kubernetes.io/projected/a654b9f2-6e7c-4c61-8715-9a5064c83b56-kube-api-access-g7sc9\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:59:08.530258 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.530253    2533 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-podinfo\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:59:08.530258 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.530262    2533 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-envoy\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:59:08.530483 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:08.530271    2533 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a654b9f2-6e7c-4c61-8715-9a5064c83b56-istio-token\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:59:09.249976 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:09.249932    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx" event={"ID":"a654b9f2-6e7c-4c61-8715-9a5064c83b56","Type":"ContainerDied","Data":"e53487b536e245c6ecafa583c092d8331245079b06baa990ca422114d6f83cf5"}
Aug 05 19:59:09.249976 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:09.249965    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"
Aug 05 19:59:09.250495 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:09.250052    2533 scope.go:117] "RemoveContainer" containerID="8a8a683fcddb2582e48c8d890a4649e44769b7f5458685f406b717edbae30994"
Aug 05 19:59:09.269249 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:09.269216    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"]
Aug 05 19:59:09.275688 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:09.275607    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-75a4be-openshift-default-59d49948d8-ppjlx"]
Aug 05 19:59:09.402018 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:09.401970    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd"
Aug 05 19:59:09.539141 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:09.539041    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6eba85d2-6a62-4f5d-87a2-1b8ce5abaada-maas-api-service-ca\") pod \"6eba85d2-6a62-4f5d-87a2-1b8ce5abaada\" (UID: \"6eba85d2-6a62-4f5d-87a2-1b8ce5abaada\") "
Aug 05 19:59:09.539420 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:09.539397    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6eba85d2-6a62-4f5d-87a2-1b8ce5abaada-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6eba85d2-6a62-4f5d-87a2-1b8ce5abaada" (UID: "6eba85d2-6a62-4f5d-87a2-1b8ce5abaada"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:59:09.640029 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:09.639969    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6eba85d2-6a62-4f5d-87a2-1b8ce5abaada-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:59:10.258459 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:10.258426    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd"
Aug 05 19:59:10.258459 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:10.258435    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd" event={"ID":"6eba85d2-6a62-4f5d-87a2-1b8ce5abaada","Type":"ContainerDied","Data":"3a66cca871bf6668cbecd79ecbb10ff452ffcb841b2e4abc32bcb425793608b9"}
Aug 05 19:59:10.259027 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:10.258478    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a66cca871bf6668cbecd79ecbb10ff452ffcb841b2e4abc32bcb425793608b9"
Aug 05 19:59:11.013768 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:11.013734    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" path="/var/lib/kubelet/pods/a654b9f2-6e7c-4c61-8715-9a5064c83b56/volumes"
Aug 05 19:59:21.906037 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:21.906002    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"]
Aug 05 19:59:21.906678 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:21.906235    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx" podUID="9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3" containerName="maas-api" containerID="cri-o://47fb572f03e8e7ea401c8da91113a0241a1dbb6b709d48abae7891b1df32069f" gracePeriod=30
Aug 05 19:59:22.109299 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.109264    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd"]
Aug 05 19:59:22.111980 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.111950    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-c686d7-lf9rd"]
Aug 05 19:59:22.161453 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.161389    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:59:22.258653 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.258603    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-maas-api-tls\") pod \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\" (UID: \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\") "
Aug 05 19:59:22.258861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.258721    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmc6z\" (UniqueName: \"kubernetes.io/projected/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-kube-api-access-wmc6z\") pod \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\" (UID: \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\") "
Aug 05 19:59:22.258861 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.258762    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-openshift-service-ca\") pod \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\" (UID: \"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3\") "
Aug 05 19:59:22.259205 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.259180    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3" (UID: "9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 19:59:22.260907 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.260882    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-kube-api-access-wmc6z" (OuterVolumeSpecName: "kube-api-access-wmc6z") pod "9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3" (UID: "9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3"). InnerVolumeSpecName "kube-api-access-wmc6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 19:59:22.261026 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.260915    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3" (UID: "9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 19:59:22.328895 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.328859    2533 generic.go:356] "Generic (PLEG): container finished" podID="9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3" containerID="47fb572f03e8e7ea401c8da91113a0241a1dbb6b709d48abae7891b1df32069f" exitCode=0
Aug 05 19:59:22.329081 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.328905    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"
Aug 05 19:59:22.329081 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.328947    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx" event={"ID":"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3","Type":"ContainerDied","Data":"47fb572f03e8e7ea401c8da91113a0241a1dbb6b709d48abae7891b1df32069f"}
Aug 05 19:59:22.329081 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.329022    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx" event={"ID":"9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3","Type":"ContainerDied","Data":"0c34c998d704b09307ee3119d1d3338267c2403dbfcded57f3419cdf537e83c4"}
Aug 05 19:59:22.329081 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.329047    2533 scope.go:117] "RemoveContainer" containerID="47fb572f03e8e7ea401c8da91113a0241a1dbb6b709d48abae7891b1df32069f"
Aug 05 19:59:22.338799 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.338780    2533 scope.go:117] "RemoveContainer" containerID="47fb572f03e8e7ea401c8da91113a0241a1dbb6b709d48abae7891b1df32069f"
Aug 05 19:59:22.339086 ip-10-0-143-76 kubenswrapper[2533]: E0805 19:59:22.339068    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47fb572f03e8e7ea401c8da91113a0241a1dbb6b709d48abae7891b1df32069f\": container with ID starting with 47fb572f03e8e7ea401c8da91113a0241a1dbb6b709d48abae7891b1df32069f not found: ID does not exist" containerID="47fb572f03e8e7ea401c8da91113a0241a1dbb6b709d48abae7891b1df32069f"
Aug 05 19:59:22.339174 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.339099    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47fb572f03e8e7ea401c8da91113a0241a1dbb6b709d48abae7891b1df32069f"} err="failed to get container status \"47fb572f03e8e7ea401c8da91113a0241a1dbb6b709d48abae7891b1df32069f\": rpc error: code = NotFound desc = could not find container \"47fb572f03e8e7ea401c8da91113a0241a1dbb6b709d48abae7891b1df32069f\": container with ID starting with 47fb572f03e8e7ea401c8da91113a0241a1dbb6b709d48abae7891b1df32069f not found: ID does not exist"
Aug 05 19:59:22.350546 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.350520    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"]
Aug 05 19:59:22.355364 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.355336    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c686d7-7454c4d46d-qndcx"]
Aug 05 19:59:22.360104 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.360087    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:59:22.360186 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.360106    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:59:22.360186 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:22.360116    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmc6z\" (UniqueName: \"kubernetes.io/projected/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3-kube-api-access-wmc6z\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 19:59:23.012945 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:23.012907    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eba85d2-6a62-4f5d-87a2-1b8ce5abaada" path="/var/lib/kubelet/pods/6eba85d2-6a62-4f5d-87a2-1b8ce5abaada/volumes"
Aug 05 19:59:23.013359 ip-10-0-143-76 kubenswrapper[2533]: I0805 19:59:23.013343    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3" path="/var/lib/kubelet/pods/9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3/volumes"
Aug 05 20:00:00.138321 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.138278    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29766000-5ndjk"]
Aug 05 20:00:00.138888 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.138855    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy"
Aug 05 20:00:00.138888 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.138876    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy"
Aug 05 20:00:00.139045 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.138901    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3" containerName="maas-api"
Aug 05 20:00:00.139045 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.138910    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3" containerName="maas-api"
Aug 05 20:00:00.139045 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.138930    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eba85d2-6a62-4f5d-87a2-1b8ce5abaada" containerName="revoke-keys"
Aug 05 20:00:00.139045 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.138940    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eba85d2-6a62-4f5d-87a2-1b8ce5abaada" containerName="revoke-keys"
Aug 05 20:00:00.139266 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.139054    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy"
Aug 05 20:00:00.139266 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.139068    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d0a66ed-12b2-4bcc-be84-6bc8b8cb2ca3" containerName="maas-api"
Aug 05 20:00:00.139266 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.139079    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eba85d2-6a62-4f5d-87a2-1b8ce5abaada" containerName="revoke-keys"
Aug 05 20:00:00.139266 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.139089    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy"
Aug 05 20:00:00.142198 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.142173    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29766000-5ndjk"
Aug 05 20:00:00.144587 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.144556    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 20:00:00.146877 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.146853    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a1e3e2-29766000-pf5gx"]
Aug 05 20:00:00.147662 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.147638    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy"
Aug 05 20:00:00.147816 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.147803    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="a654b9f2-6e7c-4c61-8715-9a5064c83b56" containerName="istio-proxy"
Aug 05 20:00:00.163431 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.163392    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2d7d-29766000-bp6pf"]
Aug 05 20:00:00.163703 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.163679    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a1e3e2-29766000-pf5gx"
Aug 05 20:00:00.167884 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.167857    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29766000-5ndjk"
Aug 05 20:00:00.169738 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.169699    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1df35a-29766000-4fz28"]
Aug 05 20:00:00.169875 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.169836    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2d7d-29766000-bp6pf"
Aug 05 20:00:00.173520 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.173500    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29766000-5ndjk"]
Aug 05 20:00:00.173632 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.173604    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1df35a-29766000-4fz28"
Aug 05 20:00:00.174441 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.174422    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2d7d-29766000-bp6pf"]
Aug 05 20:00:00.179334 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.179286    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a1e3e2-29766000-pf5gx"]
Aug 05 20:00:00.186269 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.186240    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1df35a-29766000-4fz28"]
Aug 05 20:00:00.205534 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.205487    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a1e3e2-29766000-pf5gx"
Aug 05 20:00:00.214871 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.214844    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2d7d-29766000-bp6pf"
Aug 05 20:00:00.260583 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.260552    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1df35a-29766000-4fz28"
Aug 05 20:00:00.346909 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.346765    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29766000-5ndjk"]
Aug 05 20:00:00.351033 ip-10-0-143-76 kubenswrapper[2533]: W0805 20:00:00.350945    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b0b67e5_3cd5_47bc_ab88_f499249a2da7.slice/crio-f0ec27d95669096f46c7372c452a3e8b724c3913328401065c9cdeb2b41e511f WatchSource:0}: Error finding container f0ec27d95669096f46c7372c452a3e8b724c3913328401065c9cdeb2b41e511f: Status 404 returned error can't find the container with id f0ec27d95669096f46c7372c452a3e8b724c3913328401065c9cdeb2b41e511f
Aug 05 20:00:00.400196 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.400166    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a1e3e2-29766000-pf5gx"]
Aug 05 20:00:00.400968 ip-10-0-143-76 kubenswrapper[2533]: W0805 20:00:00.400934    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3d7c6d_2296_4568_94cd_67933c8c1ef3.slice/crio-80450af8fb8d52605c0c54d4d81f8802643328ac14386cc9d3531279056546f6 WatchSource:0}: Error finding container 80450af8fb8d52605c0c54d4d81f8802643328ac14386cc9d3531279056546f6: Status 404 returned error can't find the container with id 80450af8fb8d52605c0c54d4d81f8802643328ac14386cc9d3531279056546f6
Aug 05 20:00:00.430310 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.430269    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2d7d-29766000-bp6pf"]
Aug 05 20:00:00.433382 ip-10-0-143-76 kubenswrapper[2533]: W0805 20:00:00.433358    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8b8ab9_9c55_4892_8815_57eb07daecfe.slice/crio-217d9ddafe8b37f2ac68601ac9834356e451d3eb18d88c35bc7967dfa7784eba WatchSource:0}: Error finding container 217d9ddafe8b37f2ac68601ac9834356e451d3eb18d88c35bc7967dfa7784eba: Status 404 returned error can't find the container with id 217d9ddafe8b37f2ac68601ac9834356e451d3eb18d88c35bc7967dfa7784eba
Aug 05 20:00:00.458861 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.458838    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1df35a-29766000-4fz28"]
Aug 05 20:00:00.471219 ip-10-0-143-76 kubenswrapper[2533]: W0805 20:00:00.471190    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1edc27f2_4c05_4376_bf5b_76cbdc3a6eb4.slice/crio-16db9810a4514e4565a22c36234eb89b111ca7e8ed64f2733872d8e45ee4a287 WatchSource:0}: Error finding container 16db9810a4514e4565a22c36234eb89b111ca7e8ed64f2733872d8e45ee4a287: Status 404 returned error can't find the container with id 16db9810a4514e4565a22c36234eb89b111ca7e8ed64f2733872d8e45ee4a287
Aug 05 20:00:00.545244 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.545212    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29766000-5ndjk" event={"ID":"9b0b67e5-3cd5-47bc-ab88-f499249a2da7","Type":"ContainerStarted","Data":"f0ec27d95669096f46c7372c452a3e8b724c3913328401065c9cdeb2b41e511f"}
Aug 05 20:00:00.546578 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.546537    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1df35a-29766000-4fz28" event={"ID":"1edc27f2-4c05-4376-bf5b-76cbdc3a6eb4","Type":"ContainerStarted","Data":"16db9810a4514e4565a22c36234eb89b111ca7e8ed64f2733872d8e45ee4a287"}
Aug 05 20:00:00.547806 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.547779    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2d7d-29766000-bp6pf" event={"ID":"7c8b8ab9-9c55-4892-8815-57eb07daecfe","Type":"ContainerStarted","Data":"217d9ddafe8b37f2ac68601ac9834356e451d3eb18d88c35bc7967dfa7784eba"}
Aug 05 20:00:00.548868 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:00.548847    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a1e3e2-29766000-pf5gx" event={"ID":"2b3d7c6d-2296-4568-94cd-67933c8c1ef3","Type":"ContainerStarted","Data":"80450af8fb8d52605c0c54d4d81f8802643328ac14386cc9d3531279056546f6"}
Aug 05 20:00:01.558671 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:01.558533    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2d7d-29766000-bp6pf" event={"ID":"7c8b8ab9-9c55-4892-8815-57eb07daecfe","Type":"ContainerStarted","Data":"28c8543ef64f4820b4820332c57c9a072f43f584e7bab45e2a217e6c94f284cd"}
Aug 05 20:00:01.560418 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:01.560389    2533 generic.go:356] "Generic (PLEG): container finished" podID="2b3d7c6d-2296-4568-94cd-67933c8c1ef3" containerID="d6ee170c7a0add33066fed776b1cd7331e41565c813c1473c5c06e9866090943" exitCode=0
Aug 05 20:00:01.560721 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:01.560433    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a1e3e2-29766000-pf5gx" event={"ID":"2b3d7c6d-2296-4568-94cd-67933c8c1ef3","Type":"ContainerDied","Data":"d6ee170c7a0add33066fed776b1cd7331e41565c813c1473c5c06e9866090943"}
Aug 05 20:00:01.562252 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:01.562228    2533 generic.go:356] "Generic (PLEG): container finished" podID="9b0b67e5-3cd5-47bc-ab88-f499249a2da7" containerID="1e049bb3a68bd96f389e874f4fa0ffe4aea98b37c07ca6c98303dcbd54b84274" exitCode=0
Aug 05 20:00:01.562371 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:01.562299    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29766000-5ndjk" event={"ID":"9b0b67e5-3cd5-47bc-ab88-f499249a2da7","Type":"ContainerDied","Data":"1e049bb3a68bd96f389e874f4fa0ffe4aea98b37c07ca6c98303dcbd54b84274"}
Aug 05 20:00:01.563782 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:01.563762    2533 generic.go:356] "Generic (PLEG): container finished" podID="1edc27f2-4c05-4376-bf5b-76cbdc3a6eb4" containerID="30d3121a95e4d10e88327751aca7eab44d968e69f174e7e2c808e0391abcaf3c" exitCode=0
Aug 05 20:00:01.563873 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:01.563821    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1df35a-29766000-4fz28" event={"ID":"1edc27f2-4c05-4376-bf5b-76cbdc3a6eb4","Type":"ContainerDied","Data":"30d3121a95e4d10e88327751aca7eab44d968e69f174e7e2c808e0391abcaf3c"}
Aug 05 20:00:02.571668 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:02.571632    2533 generic.go:356] "Generic (PLEG): container finished" podID="7c8b8ab9-9c55-4892-8815-57eb07daecfe" containerID="28c8543ef64f4820b4820332c57c9a072f43f584e7bab45e2a217e6c94f284cd" exitCode=0
Aug 05 20:00:02.572165 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:02.571724    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2d7d-29766000-bp6pf" event={"ID":"7c8b8ab9-9c55-4892-8815-57eb07daecfe","Type":"ContainerDied","Data":"28c8543ef64f4820b4820332c57c9a072f43f584e7bab45e2a217e6c94f284cd"}
Aug 05 20:00:02.756716 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:02.756679    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1df35a-29766000-4fz28"
Aug 05 20:00:02.768948 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:02.768911    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2d7d-29766000-bp6pf"
Aug 05 20:00:02.781312 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:02.781265    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a1e3e2-29766000-pf5gx"
Aug 05 20:00:02.788048 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:02.788021    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29766000-5ndjk"
Aug 05 20:00:03.578670 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.578639    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2d7d-29766000-bp6pf"
Aug 05 20:00:03.578670 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.578663    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2d7d-29766000-bp6pf" event={"ID":"7c8b8ab9-9c55-4892-8815-57eb07daecfe","Type":"ContainerDied","Data":"217d9ddafe8b37f2ac68601ac9834356e451d3eb18d88c35bc7967dfa7784eba"}
Aug 05 20:00:03.579184 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.578753    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="217d9ddafe8b37f2ac68601ac9834356e451d3eb18d88c35bc7967dfa7784eba"
Aug 05 20:00:03.580151 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.580133    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a1e3e2-29766000-pf5gx"
Aug 05 20:00:03.580261 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.580178    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a1e3e2-29766000-pf5gx" event={"ID":"2b3d7c6d-2296-4568-94cd-67933c8c1ef3","Type":"ContainerDied","Data":"80450af8fb8d52605c0c54d4d81f8802643328ac14386cc9d3531279056546f6"}
Aug 05 20:00:03.580261 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.580217    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80450af8fb8d52605c0c54d4d81f8802643328ac14386cc9d3531279056546f6"
Aug 05 20:00:03.581638 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.581620    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29766000-5ndjk"
Aug 05 20:00:03.581740 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.581642    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29766000-5ndjk" event={"ID":"9b0b67e5-3cd5-47bc-ab88-f499249a2da7","Type":"ContainerDied","Data":"f0ec27d95669096f46c7372c452a3e8b724c3913328401065c9cdeb2b41e511f"}
Aug 05 20:00:03.581740 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.581683    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0ec27d95669096f46c7372c452a3e8b724c3913328401065c9cdeb2b41e511f"
Aug 05 20:00:03.583130 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.583101    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1df35a-29766000-4fz28" event={"ID":"1edc27f2-4c05-4376-bf5b-76cbdc3a6eb4","Type":"ContainerDied","Data":"16db9810a4514e4565a22c36234eb89b111ca7e8ed64f2733872d8e45ee4a287"}
Aug 05 20:00:03.583210 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.583135    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1df35a-29766000-4fz28"
Aug 05 20:00:03.583267 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.583142    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16db9810a4514e4565a22c36234eb89b111ca7e8ed64f2733872d8e45ee4a287"
Aug 05 20:00:03.875270 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.875179    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765955-4pq8h"]
Aug 05 20:00:03.877648 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:03.877624    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765955-4pq8h"]
Aug 05 20:00:05.013758 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:05.013718    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65382b78-3f75-4105-8084-1b93fe60b9a9" path="/var/lib/kubelet/pods/65382b78-3f75-4105-8084-1b93fe60b9a9/volumes"
Aug 05 20:00:25.502866 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.502821    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z"]
Aug 05 20:00:25.503436 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.503416    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1edc27f2-4c05-4376-bf5b-76cbdc3a6eb4" containerName="cleanup"
Aug 05 20:00:25.503510 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.503437    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="1edc27f2-4c05-4376-bf5b-76cbdc3a6eb4" containerName="cleanup"
Aug 05 20:00:25.503510 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.503474    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c8b8ab9-9c55-4892-8815-57eb07daecfe" containerName="cleanup"
Aug 05 20:00:25.503510 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.503484    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c8b8ab9-9c55-4892-8815-57eb07daecfe" containerName="cleanup"
Aug 05 20:00:25.503510 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.503502    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3d7c6d-2296-4568-94cd-67933c8c1ef3" containerName="cleanup"
Aug 05 20:00:25.503510 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.503510    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3d7c6d-2296-4568-94cd-67933c8c1ef3" containerName="cleanup"
Aug 05 20:00:25.503760 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.503527    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b0b67e5-3cd5-47bc-ab88-f499249a2da7" containerName="cleanup"
Aug 05 20:00:25.503760 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.503536    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b0b67e5-3cd5-47bc-ab88-f499249a2da7" containerName="cleanup"
Aug 05 20:00:25.503760 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.503623    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b0b67e5-3cd5-47bc-ab88-f499249a2da7" containerName="cleanup"
Aug 05 20:00:25.503760 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.503636    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3d7c6d-2296-4568-94cd-67933c8c1ef3" containerName="cleanup"
Aug 05 20:00:25.503760 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.503650    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="1edc27f2-4c05-4376-bf5b-76cbdc3a6eb4" containerName="cleanup"
Aug 05 20:00:25.503760 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.503659    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c8b8ab9-9c55-4892-8815-57eb07daecfe" containerName="cleanup"
Aug 05 20:00:25.506836 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.506815    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z"
Aug 05 20:00:25.509245 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.509223    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 20:00:25.513538 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.513512    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z"]
Aug 05 20:00:25.671102 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.671057    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f9b3d19-9c9e-455e-9040-1ce943910f6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z\" (UID: \"6f9b3d19-9c9e-455e-9040-1ce943910f6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z"
Aug 05 20:00:25.772626 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.772535    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f9b3d19-9c9e-455e-9040-1ce943910f6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z\" (UID: \"6f9b3d19-9c9e-455e-9040-1ce943910f6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z"
Aug 05 20:00:25.773223 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.773201    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f9b3d19-9c9e-455e-9040-1ce943910f6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z\" (UID: \"6f9b3d19-9c9e-455e-9040-1ce943910f6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z"
Aug 05 20:00:25.819803 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.819767    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z"
Aug 05 20:00:25.961135 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:25.961100    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z"]
Aug 05 20:00:25.963164 ip-10-0-143-76 kubenswrapper[2533]: W0805 20:00:25.963136    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9b3d19_9c9e_455e_9040_1ce943910f6d.slice/crio-c793c88f34aa86f13b22cedaa9af0d6d0567c4ebe821d6fe24a89f8853eca6a6 WatchSource:0}: Error finding container c793c88f34aa86f13b22cedaa9af0d6d0567c4ebe821d6fe24a89f8853eca6a6: Status 404 returned error can't find the container with id c793c88f34aa86f13b22cedaa9af0d6d0567c4ebe821d6fe24a89f8853eca6a6
Aug 05 20:00:26.717119 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:26.717080    2533 generic.go:356] "Generic (PLEG): container finished" podID="6f9b3d19-9c9e-455e-9040-1ce943910f6d" containerID="1ef7d0b3b40f4c7c3d9e66ff397365ddfb1b002bcf69462187dcd8889983eb25" exitCode=0
Aug 05 20:00:26.717516 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:26.717116    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z" event={"ID":"6f9b3d19-9c9e-455e-9040-1ce943910f6d","Type":"ContainerDied","Data":"1ef7d0b3b40f4c7c3d9e66ff397365ddfb1b002bcf69462187dcd8889983eb25"}
Aug 05 20:00:26.717516 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:26.717176    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z" event={"ID":"6f9b3d19-9c9e-455e-9040-1ce943910f6d","Type":"ContainerStarted","Data":"c793c88f34aa86f13b22cedaa9af0d6d0567c4ebe821d6fe24a89f8853eca6a6"}
Aug 05 20:00:27.858182 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:27.858150    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z"
Aug 05 20:00:27.997571 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:27.997479    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f9b3d19-9c9e-455e-9040-1ce943910f6d-maas-api-service-ca\") pod \"6f9b3d19-9c9e-455e-9040-1ce943910f6d\" (UID: \"6f9b3d19-9c9e-455e-9040-1ce943910f6d\") "
Aug 05 20:00:27.997840 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:27.997815    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f9b3d19-9c9e-455e-9040-1ce943910f6d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6f9b3d19-9c9e-455e-9040-1ce943910f6d" (UID: "6f9b3d19-9c9e-455e-9040-1ce943910f6d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 20:00:28.098830 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:28.098791    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f9b3d19-9c9e-455e-9040-1ce943910f6d-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:28.730481 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:28.730445    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z"
Aug 05 20:00:28.730673 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:28.730489    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z" event={"ID":"6f9b3d19-9c9e-455e-9040-1ce943910f6d","Type":"ContainerDied","Data":"c793c88f34aa86f13b22cedaa9af0d6d0567c4ebe821d6fe24a89f8853eca6a6"}
Aug 05 20:00:28.730673 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:28.730548    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c793c88f34aa86f13b22cedaa9af0d6d0567c4ebe821d6fe24a89f8853eca6a6"
Aug 05 20:00:36.040882 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.040844    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"]
Aug 05 20:00:36.041432 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.041243    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj" podUID="c4915a18-0792-4aa2-a8d3-102f26415ae9" containerName="maas-api" containerID="cri-o://6d35d0c5cb1e831da65cb9479a48a9ee7bbc700cc4e2f826e843b692c29362b7" gracePeriod=30
Aug 05 20:00:36.073154 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.073122    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a1e3e2-29766000-pf5gx"]
Aug 05 20:00:36.077914 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.077882    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a1e3e2-29766000-pf5gx"]
Aug 05 20:00:36.260596 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.260564    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z"]
Aug 05 20:00:36.264661 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.264628    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a1e3e2-2789z"]
Aug 05 20:00:36.307120 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.307033    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 20:00:36.375583 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.375538    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tslxd\" (UniqueName: \"kubernetes.io/projected/c4915a18-0792-4aa2-a8d3-102f26415ae9-kube-api-access-tslxd\") pod \"c4915a18-0792-4aa2-a8d3-102f26415ae9\" (UID: \"c4915a18-0792-4aa2-a8d3-102f26415ae9\") "
Aug 05 20:00:36.375805 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.375620    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4915a18-0792-4aa2-a8d3-102f26415ae9-maas-api-tls\") pod \"c4915a18-0792-4aa2-a8d3-102f26415ae9\" (UID: \"c4915a18-0792-4aa2-a8d3-102f26415ae9\") "
Aug 05 20:00:36.375805 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.375681    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4915a18-0792-4aa2-a8d3-102f26415ae9-openshift-service-ca\") pod \"c4915a18-0792-4aa2-a8d3-102f26415ae9\" (UID: \"c4915a18-0792-4aa2-a8d3-102f26415ae9\") "
Aug 05 20:00:36.376031 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.376000    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4915a18-0792-4aa2-a8d3-102f26415ae9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4915a18-0792-4aa2-a8d3-102f26415ae9" (UID: "c4915a18-0792-4aa2-a8d3-102f26415ae9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 20:00:36.377847 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.377813    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4915a18-0792-4aa2-a8d3-102f26415ae9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4915a18-0792-4aa2-a8d3-102f26415ae9" (UID: "c4915a18-0792-4aa2-a8d3-102f26415ae9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 20:00:36.377847 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.377835    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4915a18-0792-4aa2-a8d3-102f26415ae9-kube-api-access-tslxd" (OuterVolumeSpecName: "kube-api-access-tslxd") pod "c4915a18-0792-4aa2-a8d3-102f26415ae9" (UID: "c4915a18-0792-4aa2-a8d3-102f26415ae9"). InnerVolumeSpecName "kube-api-access-tslxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 20:00:36.476303 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.476261    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4915a18-0792-4aa2-a8d3-102f26415ae9-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:36.476303 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.476297    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tslxd\" (UniqueName: \"kubernetes.io/projected/c4915a18-0792-4aa2-a8d3-102f26415ae9-kube-api-access-tslxd\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:36.476303 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.476308    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4915a18-0792-4aa2-a8d3-102f26415ae9-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:36.783128 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.783086    2533 generic.go:356] "Generic (PLEG): container finished" podID="c4915a18-0792-4aa2-a8d3-102f26415ae9" containerID="6d35d0c5cb1e831da65cb9479a48a9ee7bbc700cc4e2f826e843b692c29362b7" exitCode=0
Aug 05 20:00:36.783319 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.783140    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"
Aug 05 20:00:36.783319 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.783171    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj" event={"ID":"c4915a18-0792-4aa2-a8d3-102f26415ae9","Type":"ContainerDied","Data":"6d35d0c5cb1e831da65cb9479a48a9ee7bbc700cc4e2f826e843b692c29362b7"}
Aug 05 20:00:36.783319 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.783219    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj" event={"ID":"c4915a18-0792-4aa2-a8d3-102f26415ae9","Type":"ContainerDied","Data":"c725cf74d48f7c8dfcf1e5a9afe9c468192c1b3692c35b76dfbb44245c1b4245"}
Aug 05 20:00:36.783319 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.783241    2533 scope.go:117] "RemoveContainer" containerID="6d35d0c5cb1e831da65cb9479a48a9ee7bbc700cc4e2f826e843b692c29362b7"
Aug 05 20:00:36.793854 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.793836    2533 scope.go:117] "RemoveContainer" containerID="6d35d0c5cb1e831da65cb9479a48a9ee7bbc700cc4e2f826e843b692c29362b7"
Aug 05 20:00:36.794154 ip-10-0-143-76 kubenswrapper[2533]: E0805 20:00:36.794131    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d35d0c5cb1e831da65cb9479a48a9ee7bbc700cc4e2f826e843b692c29362b7\": container with ID starting with 6d35d0c5cb1e831da65cb9479a48a9ee7bbc700cc4e2f826e843b692c29362b7 not found: ID does not exist" containerID="6d35d0c5cb1e831da65cb9479a48a9ee7bbc700cc4e2f826e843b692c29362b7"
Aug 05 20:00:36.794235 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.794168    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d35d0c5cb1e831da65cb9479a48a9ee7bbc700cc4e2f826e843b692c29362b7"} err="failed to get container status \"6d35d0c5cb1e831da65cb9479a48a9ee7bbc700cc4e2f826e843b692c29362b7\": rpc error: code = NotFound desc = could not find container \"6d35d0c5cb1e831da65cb9479a48a9ee7bbc700cc4e2f826e843b692c29362b7\": container with ID starting with 6d35d0c5cb1e831da65cb9479a48a9ee7bbc700cc4e2f826e843b692c29362b7 not found: ID does not exist"
Aug 05 20:00:36.805954 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.805925    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"]
Aug 05 20:00:36.809945 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:36.809918    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a1e3e2-5f48d9f764-2khtj"]
Aug 05 20:00:37.013231 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:37.013198    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b3d7c6d-2296-4568-94cd-67933c8c1ef3" path="/var/lib/kubelet/pods/2b3d7c6d-2296-4568-94cd-67933c8c1ef3/volumes"
Aug 05 20:00:37.013516 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:37.013502    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f9b3d19-9c9e-455e-9040-1ce943910f6d" path="/var/lib/kubelet/pods/6f9b3d19-9c9e-455e-9040-1ce943910f6d/volumes"
Aug 05 20:00:37.013849 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:37.013837    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4915a18-0792-4aa2-a8d3-102f26415ae9" path="/var/lib/kubelet/pods/c4915a18-0792-4aa2-a8d3-102f26415ae9/volumes"
Aug 05 20:00:39.585624 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:39.585591    2533 scope.go:117] "RemoveContainer" containerID="42a629baf555a30a792a050d41a65cc9d3d9dc05a631d660367b3d134ef36552"
Aug 05 20:00:42.562266 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:42.562235    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"]
Aug 05 20:00:42.562647 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:42.562451    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerName="istio-proxy" containerID="cri-o://6f66cc77e2746cf4576d2042f719846c84d587a1e28b53b70efaf0623d195018" gracePeriod=30
Aug 05 20:00:42.922673 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:42.922647    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89"]
Aug 05 20:00:42.923052 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:42.923039    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4915a18-0792-4aa2-a8d3-102f26415ae9" containerName="maas-api"
Aug 05 20:00:42.923105 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:42.923054    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4915a18-0792-4aa2-a8d3-102f26415ae9" containerName="maas-api"
Aug 05 20:00:42.923105 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:42.923068    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9b3d19-9c9e-455e-9040-1ce943910f6d" containerName="revoke-keys"
Aug 05 20:00:42.923105 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:42.923075    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9b3d19-9c9e-455e-9040-1ce943910f6d" containerName="revoke-keys"
Aug 05 20:00:42.923214 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:42.923147    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9b3d19-9c9e-455e-9040-1ce943910f6d" containerName="revoke-keys"
Aug 05 20:00:42.923214 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:42.923155    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4915a18-0792-4aa2-a8d3-102f26415ae9" containerName="maas-api"
Aug 05 20:00:42.932615 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:42.932581    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89"
Aug 05 20:00:42.934800 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:42.934770    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 20:00:42.936354 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:42.936317    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89"]
Aug 05 20:00:43.035899 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:43.035859    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e72e12-db2a-4c79-8a34-9279dfacbaa6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89\" (UID: \"21e72e12-db2a-4c79-8a34-9279dfacbaa6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89"
Aug 05 20:00:43.136622 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:43.136562    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e72e12-db2a-4c79-8a34-9279dfacbaa6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89\" (UID: \"21e72e12-db2a-4c79-8a34-9279dfacbaa6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89"
Aug 05 20:00:43.137245 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:43.137207    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e72e12-db2a-4c79-8a34-9279dfacbaa6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89\" (UID: \"21e72e12-db2a-4c79-8a34-9279dfacbaa6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89"
Aug 05 20:00:43.245793 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:43.245697    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89"
Aug 05 20:00:43.386787 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:43.386761    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89"]
Aug 05 20:00:43.388810 ip-10-0-143-76 kubenswrapper[2533]: W0805 20:00:43.388776    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e72e12_db2a_4c79_8a34_9279dfacbaa6.slice/crio-590f157c6d07993aeb4bc53f9df624b716bff0b787efcbad72a042107977bb61 WatchSource:0}: Error finding container 590f157c6d07993aeb4bc53f9df624b716bff0b787efcbad72a042107977bb61: Status 404 returned error can't find the container with id 590f157c6d07993aeb4bc53f9df624b716bff0b787efcbad72a042107977bb61
Aug 05 20:00:43.829395 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:43.829293    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89" event={"ID":"21e72e12-db2a-4c79-8a34-9279dfacbaa6","Type":"ContainerStarted","Data":"e83d5bbc90db22b99e7438f53ae3c86a668567f53caf040d8a9e3098a94fb359"}
Aug 05 20:00:43.829395 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:43.829355    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89" event={"ID":"21e72e12-db2a-4c79-8a34-9279dfacbaa6","Type":"ContainerStarted","Data":"590f157c6d07993aeb4bc53f9df624b716bff0b787efcbad72a042107977bb61"}
Aug 05 20:00:43.846669 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:43.846613    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89" podStartSLOduration=1.846595605 podStartE2EDuration="1.846595605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 20:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 20:00:43.844767771 +0000 UTC m=+3545.334702863" watchObservedRunningTime="2026-08-05 20:00:43.846595605 +0000 UTC m=+3545.336530678"
Aug 05 20:00:44.837088 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:44.837049    2533 generic.go:356] "Generic (PLEG): container finished" podID="21e72e12-db2a-4c79-8a34-9279dfacbaa6" containerID="e83d5bbc90db22b99e7438f53ae3c86a668567f53caf040d8a9e3098a94fb359" exitCode=0
Aug 05 20:00:44.837511 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:44.837126    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89" event={"ID":"21e72e12-db2a-4c79-8a34-9279dfacbaa6","Type":"ContainerDied","Data":"e83d5bbc90db22b99e7438f53ae3c86a668567f53caf040d8a9e3098a94fb359"}
Aug 05 20:00:45.975300 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:45.975273    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89"
Aug 05 20:00:46.064301 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:46.064263    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e72e12-db2a-4c79-8a34-9279dfacbaa6-maas-api-service-ca\") pod \"21e72e12-db2a-4c79-8a34-9279dfacbaa6\" (UID: \"21e72e12-db2a-4c79-8a34-9279dfacbaa6\") "
Aug 05 20:00:46.064718 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:46.064694    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21e72e12-db2a-4c79-8a34-9279dfacbaa6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "21e72e12-db2a-4c79-8a34-9279dfacbaa6" (UID: "21e72e12-db2a-4c79-8a34-9279dfacbaa6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 20:00:46.166180 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:46.166094    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e72e12-db2a-4c79-8a34-9279dfacbaa6-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:46.850466 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:46.850434    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89"
Aug 05 20:00:46.850466 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:46.850451    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89" event={"ID":"21e72e12-db2a-4c79-8a34-9279dfacbaa6","Type":"ContainerDied","Data":"590f157c6d07993aeb4bc53f9df624b716bff0b787efcbad72a042107977bb61"}
Aug 05 20:00:46.850734 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:46.850496    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="590f157c6d07993aeb4bc53f9df624b716bff0b787efcbad72a042107977bb61"
Aug 05 20:00:47.813761 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.813735    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 20:00:47.859443 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.859341    2533 generic.go:356] "Generic (PLEG): container finished" podID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerID="6f66cc77e2746cf4576d2042f719846c84d587a1e28b53b70efaf0623d195018" exitCode=0
Aug 05 20:00:47.859443 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.859382    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"
Aug 05 20:00:47.859443 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.859414    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" event={"ID":"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223","Type":"ContainerDied","Data":"6f66cc77e2746cf4576d2042f719846c84d587a1e28b53b70efaf0623d195018"}
Aug 05 20:00:47.859690 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.859471    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522" event={"ID":"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223","Type":"ContainerDied","Data":"96d187653eb1c48a7da417c035d22bb736527d77bfb2c6f97e9f31633c59f427"}
Aug 05 20:00:47.859690 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.859505    2533 scope.go:117] "RemoveContainer" containerID="6f66cc77e2746cf4576d2042f719846c84d587a1e28b53b70efaf0623d195018"
Aug 05 20:00:47.868755 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.868734    2533 scope.go:117] "RemoveContainer" containerID="112c0e01f245b1a455378e09cc623ce15e71624a1c039ad0abf75edf876f398e"
Aug 05 20:00:47.877490 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.877468    2533 scope.go:117] "RemoveContainer" containerID="6f66cc77e2746cf4576d2042f719846c84d587a1e28b53b70efaf0623d195018"
Aug 05 20:00:47.877811 ip-10-0-143-76 kubenswrapper[2533]: E0805 20:00:47.877788    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f66cc77e2746cf4576d2042f719846c84d587a1e28b53b70efaf0623d195018\": container with ID starting with 6f66cc77e2746cf4576d2042f719846c84d587a1e28b53b70efaf0623d195018 not found: ID does not exist" containerID="6f66cc77e2746cf4576d2042f719846c84d587a1e28b53b70efaf0623d195018"
Aug 05 20:00:47.877876 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.877822    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f66cc77e2746cf4576d2042f719846c84d587a1e28b53b70efaf0623d195018"} err="failed to get container status \"6f66cc77e2746cf4576d2042f719846c84d587a1e28b53b70efaf0623d195018\": rpc error: code = NotFound desc = could not find container \"6f66cc77e2746cf4576d2042f719846c84d587a1e28b53b70efaf0623d195018\": container with ID starting with 6f66cc77e2746cf4576d2042f719846c84d587a1e28b53b70efaf0623d195018 not found: ID does not exist"
Aug 05 20:00:47.877876 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.877841    2533 scope.go:117] "RemoveContainer" containerID="112c0e01f245b1a455378e09cc623ce15e71624a1c039ad0abf75edf876f398e"
Aug 05 20:00:47.878105 ip-10-0-143-76 kubenswrapper[2533]: E0805 20:00:47.878086    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"112c0e01f245b1a455378e09cc623ce15e71624a1c039ad0abf75edf876f398e\": container with ID starting with 112c0e01f245b1a455378e09cc623ce15e71624a1c039ad0abf75edf876f398e not found: ID does not exist" containerID="112c0e01f245b1a455378e09cc623ce15e71624a1c039ad0abf75edf876f398e"
Aug 05 20:00:47.878155 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.878112    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112c0e01f245b1a455378e09cc623ce15e71624a1c039ad0abf75edf876f398e"} err="failed to get container status \"112c0e01f245b1a455378e09cc623ce15e71624a1c039ad0abf75edf876f398e\": rpc error: code = NotFound desc = could not find container \"112c0e01f245b1a455378e09cc623ce15e71624a1c039ad0abf75edf876f398e\": container with ID starting with 112c0e01f245b1a455378e09cc623ce15e71624a1c039ad0abf75edf876f398e not found: ID does not exist"
Aug 05 20:00:47.882376 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.882360    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-token\") pod \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") "
Aug 05 20:00:47.882436 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.882417    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istiod-ca-cert\") pod \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") "
Aug 05 20:00:47.882475 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.882441    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-workload-socket\") pod \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") "
Aug 05 20:00:47.882540 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.882520    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-envoy\") pod \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") "
Aug 05 20:00:47.882618 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.882606    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-podinfo\") pod \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") "
Aug 05 20:00:47.882674 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.882645    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcpj9\" (UniqueName: \"kubernetes.io/projected/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-kube-api-access-pcpj9\") pod \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") "
Aug 05 20:00:47.882732 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.882688    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-data\") pod \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") "
Aug 05 20:00:47.882732 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.882707    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" (UID: "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 20:00:47.882843 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.882764    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-credential-socket\") pod \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") "
Aug 05 20:00:47.882843 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.882787    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" (UID: "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 20:00:47.882843 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.882802    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-workload-certs\") pod \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\" (UID: \"9fc6f3e4-ce97-4b16-bb0a-cebb399ed223\") "
Aug 05 20:00:47.883011 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.882942    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-data" (OuterVolumeSpecName: "istio-data") pod "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" (UID: "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 20:00:47.883070 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.883045    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" (UID: "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 20:00:47.883192 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.883174    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" (UID: "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 20:00:47.883256 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.883231    2533 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-data\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:47.883256 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.883250    2533 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-credential-socket\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:47.883337 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.883264    2533 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istiod-ca-cert\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:47.883337 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.883278    2533 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-workload-socket\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:47.885083 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.885048    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" (UID: "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 20:00:47.885203 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.885132    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-token" (OuterVolumeSpecName: "istio-token") pod "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" (UID: "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 20:00:47.885203 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.885170    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-kube-api-access-pcpj9" (OuterVolumeSpecName: "kube-api-access-pcpj9") pod "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" (UID: "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223"). InnerVolumeSpecName "kube-api-access-pcpj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 20:00:47.885316 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.885205    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" (UID: "9fc6f3e4-ce97-4b16-bb0a-cebb399ed223"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 20:00:47.984694 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.984652    2533 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-envoy\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:47.984694 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.984686    2533 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-podinfo\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:47.984911 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.984720    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcpj9\" (UniqueName: \"kubernetes.io/projected/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-kube-api-access-pcpj9\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:47.984911 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.984731    2533 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-workload-certs\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:47.984911 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:47.984740    2533 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223-istio-token\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:48.183574 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:48.183539    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"]
Aug 05 20:00:48.185920 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:48.185896    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-a1e3e2-openshift-default-6dd979cf74-5r522"]
Aug 05 20:00:49.013172 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:49.013135    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" path="/var/lib/kubelet/pods/9fc6f3e4-ce97-4b16-bb0a-cebb399ed223/volumes"
Aug 05 20:00:53.399442 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.399406    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"]
Aug 05 20:00:53.400064 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.399690    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw" podUID="82b25882-a39e-4a75-9b0b-0e08fe96966a" containerName="maas-api" containerID="cri-o://e1e32dae30db252a6352d213848b57a164bec38d934423245c5dde59e42f00bc" gracePeriod=30
Aug 05 20:00:53.426898 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.426866    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2d7d-29766000-bp6pf"]
Aug 05 20:00:53.430361 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.430331    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-6a2d7d-29766000-bp6pf"]
Aug 05 20:00:53.618275 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.618235    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89"]
Aug 05 20:00:53.621636 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.621610    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-6a2d7d-gxq89"]
Aug 05 20:00:53.656275 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.656203    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 20:00:53.736486 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.736453    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82b25882-a39e-4a75-9b0b-0e08fe96966a-maas-api-tls\") pod \"82b25882-a39e-4a75-9b0b-0e08fe96966a\" (UID: \"82b25882-a39e-4a75-9b0b-0e08fe96966a\") "
Aug 05 20:00:53.736637 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.736498    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2g7nm\" (UniqueName: \"kubernetes.io/projected/82b25882-a39e-4a75-9b0b-0e08fe96966a-kube-api-access-2g7nm\") pod \"82b25882-a39e-4a75-9b0b-0e08fe96966a\" (UID: \"82b25882-a39e-4a75-9b0b-0e08fe96966a\") "
Aug 05 20:00:53.736637 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.736568    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b25882-a39e-4a75-9b0b-0e08fe96966a-openshift-service-ca\") pod \"82b25882-a39e-4a75-9b0b-0e08fe96966a\" (UID: \"82b25882-a39e-4a75-9b0b-0e08fe96966a\") "
Aug 05 20:00:53.737021 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.736968    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b25882-a39e-4a75-9b0b-0e08fe96966a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "82b25882-a39e-4a75-9b0b-0e08fe96966a" (UID: "82b25882-a39e-4a75-9b0b-0e08fe96966a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 20:00:53.738630 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.738597    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82b25882-a39e-4a75-9b0b-0e08fe96966a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "82b25882-a39e-4a75-9b0b-0e08fe96966a" (UID: "82b25882-a39e-4a75-9b0b-0e08fe96966a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 20:00:53.738630 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.738622    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b25882-a39e-4a75-9b0b-0e08fe96966a-kube-api-access-2g7nm" (OuterVolumeSpecName: "kube-api-access-2g7nm") pod "82b25882-a39e-4a75-9b0b-0e08fe96966a" (UID: "82b25882-a39e-4a75-9b0b-0e08fe96966a"). InnerVolumeSpecName "kube-api-access-2g7nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 20:00:53.837334 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.837276    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82b25882-a39e-4a75-9b0b-0e08fe96966a-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:53.837334 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.837325    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82b25882-a39e-4a75-9b0b-0e08fe96966a-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:53.837334 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.837340    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2g7nm\" (UniqueName: \"kubernetes.io/projected/82b25882-a39e-4a75-9b0b-0e08fe96966a-kube-api-access-2g7nm\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:00:53.901127 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.901086    2533 generic.go:356] "Generic (PLEG): container finished" podID="82b25882-a39e-4a75-9b0b-0e08fe96966a" containerID="e1e32dae30db252a6352d213848b57a164bec38d934423245c5dde59e42f00bc" exitCode=0
Aug 05 20:00:53.901313 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.901135    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"
Aug 05 20:00:53.901313 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.901172    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw" event={"ID":"82b25882-a39e-4a75-9b0b-0e08fe96966a","Type":"ContainerDied","Data":"e1e32dae30db252a6352d213848b57a164bec38d934423245c5dde59e42f00bc"}
Aug 05 20:00:53.901313 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.901229    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw" event={"ID":"82b25882-a39e-4a75-9b0b-0e08fe96966a","Type":"ContainerDied","Data":"0b980a7cec03230778d0149cb61e510e5f2a4614058c9fbb1254482d5a281044"}
Aug 05 20:00:53.901313 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.901253    2533 scope.go:117] "RemoveContainer" containerID="e1e32dae30db252a6352d213848b57a164bec38d934423245c5dde59e42f00bc"
Aug 05 20:00:53.910716 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.910698    2533 scope.go:117] "RemoveContainer" containerID="e1e32dae30db252a6352d213848b57a164bec38d934423245c5dde59e42f00bc"
Aug 05 20:00:53.911027 ip-10-0-143-76 kubenswrapper[2533]: E0805 20:00:53.911003    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1e32dae30db252a6352d213848b57a164bec38d934423245c5dde59e42f00bc\": container with ID starting with e1e32dae30db252a6352d213848b57a164bec38d934423245c5dde59e42f00bc not found: ID does not exist" containerID="e1e32dae30db252a6352d213848b57a164bec38d934423245c5dde59e42f00bc"
Aug 05 20:00:53.911084 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.911037    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1e32dae30db252a6352d213848b57a164bec38d934423245c5dde59e42f00bc"} err="failed to get container status \"e1e32dae30db252a6352d213848b57a164bec38d934423245c5dde59e42f00bc\": rpc error: code = NotFound desc = could not find container \"e1e32dae30db252a6352d213848b57a164bec38d934423245c5dde59e42f00bc\": container with ID starting with e1e32dae30db252a6352d213848b57a164bec38d934423245c5dde59e42f00bc not found: ID does not exist"
Aug 05 20:00:53.924221 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.924191    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"]
Aug 05 20:00:53.928802 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:53.928766    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2d7d-8f69c6c7b-b8jjw"]
Aug 05 20:00:55.013266 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:55.013232    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21e72e12-db2a-4c79-8a34-9279dfacbaa6" path="/var/lib/kubelet/pods/21e72e12-db2a-4c79-8a34-9279dfacbaa6/volumes"
Aug 05 20:00:55.013653 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:55.013521    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c8b8ab9-9c55-4892-8815-57eb07daecfe" path="/var/lib/kubelet/pods/7c8b8ab9-9c55-4892-8815-57eb07daecfe/volumes"
Aug 05 20:00:55.013822 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:00:55.013809    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82b25882-a39e-4a75-9b0b-0e08fe96966a" path="/var/lib/kubelet/pods/82b25882-a39e-4a75-9b0b-0e08fe96966a/volumes"
Aug 05 20:01:00.432149 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.432108    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s"]
Aug 05 20:01:00.432542 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.432494    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerName="istio-proxy"
Aug 05 20:01:00.432542 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.432506    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerName="istio-proxy"
Aug 05 20:01:00.432542 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.432519    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e72e12-db2a-4c79-8a34-9279dfacbaa6" containerName="revoke-keys"
Aug 05 20:01:00.432542 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.432525    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e72e12-db2a-4c79-8a34-9279dfacbaa6" containerName="revoke-keys"
Aug 05 20:01:00.432542 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.432543    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82b25882-a39e-4a75-9b0b-0e08fe96966a" containerName="maas-api"
Aug 05 20:01:00.432715 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.432555    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="82b25882-a39e-4a75-9b0b-0e08fe96966a" containerName="maas-api"
Aug 05 20:01:00.432715 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.432619    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerName="istio-proxy"
Aug 05 20:01:00.432715 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.432628    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="21e72e12-db2a-4c79-8a34-9279dfacbaa6" containerName="revoke-keys"
Aug 05 20:01:00.432715 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.432636    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="82b25882-a39e-4a75-9b0b-0e08fe96966a" containerName="maas-api"
Aug 05 20:01:00.437072 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.437050    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s"
Aug 05 20:01:00.439957 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.439932    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bs9md\""
Aug 05 20:01:00.445470 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.445442    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s"]
Aug 05 20:01:00.494207 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.494173    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be639ca3-f226-483c-8fc1-d0d28529215d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s\" (UID: \"be639ca3-f226-483c-8fc1-d0d28529215d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s"
Aug 05 20:01:00.595069 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.595022    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be639ca3-f226-483c-8fc1-d0d28529215d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s\" (UID: \"be639ca3-f226-483c-8fc1-d0d28529215d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s"
Aug 05 20:01:00.595659 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.595640    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be639ca3-f226-483c-8fc1-d0d28529215d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s\" (UID: \"be639ca3-f226-483c-8fc1-d0d28529215d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s"
Aug 05 20:01:00.749931 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.749834    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s"
Aug 05 20:01:00.886700 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.886674    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s"]
Aug 05 20:01:00.888404 ip-10-0-143-76 kubenswrapper[2533]: W0805 20:01:00.888372    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe639ca3_f226_483c_8fc1_d0d28529215d.slice/crio-ad3c2c8da6fd82afd2463f9eff7a71889334e08f2c0537f8e81837f79adb7529 WatchSource:0}: Error finding container ad3c2c8da6fd82afd2463f9eff7a71889334e08f2c0537f8e81837f79adb7529: Status 404 returned error can't find the container with id ad3c2c8da6fd82afd2463f9eff7a71889334e08f2c0537f8e81837f79adb7529
Aug 05 20:01:00.943619 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:00.943584    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s" event={"ID":"be639ca3-f226-483c-8fc1-d0d28529215d","Type":"ContainerStarted","Data":"ad3c2c8da6fd82afd2463f9eff7a71889334e08f2c0537f8e81837f79adb7529"}
Aug 05 20:01:01.950624 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:01.950584    2533 generic.go:356] "Generic (PLEG): container finished" podID="be639ca3-f226-483c-8fc1-d0d28529215d" containerID="8ad68ea05a7513855e4c407220c47befe002706f7e12e14ceedcbee07925dc42" exitCode=0
Aug 05 20:01:01.951040 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:01.950668    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s" event={"ID":"be639ca3-f226-483c-8fc1-d0d28529215d","Type":"ContainerDied","Data":"8ad68ea05a7513855e4c407220c47befe002706f7e12e14ceedcbee07925dc42"}
Aug 05 20:01:03.095079 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:03.095049    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s"
Aug 05 20:01:03.218704 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:03.218600    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be639ca3-f226-483c-8fc1-d0d28529215d-maas-api-service-ca\") pod \"be639ca3-f226-483c-8fc1-d0d28529215d\" (UID: \"be639ca3-f226-483c-8fc1-d0d28529215d\") "
Aug 05 20:01:03.219037 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:03.218981    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be639ca3-f226-483c-8fc1-d0d28529215d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "be639ca3-f226-483c-8fc1-d0d28529215d" (UID: "be639ca3-f226-483c-8fc1-d0d28529215d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 20:01:03.319734 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:03.319685    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be639ca3-f226-483c-8fc1-d0d28529215d-maas-api-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:01:03.965049 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:03.965022    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s"
Aug 05 20:01:03.965234 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:03.965014    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s" event={"ID":"be639ca3-f226-483c-8fc1-d0d28529215d","Type":"ContainerDied","Data":"ad3c2c8da6fd82afd2463f9eff7a71889334e08f2c0537f8e81837f79adb7529"}
Aug 05 20:01:03.965234 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:03.965156    2533 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad3c2c8da6fd82afd2463f9eff7a71889334e08f2c0537f8e81837f79adb7529"
Aug 05 20:01:11.295408 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.295369    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"]
Aug 05 20:01:11.295948 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.295626    2533 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv" podUID="1fadcc7c-427d-4c91-ad39-959b2f8a2e8f" containerName="maas-api" containerID="cri-o://80dd2a3284624a4a7e0d34a0d37d383b4d28273b6f83185d987e74cfcad1449b" gracePeriod=30
Aug 05 20:01:11.330000 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.329947    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1df35a-29766000-4fz28"]
Aug 05 20:01:11.333442 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.333414    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1df35a-29766000-4fz28"]
Aug 05 20:01:11.554135 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.554036    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s"]
Aug 05 20:01:11.557266 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.557229    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1df35a-d5b5s"]
Aug 05 20:01:11.564393 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.564362    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 20:01:11.709208 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.709171    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-maas-api-tls\") pod \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\" (UID: \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\") "
Aug 05 20:01:11.709395 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.709244    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57mwl\" (UniqueName: \"kubernetes.io/projected/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-kube-api-access-57mwl\") pod \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\" (UID: \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\") "
Aug 05 20:01:11.709395 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.709338    2533 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-openshift-service-ca\") pod \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\" (UID: \"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f\") "
Aug 05 20:01:11.709688 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.709664    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1fadcc7c-427d-4c91-ad39-959b2f8a2e8f" (UID: "1fadcc7c-427d-4c91-ad39-959b2f8a2e8f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 20:01:11.711326 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.711305    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1fadcc7c-427d-4c91-ad39-959b2f8a2e8f" (UID: "1fadcc7c-427d-4c91-ad39-959b2f8a2e8f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 20:01:11.711384 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.711308    2533 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-kube-api-access-57mwl" (OuterVolumeSpecName: "kube-api-access-57mwl") pod "1fadcc7c-427d-4c91-ad39-959b2f8a2e8f" (UID: "1fadcc7c-427d-4c91-ad39-959b2f8a2e8f"). InnerVolumeSpecName "kube-api-access-57mwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 20:01:11.810601 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.810500    2533 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-maas-api-tls\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:01:11.810601 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.810537    2533 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57mwl\" (UniqueName: \"kubernetes.io/projected/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-kube-api-access-57mwl\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:01:11.810601 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:11.810548    2533 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f-openshift-service-ca\") on node \"ip-10-0-143-76.ec2.internal\" DevicePath \"\""
Aug 05 20:01:12.013660 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:12.013621    2533 generic.go:356] "Generic (PLEG): container finished" podID="1fadcc7c-427d-4c91-ad39-959b2f8a2e8f" containerID="80dd2a3284624a4a7e0d34a0d37d383b4d28273b6f83185d987e74cfcad1449b" exitCode=0
Aug 05 20:01:12.013834 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:12.013674    2533 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"
Aug 05 20:01:12.013834 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:12.013701    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv" event={"ID":"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f","Type":"ContainerDied","Data":"80dd2a3284624a4a7e0d34a0d37d383b4d28273b6f83185d987e74cfcad1449b"}
Aug 05 20:01:12.013834 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:12.013753    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv" event={"ID":"1fadcc7c-427d-4c91-ad39-959b2f8a2e8f","Type":"ContainerDied","Data":"28ead955d0d9d474b003134c014652316642db52d7e547c0f77e91d5fb7b362b"}
Aug 05 20:01:12.013834 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:12.013775    2533 scope.go:117] "RemoveContainer" containerID="80dd2a3284624a4a7e0d34a0d37d383b4d28273b6f83185d987e74cfcad1449b"
Aug 05 20:01:12.023995 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:12.023954    2533 scope.go:117] "RemoveContainer" containerID="80dd2a3284624a4a7e0d34a0d37d383b4d28273b6f83185d987e74cfcad1449b"
Aug 05 20:01:12.024311 ip-10-0-143-76 kubenswrapper[2533]: E0805 20:01:12.024289    2533 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80dd2a3284624a4a7e0d34a0d37d383b4d28273b6f83185d987e74cfcad1449b\": container with ID starting with 80dd2a3284624a4a7e0d34a0d37d383b4d28273b6f83185d987e74cfcad1449b not found: ID does not exist" containerID="80dd2a3284624a4a7e0d34a0d37d383b4d28273b6f83185d987e74cfcad1449b"
Aug 05 20:01:12.024376 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:12.024325    2533 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80dd2a3284624a4a7e0d34a0d37d383b4d28273b6f83185d987e74cfcad1449b"} err="failed to get container status \"80dd2a3284624a4a7e0d34a0d37d383b4d28273b6f83185d987e74cfcad1449b\": rpc error: code = NotFound desc = could not find container \"80dd2a3284624a4a7e0d34a0d37d383b4d28273b6f83185d987e74cfcad1449b\": container with ID starting with 80dd2a3284624a4a7e0d34a0d37d383b4d28273b6f83185d987e74cfcad1449b not found: ID does not exist"
Aug 05 20:01:12.035599 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:12.035559    2533 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"]
Aug 05 20:01:12.041876 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:12.041843    2533 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1df35a-59cd74767f-7pctv"]
Aug 05 20:01:13.013143 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:13.013109    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1edc27f2-4c05-4376-bf5b-76cbdc3a6eb4" path="/var/lib/kubelet/pods/1edc27f2-4c05-4376-bf5b-76cbdc3a6eb4/volumes"
Aug 05 20:01:13.013538 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:13.013483    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fadcc7c-427d-4c91-ad39-959b2f8a2e8f" path="/var/lib/kubelet/pods/1fadcc7c-427d-4c91-ad39-959b2f8a2e8f/volumes"
Aug 05 20:01:13.013784 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:13.013770    2533 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be639ca3-f226-483c-8fc1-d0d28529215d" path="/var/lib/kubelet/pods/be639ca3-f226-483c-8fc1-d0d28529215d/volumes"
Aug 05 20:01:24.173669 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:24.173632    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c8dd8c4bc-5qqrr_3b14284c-b56f-4056-85fc-77857d32ed24/manager/0.log"
Aug 05 20:01:24.619123 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:24.619042    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74df9bd579-926tr_61e6786c-fff5-44c2-a9c0-b38ce08f5670/copy-manifests/0.log"
Aug 05 20:01:24.626253 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:24.626221    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74df9bd579-926tr_61e6786c-fff5-44c2-a9c0-b38ce08f5670/manager/0.log"
Aug 05 20:01:25.069500 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:25.069467    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5888db464-bcgqr_3d88be28-03c5-460e-9940-be5f3dd8ab3b/maas-api/0.log"
Aug 05 20:01:25.174771 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:25.174742    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29765970-rcmhf_fd5dfd14-7fef-4297-a5fd-1ee959692c5e/cleanup/0.log"
Aug 05 20:01:25.281167 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:25.281130    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29765985-2tpg2_ebea0f90-d1d4-4556-8248-0ff1daca8644/cleanup/0.log"
Aug 05 20:01:25.390296 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:25.390212    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29766000-5ndjk_9b0b67e5-3cd5-47bc-ab88-f499249a2da7/cleanup/0.log"
Aug 05 20:01:25.490424 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:25.490391    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-4pz8t_1da80c10-acb1-4666-aa32-09325ea78062/postgres/0.log"
Aug 05 20:01:27.319911 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:27.319883    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8pcdv_b9af40b4-2069-4de0-988d-f040cd08782e/discovery/0.log"
Aug 05 20:01:28.295868 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:28.295838    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gq8m8_b9ef82da-f037-4a35-98fa-4ea8ff07d2c1/main/0.log"
Aug 05 20:01:28.506950 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:28.506920    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-464ld_841efe15-2b0a-4e29-a995-bb51c996f276/main/0.log"
Aug 05 20:01:28.610161 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:28.610085    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc78cl_bc8b2281-22b6-48d6-a6af-15b8799ce351/main/0.log"
Aug 05 20:01:36.914539 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:36.914461    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v8kzz_08234163-7160-44d4-a86f-6af179f3a5bc/global-pull-secret-syncer/0.log"
Aug 05 20:01:37.036823 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:37.036791    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sgtkr_57786922-3d3a-4eeb-abb5-b881fdfaef95/konnectivity-agent/0.log"
Aug 05 20:01:37.109815 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:37.109779    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-76.ec2.internal_0e17d0a2e08bf110a6a814f4cf093cda/haproxy/0.log"
Aug 05 20:01:44.212669 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:44.212636    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c05055a7-33c6-4e79-a2e6-c82ca2807e26/alertmanager/0.log"
Aug 05 20:01:44.236197 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:44.236163    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c05055a7-33c6-4e79-a2e6-c82ca2807e26/config-reloader/0.log"
Aug 05 20:01:44.264579 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:44.264553    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c05055a7-33c6-4e79-a2e6-c82ca2807e26/kube-rbac-proxy-web/0.log"
Aug 05 20:01:44.293290 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:44.293264    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c05055a7-33c6-4e79-a2e6-c82ca2807e26/kube-rbac-proxy/0.log"
Aug 05 20:01:44.330685 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:44.330660    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c05055a7-33c6-4e79-a2e6-c82ca2807e26/kube-rbac-proxy-metric/0.log"
Aug 05 20:01:44.353848 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:44.353707    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c05055a7-33c6-4e79-a2e6-c82ca2807e26/prom-label-proxy/0.log"
Aug 05 20:01:44.380966 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:44.380932    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c05055a7-33c6-4e79-a2e6-c82ca2807e26/init-config-reloader/0.log"
Aug 05 20:01:44.574860 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:44.574782    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-77c8865575-g2tf2_4ee769fd-8df1-481f-a1ee-3ad260167f81/metrics-server/0.log"
Aug 05 20:01:44.603192 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:44.603161    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-8sm6t_c60d3387-71ac-49f8-a8a0-1cba2b327338/monitoring-plugin/0.log"
Aug 05 20:01:44.642183 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:44.642153    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l757c_d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf/node-exporter/0.log"
Aug 05 20:01:44.662254 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:44.662223    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l757c_d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf/kube-rbac-proxy/0.log"
Aug 05 20:01:44.682419 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:44.682392    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l757c_d92ef6f4-8ad4-40b7-8157-fe5ee6525bbf/init-textfile/0.log"
Aug 05 20:01:45.262096 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:45.262069    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79c7486775-c8zcn_5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153/telemeter-client/0.log"
Aug 05 20:01:45.282974 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:45.282947    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79c7486775-c8zcn_5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153/reload/0.log"
Aug 05 20:01:45.307507 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:45.307475    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79c7486775-c8zcn_5b1050b2-aeae-4b2c-ac0e-8b8e9e7d3153/kube-rbac-proxy/0.log"
Aug 05 20:01:45.338685 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:45.338653    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5798d99c8d-gvznv_f60d1f65-ddfa-4810-9215-843e6602a683/thanos-query/0.log"
Aug 05 20:01:45.361093 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:45.361067    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5798d99c8d-gvznv_f60d1f65-ddfa-4810-9215-843e6602a683/kube-rbac-proxy-web/0.log"
Aug 05 20:01:45.381430 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:45.381406    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5798d99c8d-gvznv_f60d1f65-ddfa-4810-9215-843e6602a683/kube-rbac-proxy/0.log"
Aug 05 20:01:45.401029 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:45.400970    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5798d99c8d-gvznv_f60d1f65-ddfa-4810-9215-843e6602a683/prom-label-proxy/0.log"
Aug 05 20:01:45.424112 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:45.424083    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5798d99c8d-gvznv_f60d1f65-ddfa-4810-9215-843e6602a683/kube-rbac-proxy-rules/0.log"
Aug 05 20:01:45.444335 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:45.444299    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5798d99c8d-gvznv_f60d1f65-ddfa-4810-9215-843e6602a683/kube-rbac-proxy-metrics/0.log"
Aug 05 20:01:47.113655 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.113572    2533 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"]
Aug 05 20:01:47.114053 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.113922    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerName="istio-proxy"
Aug 05 20:01:47.114053 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.113933    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerName="istio-proxy"
Aug 05 20:01:47.114053 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.113946    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fadcc7c-427d-4c91-ad39-959b2f8a2e8f" containerName="maas-api"
Aug 05 20:01:47.114053 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.113953    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fadcc7c-427d-4c91-ad39-959b2f8a2e8f" containerName="maas-api"
Aug 05 20:01:47.114053 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.113961    2533 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be639ca3-f226-483c-8fc1-d0d28529215d" containerName="revoke-keys"
Aug 05 20:01:47.114053 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.113966    2533 state_mem.go:107] "Deleted CPUSet assignment" podUID="be639ca3-f226-483c-8fc1-d0d28529215d" containerName="revoke-keys"
Aug 05 20:01:47.114053 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.114034    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="be639ca3-f226-483c-8fc1-d0d28529215d" containerName="revoke-keys"
Aug 05 20:01:47.114053 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.114043    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fc6f3e4-ce97-4b16-bb0a-cebb399ed223" containerName="istio-proxy"
Aug 05 20:01:47.114053 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.114052    2533 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fadcc7c-427d-4c91-ad39-959b2f8a2e8f" containerName="maas-api"
Aug 05 20:01:47.118462 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.118438    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.120866 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.120845    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6vfb\"/\"kube-root-ca.crt\""
Aug 05 20:01:47.121559 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.121543    2533 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w6vfb\"/\"default-dockercfg-zvhjt\""
Aug 05 20:01:47.121690 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.121545    2533 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6vfb\"/\"openshift-service-ca.crt\""
Aug 05 20:01:47.131006 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.127607    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"]
Aug 05 20:01:47.238236 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.238204    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-lib-modules\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.238418 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.238245    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-proc\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.238418 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.238265    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dhfb\" (UniqueName: \"kubernetes.io/projected/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-kube-api-access-4dhfb\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.238418 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.238338    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-sys\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.238529 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.238448    2533 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-podres\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.339586 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.339548    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-proc\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.339586 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.339588    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dhfb\" (UniqueName: \"kubernetes.io/projected/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-kube-api-access-4dhfb\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.339814 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.339612    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-sys\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.339814 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.339682    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-proc\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.339814 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.339691    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-podres\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.339814 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.339763    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-sys\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.339814 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.339778    2533 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-lib-modules\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.339814 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.339811    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-podres\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.340085 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.339896    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-lib-modules\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.354229 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.354201    2533 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dhfb\" (UniqueName: \"kubernetes.io/projected/84cc8b34-08e2-4c77-94bc-2d9fdf0e7962-kube-api-access-4dhfb\") pod \"perf-node-gather-daemonset-lwvbx\" (UID: \"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.438102 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.438060    2533 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:47.577064 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:47.577036    2533 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"]
Aug 05 20:01:47.579266 ip-10-0-143-76 kubenswrapper[2533]: W0805 20:01:47.579239    2533 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod84cc8b34_08e2_4c77_94bc_2d9fdf0e7962.slice/crio-60c694a5d28cdfc62b9f32778175f4caf1cc955cd19483d898e3fc3e30d783e9 WatchSource:0}: Error finding container 60c694a5d28cdfc62b9f32778175f4caf1cc955cd19483d898e3fc3e30d783e9: Status 404 returned error can't find the container with id 60c694a5d28cdfc62b9f32778175f4caf1cc955cd19483d898e3fc3e30d783e9
Aug 05 20:01:48.220062 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:48.220021    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx" event={"ID":"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962","Type":"ContainerStarted","Data":"71ec372447972e3133029123f760c2c4ace88f7bd0d1c12fda05f1356ed6a84d"}
Aug 05 20:01:48.220514 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:48.220073    2533 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx" event={"ID":"84cc8b34-08e2-4c77-94bc-2d9fdf0e7962","Type":"ContainerStarted","Data":"60c694a5d28cdfc62b9f32778175f4caf1cc955cd19483d898e3fc3e30d783e9"}
Aug 05 20:01:48.220514 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:48.220182    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:48.234935 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:48.234876    2533 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx" podStartSLOduration=1.234855575 podStartE2EDuration="1.234855575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 20:01:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 20:01:48.234550776 +0000 UTC m=+3609.724485901" watchObservedRunningTime="2026-08-05 20:01:48.234855575 +0000 UTC m=+3609.724790649"
Aug 05 20:01:49.727509 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:49.727477    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-njvk4_f21c40a0-143e-40b7-b52d-e9ddbc050f7b/dns/0.log"
Aug 05 20:01:49.750697 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:49.750675    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-njvk4_f21c40a0-143e-40b7-b52d-e9ddbc050f7b/kube-rbac-proxy/0.log"
Aug 05 20:01:49.819729 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:49.819699    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c4tcz_18fb966a-8487-474e-93c3-9834adaeaf49/dns-node-resolver/0.log"
Aug 05 20:01:50.401712 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:50.401679    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7558ddcfb6-v5r4d_0a1b21ef-4184-458c-96a8-b6ae51c4aabf/registry/0.log"
Aug 05 20:01:50.475983 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:50.475927    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v4hx2_7937abcf-c98b-4662-9da4-8e84d7dc8b94/node-ca/0.log"
Aug 05 20:01:51.550220 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:51.550186    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8pcdv_b9af40b4-2069-4de0-988d-f040cd08782e/discovery/0.log"
Aug 05 20:01:52.562666 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:52.562635    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l8x57_f35de057-ffe9-4ebc-a73a-a31142eb1084/serve-healthcheck-canary/0.log"
Aug 05 20:01:53.055100 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:53.055066    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5vj47_aee2bbb0-35b0-42e9-9848-e04c19ca2529/kube-rbac-proxy/0.log"
Aug 05 20:01:53.075961 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:53.075931    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5vj47_aee2bbb0-35b0-42e9-9848-e04c19ca2529/exporter/0.log"
Aug 05 20:01:53.097599 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:53.097572    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5vj47_aee2bbb0-35b0-42e9-9848-e04c19ca2529/extractor/0.log"
Aug 05 20:01:54.235838 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:54.235812    2533 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-lwvbx"
Aug 05 20:01:55.700609 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:55.700572    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c8dd8c4bc-5qqrr_3b14284c-b56f-4056-85fc-77857d32ed24/manager/0.log"
Aug 05 20:01:55.880629 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:55.880598    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74df9bd579-926tr_61e6786c-fff5-44c2-a9c0-b38ce08f5670/manager/0.log"
Aug 05 20:01:55.903244 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:55.903214    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74df9bd579-926tr_61e6786c-fff5-44c2-a9c0-b38ce08f5670/copy-manifests/0.log"
Aug 05 20:01:57.438325 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:57.438295    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5bf99ddcb-pwwkp_75876958-8bc3-4a56-9483-1d058a7271a5/manager/0.log"
Aug 05 20:01:57.911021 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:57.910972    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8pcdv_b9af40b4-2069-4de0-988d-f040cd08782e/discovery/0.log"
Aug 05 20:01:59.590837 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:01:59.590800    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8pcdv_b9af40b4-2069-4de0-988d-f040cd08782e/discovery/0.log"
Aug 05 20:02:03.815367 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:02:03.815336    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvkrx_fa9c3e9b-a23e-4e44-b821-be5a1c36fda5/kube-multus-additional-cni-plugins/0.log"
Aug 05 20:02:03.834712 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:02:03.834681    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvkrx_fa9c3e9b-a23e-4e44-b821-be5a1c36fda5/egress-router-binary-copy/0.log"
Aug 05 20:02:03.856931 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:02:03.856897    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvkrx_fa9c3e9b-a23e-4e44-b821-be5a1c36fda5/cni-plugins/0.log"
Aug 05 20:02:03.876848 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:02:03.876821    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvkrx_fa9c3e9b-a23e-4e44-b821-be5a1c36fda5/bond-cni-plugin/0.log"
Aug 05 20:02:03.895652 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:02:03.895626    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvkrx_fa9c3e9b-a23e-4e44-b821-be5a1c36fda5/routeoverride-cni/0.log"
Aug 05 20:02:03.914159 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:02:03.914131    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvkrx_fa9c3e9b-a23e-4e44-b821-be5a1c36fda5/whereabouts-cni-bincopy/0.log"
Aug 05 20:02:03.932832 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:02:03.932810    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvkrx_fa9c3e9b-a23e-4e44-b821-be5a1c36fda5/whereabouts-cni/0.log"
Aug 05 20:02:04.295322 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:02:04.295293    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sjmnf_b9ce70d1-ff19-419b-b790-31ac421f34b4/kube-multus/0.log"
Aug 05 20:02:04.320290 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:02:04.320258    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8cs9j_10538719-040a-4cf2-b3df-26bf6b4c077e/network-metrics-daemon/0.log"
Aug 05 20:02:04.336940 ip-10-0-143-76 kubenswrapper[2533]: I0805 20:02:04.336910    2533 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8cs9j_10538719-040a-4cf2-b3df-26bf6b4c077e/kube-rbac-proxy/0.log"