Jul 22 16:20:48.622500 ip-10-0-142-32 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 16:20:48.622511 ip-10-0-142-32 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 16:20:48.622518 ip-10-0-142-32 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 16:20:48.622737 ip-10-0-142-32 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 16:20:58.790888 ip-10-0-142-32 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 22 16:20:58.790907 ip-10-0-142-32 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3a7c7a2eef8945779d3439603b26ec53 --
Jul 22 16:22:50.527340 ip-10-0-142-32 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 16:22:51.145463 ip-10-0-142-32 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 16:22:51.145463 ip-10-0-142-32 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 16:22:51.145463 ip-10-0-142-32 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 16:22:51.145463 ip-10-0-142-32 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 16:22:51.145463 ip-10-0-142-32 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 16:22:51.146105 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.145532    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 16:22:51.153083 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153044    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 16:22:51.153083 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153059    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 16:22:51.153083 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153063    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 16:22:51.153083 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153066    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 16:22:51.153083 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153069    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 16:22:51.153083 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153072    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 16:22:51.153083 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153075    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 16:22:51.153083 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153078    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 16:22:51.153083 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153081    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 16:22:51.153083 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153085    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 16:22:51.153083 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153088    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153091    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153095    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153099    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153102    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153105    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153108    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153116    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153119    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153122    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153124    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153127    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153130    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153132    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153135    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153137    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153140    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153143    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153146    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 16:22:51.153346 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153148    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153151    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153154    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153157    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153159    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153162    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153164    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153167    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153169    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153172    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153174    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153177    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153179    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153182    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153184    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153187    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153190    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153193    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153196    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153199    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 16:22:51.153786 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153202    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153205    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153207    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153211    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153214    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153217    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153220    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153223    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153225    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153228    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153230    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153233    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153235    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153238    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153240    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153244    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153247    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153250    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153253    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 16:22:51.154312 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153256    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153259    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153261    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153264    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153267    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153270    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153273    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153275    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153278    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153282    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153285    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153288    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153290    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153293    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153297    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153299    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153302    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153304    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153307    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153309    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 16:22:51.154754 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153312    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153314    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153317    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153319    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153321    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153324    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153326    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153329    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153331    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153334    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.153337    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154063    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154072    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154076    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154080    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154083    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154086    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154089    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154092    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 16:22:51.155261 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154096    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154098    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154101    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154104    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154106    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154109    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154111    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154114    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154117    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154121    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154123    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154126    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154129    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154131    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154134    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154136    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154139    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154141    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154144    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154146    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 16:22:51.155703 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154149    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154152    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154154    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154157    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154159    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154162    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154164    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154167    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154169    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154172    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154175    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154178    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154180    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154183    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154185    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154188    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154190    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154193    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154196    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154199    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 16:22:51.156198 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154202    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154205    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154207    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154210    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154212    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154215    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154217    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154220    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154222    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154224    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154227    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154229    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154234    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154238    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154242    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154245    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154247    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154250    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154253    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 16:22:51.156662 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154255    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154258    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154261    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154264    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154267    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154270    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154272    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154275    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154277    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154280    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154282    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154285    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154287    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154290    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154292    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154295    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154298    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154300    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154303    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154305    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 16:22:51.157124 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154308    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154311    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154313    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154316    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154319    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154322    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154324    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154327    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154329    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154332    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154334    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154337    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154716    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154721    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154724    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154727    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154729    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154732    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154735    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154737    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 16:22:51.157600 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154740    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154743    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154745    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154748    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154751    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154754    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154756    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154760    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154763    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154766    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154768    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154774    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154776    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154779    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154781    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154784    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154787    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154789    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154792    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154794    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 16:22:51.158074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154797    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154800    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154802    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154805    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154808    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154810    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154813    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154816    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154818    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154821    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154824    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154826    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154829    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154831    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154834    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154836    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154839    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154842    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154844    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154846    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 16:22:51.158528 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154849    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154852    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154854    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154858    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154861    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154863    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154866    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154868    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154872    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154876    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154879    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154882    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154884    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154887    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154890    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154892    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154895    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154898    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154902    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 16:22:51.159042 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154905    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154908    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154912    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154914    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154917    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154919    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154922    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154925    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154927    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154930    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154932    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154935    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154937    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154940    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154942    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154945    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154949    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154951    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154954    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154956    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 16:22:51.159493 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154959    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154961    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154963    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154966    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154976    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154979    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154982    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154986    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154990    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154993    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154996    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.154998    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155100    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155119    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155128    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155133    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155137    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155140    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155144    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155148    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155152    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 16:22:51.159987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155155    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155159    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155162    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155165    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155168    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155171    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155174    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155179    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155182    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155186    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155189    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155192    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155196    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155199    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155202    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155205    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155208    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155212    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155215    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155220    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155223    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155226    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155229    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155233    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 16:22:51.160502 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155236    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155238    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155241    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155244    2580 flags.go:64] FLAG: --enable-server="true"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155247    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155251    2580 flags.go:64] FLAG: --event-burst="100"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155254    2580 flags.go:64] FLAG: --event-qps="50"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155258    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155261    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155264    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155268    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155271    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155274    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155277    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155280    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155287    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155291    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155294    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155296    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155299    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155302    2580 flags.go:64] FLAG: --feature-gates=""
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155306    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155309    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155312    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155315    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155319    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 16:22:51.161075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155321    2580 flags.go:64] FLAG: --help="false"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155326    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155329    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155332    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155334    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155338    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155341    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155344    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155347    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155349    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155352    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155355    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155358    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155361    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155363    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155366    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155369    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155372    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155375    2580 flags.go:64] FLAG: --lock-file=""
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155377    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155380    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155383    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155390    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 16:22:51.161691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155393    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155395    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155398    2580 flags.go:64] FLAG: --logging-format="text"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155401    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155404    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155407    2580 flags.go:64] FLAG: --manifest-url=""
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155410    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155414    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155417    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155421    2580 flags.go:64] FLAG: --max-pods="110"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155427    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155430    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155432    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155436    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155439    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155442    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155445    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155451    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155454    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155457    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155460    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155463    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155468    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155471    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 16:22:51.162293 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155473    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155476    2580 flags.go:64] FLAG: --port="10250"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155479    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155482    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04dab7ff45b15b51e"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155485    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155487    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155491    2580 flags.go:64] FLAG: --register-node="true"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155494    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155498    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155501    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155504    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155506    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155510    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155513    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155516    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155518    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155521    2580 flags.go:64] FLAG: --runonce="false"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155524    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155527    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155531    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155534    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155536    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155540    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155543    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155546    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155549    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 16:22:51.163132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155551    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155554    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155557    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155560    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155563    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155566    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155571    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155574    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155576    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155580    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155583    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155586    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155589    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155591    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155594    2580 flags.go:64] FLAG: --v="2"
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155598    2580 flags.go:64] FLAG: --version="false"
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155602    2580 flags.go:64] FLAG: --vmodule=""
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155607    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.155610    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155743    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155747    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155751    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155754    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155757    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 16:22:51.163913 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155759    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155763    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155766    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155769    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155771    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155775    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155778    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155781    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155784    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155787    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155790    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155793    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155795    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155798    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155800    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155803    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155805    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155808    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155812    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 16:22:51.164498 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155815    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155817    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155820    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155822    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155825    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155828    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155831    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155834    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155836    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155838    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155841    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155844    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155846    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155848    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155852    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155854    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155857    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155860    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155862    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155865    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 16:22:51.164963 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155867    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155870    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155872    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155875    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155878    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155880    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155883    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155885    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155888    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155890    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155893    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155896    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155899    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155902    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155904    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155907    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155909    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155912    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155915    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155917    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 16:22:51.165464 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155920    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155922    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155925    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155927    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155930    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155932    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155936    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155939    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155942    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155944    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155946    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155949    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155952    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155954    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155957    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155959    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155962    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155964    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155967    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155970    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 16:22:51.165934 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155972    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155975    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155978    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155984    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155988    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155991    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155994    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.155997    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.156000    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.156003    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.156005    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.156009    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.156011    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.156014    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 16:22:51.166432 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.156030    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.156629    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.164568    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.164584    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.164605    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.164611    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164681    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164686    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164690    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164693    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164696    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164699    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164702    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164706    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 16:22:51.166757 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164710    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164713    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164716    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164719    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164721    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164724    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164727    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164729    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164733    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164736    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164738    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164741    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164744    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164746    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164749    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164751    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164754    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164756    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164759    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164761    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 16:22:51.167233 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164764    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164767    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164770    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164773    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164776    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164778    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164782    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164786    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164789    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164792    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164794    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164797    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164800    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164803    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164805    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164808    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164811    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164814    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164817    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164821    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 16:22:51.167715 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164823    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164826    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164829    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164833    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164836    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164839    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164842    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164845    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164848    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164850    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164853    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164856    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164858    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164861    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164864    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164866    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164869    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164872    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164874    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164876    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 16:22:51.168234 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164879    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164896    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164900    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164903    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164906    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164909    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164912    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164915    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164918    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164922    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164925    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164928    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164931    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164934    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164937    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164940    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164943    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164946    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164948    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 16:22:51.168716 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164951    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164954    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164957    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164959    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164962    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164965    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164968    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164971    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164973    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164976    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164979    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.164982    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.164986    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165120    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165127    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 16:22:51.169207 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165129    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165132    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165135    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165137    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165140    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165142    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165145    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165147    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165150    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165153    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165156    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165159    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165162    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165164    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165167    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165170    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165173    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165175    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165178    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165180    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 16:22:51.169567 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165183    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165186    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165188    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165191    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165195    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165199    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165202    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165205    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165208    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165210    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165213    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165215    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165218    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165221    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165223    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165226    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165228    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165231    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165233    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 16:22:51.170055 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165236    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165238    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165241    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165243    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165247    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165249    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165252    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165254    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165257    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165259    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165262    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165264    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165267    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165269    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165272    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165275    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165277    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165280    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165282    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165285    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 16:22:51.170510 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165288    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165291    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165293    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165295    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165298    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165300    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165303    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165306    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165308    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165311    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165315    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165318    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165321    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165323    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165326    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165329    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165331    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165334    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 16:22:51.170988 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165337    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165340    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165343    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165345    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165348    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165350    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165353    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165356    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165358    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165361    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165363    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165366    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165369    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165371    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165374    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165376    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165379    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165382    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165384    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 16:22:51.171469 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:51.165386    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 16:22:51.171937 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.165392    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 16:22:51.171937 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.165504    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 16:22:51.171937 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.168094    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 16:22:51.171937 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.169412    2580 server.go:1019] "Starting client certificate rotation"
Jul 22 16:22:51.171937 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.169506    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 16:22:51.171937 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.169538    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 16:22:51.171937 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.171596    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 16:22:51.172811 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.172790    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 16:22:51.182689 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.182672    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 22 16:22:51.187005 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.186985    2580 log.go:25] "Validated CRI v1 image API"
Jul 22 16:22:51.187865 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.187849    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 16:22:51.193788 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.193768    2580 fs.go:135] Filesystem UUIDs: map[188fcc7e-d683-4016-a48a-fc5e4efd412f:/dev/nvme0n1p3 2408e5bc-580d-4cb9-b8c1-c0965593deef:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 22 16:22:51.193863 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.193788    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 16:22:51.198807 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.198779    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 16:22:51.202228 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.202111    2580 manager.go:216] Machine: {Timestamp:2026-07-22 16:22:51.200528908 +0000 UTC m=+0.552804923 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109000 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aeedace01f73fb86b54362b168e4b SystemUUID:ec2aeeda-ce01-f73f-b86b-54362b168e4b BootID:3a7c7a2e-ef89-4577-9d34-39603b26ec53 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:69:b1:f4:1e:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:69:b1:f4:1e:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:d3:00:cb:9a:76 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 16:22:51.202228 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.202216    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 16:22:51.202411 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.202329    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 16:22:51.204937 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.204908    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 16:22:51.205132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.204939    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-32.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 16:22:51.205921 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.205909    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 16:22:51.205978 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.205925    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 16:22:51.205978 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.205937    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 16:22:51.206840 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.206826    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 16:22:51.208137 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.208125    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 16:22:51.211424 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.211409    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 16:22:51.211601 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.211588    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 16:22:51.211663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.211629    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 16:22:51.211663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.211645    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 16:22:51.211765 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.211667    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 16:22:51.211765 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.211686    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 22 16:22:51.211765 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.211700    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 16:22:51.212110 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.212078    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 16:22:51.212176 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.212120    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 16:22:51.214347 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.214332    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 16:22:51.216452 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.216435    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 16:22:51.216510 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.216472    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 16:22:51.217623 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.217605    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 16:22:51.217699 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.217631    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 16:22:51.217699 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.217638    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 16:22:51.217699 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.217646    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 16:22:51.217699 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.217657    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 16:22:51.217699 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.217676    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 16:22:51.217699 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.217685    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 16:22:51.217699 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.217691    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 16:22:51.217699 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.217697    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 16:22:51.217699 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.217703    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 16:22:51.218005 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.217719    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 16:22:51.218005 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.217725    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 16:22:51.219044 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.219032    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 16:22:51.219084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.219046    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 16:22:51.222338 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.222325    2580 server.go:1268] "Started kubelet"
Jul 22 16:22:51.222453 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.222415    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 16:22:51.222585 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.222493    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 16:22:51.222731 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.222712    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 16:22:51.223348 ip-10-0-142-32 systemd[1]: Started Kubernetes Kubelet.
Jul 22 16:22:51.223618 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.223535    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 16:22:51.223618 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.223540    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 16:22:51.223717 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.223656    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-32.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 16:22:51.224461 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.224429    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 16:22:51.225154 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.225140    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 16:22:51.225884 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.225868    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhmzh"
Jul 22 16:22:51.228391 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.228359    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 16:22:51.228470 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.227354    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-32.ec2.internal.18c4a92ee511c82f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-32.ec2.internal,UID:ip-10-0-142-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-32.ec2.internal,},FirstTimestamp:2026-07-22 16:22:51.222296623 +0000 UTC m=+0.574572636,LastTimestamp:2026-07-22 16:22:51.222296623 +0000 UTC m=+0.574572636,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-32.ec2.internal,}"
Jul 22 16:22:51.230697 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.230673    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 16:22:51.230697 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.230678    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 16:22:51.230840 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.230767    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:51.231262 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.231240    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 16:22:51.231262 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.231241    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 16:22:51.231422 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.231270    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 16:22:51.231422 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.231383    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 16:22:51.231422 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.231390    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 16:22:51.232185 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.232162    2580 factory.go:55] Registering systemd factory
Jul 22 16:22:51.232290 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.232209    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 22 16:22:51.233551 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.233531    2580 factory.go:153] Registering CRI-O factory
Jul 22 16:22:51.233551 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.233553    2580 factory.go:223] Registration of the crio container factory successfully
Jul 22 16:22:51.233686 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.233612    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 16:22:51.233686 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.233639    2580 factory.go:103] Registering Raw factory
Jul 22 16:22:51.233686 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.233657    2580 manager.go:1196] Started watching for new ooms in manager
Jul 22 16:22:51.234306 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.234291    2580 manager.go:349] Starting recovery of all containers
Jul 22 16:22:51.234466 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.234436    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 16:22:51.234530 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.234447    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 16:22:51.239039 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.236865    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhmzh"
Jul 22 16:22:51.247939 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.247915    2580 manager.go:354] Recovery completed
Jul 22 16:22:51.252631 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.252526    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:22:51.256649 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.256634    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:22:51.256708 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.256665    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:22:51.256708 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.256682    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:22:51.257248 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.257233    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 16:22:51.257248 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.257245    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 16:22:51.257341 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.257260    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 16:22:51.257341 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.257238    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:22:51.258255 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.258237    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:22:51.258322 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.258265    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:22:51.258322 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.258275    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:22:51.258692 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.258678    2580 policy_none.go:49] "None policy: Start"
Jul 22 16:22:51.258727 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.258700    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 16:22:51.258727 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.258717    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 16:22:51.259803 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.259788    2580 policy_none.go:47] "Start"
Jul 22 16:22:51.297764 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.297748    2580 manager.go:337] "Starting Device Plugin manager"
Jul 22 16:22:51.297860 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.297784    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 16:22:51.297860 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.297794    2580 server.go:87] "Starting device plugin registration server"
Jul 22 16:22:51.298063 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.298042    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 16:22:51.298126 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.298072    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 16:22:51.298223 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.298201    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 16:22:51.298471 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.298314    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 16:22:51.298471 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.298329    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 16:22:51.299287 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.299263    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 16:22:51.299377 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.299322    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:51.364639 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.364607    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 16:22:51.366017 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.366000    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 16:22:51.366124 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.366041    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 16:22:51.366124 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.366066    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 16:22:51.366124 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.366115    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 16:22:51.368526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.368506    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 16:22:51.399078 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.399038    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:22:51.400006 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.399987    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:22:51.400128 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.400017    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:22:51.400128 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.400047    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:22:51.400128 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.400073    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.406509 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.406464    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.406509 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.406486    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-32.ec2.internal\": node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:51.422789 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.422762    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:51.466557 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.466528    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-32.ec2.internal"]
Jul 22 16:22:51.466661 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.466591    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:22:51.467531 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.467511    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:22:51.467608 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.467545    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:22:51.467608 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.467565    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:22:51.468902 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.468890    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:22:51.469079 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.469064    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.469163 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.469096    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:22:51.469616 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.469602    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:22:51.469685 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.469619    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:22:51.469685 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.469630    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:22:51.469685 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.469643    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:22:51.469685 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.469657    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:22:51.469820 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.469645    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:22:51.470992 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.470978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.471044 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.471002    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:22:51.472207 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.472188    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:22:51.472287 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.472220    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:22:51.472287 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.472234    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:22:51.494882 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.494857    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-32.ec2.internal\" not found" node="ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.499909 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.499890    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-32.ec2.internal\" not found" node="ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.523000 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.522975    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:51.533278 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.533261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6f9829d91eb47ddd7a62b2260080095f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal\" (UID: \"6f9829d91eb47ddd7a62b2260080095f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.533368 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.533286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f9829d91eb47ddd7a62b2260080095f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal\" (UID: \"6f9829d91eb47ddd7a62b2260080095f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.533368 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.533303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6e9fcf95a14b3457c9d6d94083569909-config\") pod \"kube-apiserver-proxy-ip-10-0-142-32.ec2.internal\" (UID: \"6e9fcf95a14b3457c9d6d94083569909\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.624219 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.624192    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:51.633862 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.633841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6f9829d91eb47ddd7a62b2260080095f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal\" (UID: \"6f9829d91eb47ddd7a62b2260080095f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.633952 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.633904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f9829d91eb47ddd7a62b2260080095f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal\" (UID: \"6f9829d91eb47ddd7a62b2260080095f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.633997 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.633946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f9829d91eb47ddd7a62b2260080095f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal\" (UID: \"6f9829d91eb47ddd7a62b2260080095f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.633997 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.633981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6e9fcf95a14b3457c9d6d94083569909-config\") pod \"kube-apiserver-proxy-ip-10-0-142-32.ec2.internal\" (UID: \"6e9fcf95a14b3457c9d6d94083569909\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.634068 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.634016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6e9fcf95a14b3457c9d6d94083569909-config\") pod \"kube-apiserver-proxy-ip-10-0-142-32.ec2.internal\" (UID: \"6e9fcf95a14b3457c9d6d94083569909\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.634068 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.633949    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6f9829d91eb47ddd7a62b2260080095f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal\" (UID: \"6f9829d91eb47ddd7a62b2260080095f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.724539 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.724461    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:51.802965 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.802929    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.803083 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:51.802929    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:51.825166 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.825141    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:51.927266 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:51.927218    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:52.027370 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:52.027298    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:52.088612 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.088577    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 16:22:52.129666 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:52.129622    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:52.170974 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.170942    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 16:22:52.171489 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.171124    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 16:22:52.171489 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.171126    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 16:22:52.230152 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:52.230126    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:52.240450 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.240420    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 16:17:52 +0000 UTC" deadline="2028-04-09 22:24:17.01547023 +0000 UTC"
Jul 22 16:22:52.240500 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.240455    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15054h1m24.775027029s"
Jul 22 16:22:52.331065 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:52.331041    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:52.424450 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:52.424413    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9829d91eb47ddd7a62b2260080095f.slice/crio-ba6a9b9c8330a01e411f7e6798f6b44ffbbdbbaa785b6903cfe7b2715620d2d3 WatchSource:0}: Error finding container ba6a9b9c8330a01e411f7e6798f6b44ffbbdbbaa785b6903cfe7b2715620d2d3: Status 404 returned error can't find the container with id ba6a9b9c8330a01e411f7e6798f6b44ffbbdbbaa785b6903cfe7b2715620d2d3
Jul 22 16:22:52.424766 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:52.424746    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9fcf95a14b3457c9d6d94083569909.slice/crio-85217b87adcdf75122ad6e16a60458d7cf93c31cee4a3154893bfd115aace600 WatchSource:0}: Error finding container 85217b87adcdf75122ad6e16a60458d7cf93c31cee4a3154893bfd115aace600: Status 404 returned error can't find the container with id 85217b87adcdf75122ad6e16a60458d7cf93c31cee4a3154893bfd115aace600
Jul 22 16:22:52.432915 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:52.432799    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:52.433453 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.433435    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 16:22:52.533491 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:52.533445    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:52.637721 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:52.637663    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-32.ec2.internal\" not found"
Jul 22 16:22:52.725690 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.725658    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 16:22:52.730960 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.730940    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:52.742555 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.742538    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 16:22:52.744427 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.744414    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-32.ec2.internal"
Jul 22 16:22:52.754048 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.754020    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 16:22:52.787554 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.787528    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 16:22:52.984707 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:52.984626    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 16:22:53.215060 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.215001    2580 apiserver.go:52] "Watching apiserver"
Jul 22 16:22:53.224264 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.224236    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 16:22:53.224772 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.224743    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-jtsgq","kube-system/konnectivity-agent-gm4w2","kube-system/kube-apiserver-proxy-ip-10-0-142-32.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v","openshift-dns/node-resolver-65tvf","openshift-multus/multus-additional-cni-plugins-7q49k","openshift-network-diagnostics/network-check-target-ls2js","openshift-ovn-kubernetes/ovnkube-node-r8kmz","kube-system/global-pull-secret-syncer-x296k","openshift-cluster-node-tuning-operator/tuned-dfhbf","openshift-image-registry/node-ca-zbdf2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal","openshift-multus/multus-mkxwr","openshift-multus/network-metrics-daemon-r8tkj"]
Jul 22 16:22:53.226692 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.226668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:22:53.226827 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.226748    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:22:53.228127 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.228082    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.229195 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.229167    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:22:53.229309 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.229240    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:22:53.232369 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.231292    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.232369 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.231589    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 16:22:53.232369 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.232167    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4tfrq\""
Jul 22 16:22:53.232611 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.232410    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 16:22:53.232611 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.232476    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 16:22:53.232872 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.232814    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-65tvf"
Jul 22 16:22:53.233602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.232989    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 16:22:53.233602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.233258    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.238164 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.235067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:53.238164 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.235202    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:22:53.238164 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.235334    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 16:22:53.238164 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.235510    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 16:22:53.238164 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.235835    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 16:22:53.238164 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.236171    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 16:22:53.238504 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.238446    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 16:22:53.238913 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.238803    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hfb89\""
Jul 22 16:22:53.240157 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.239079    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 16:22:53.240157 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.239177    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tdp5t\""
Jul 22 16:22:53.240157 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.239466    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 16:22:53.240157 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.239823    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 16:22:53.242123 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.240518    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jtsgq"
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.243049    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.243216    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gm4w2"
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.243461    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-42vjp\""
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.243545    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k6vj2\""
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.243762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-socket-dir\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.243806    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-multus-socket-dir-parent\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.243855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-hostroot\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.243894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/57478d6c-8207-4831-ab7d-43c274460043-multus-daemon-config\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.243943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqd5m\" (UniqueName: \"kubernetes.io/projected/57478d6c-8207-4831-ab7d-43c274460043-kube-api-access-sqd5m\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.243978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7949k\" (UniqueName: \"kubernetes.io/projected/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-kube-api-access-7949k\") pod \"network-metrics-daemon-r8tkj\" (UID: \"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0\") " pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.243989    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.244012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-device-dir\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.244041    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cd5b8a2-941c-4540-a348-5faea8a1dc5f-hosts-file\") pod \"node-resolver-65tvf\" (UID: \"6cd5b8a2-941c-4540-a348-5faea8a1dc5f\") " pod="openshift-dns/node-resolver-65tvf"
Jul 22 16:22:53.245191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.244169    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 16:22:53.246408 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fcdfe093-5973-4a2e-a507-e7783f3fc908-os-release\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.246498 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-var-lib-cni-bin\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.246498 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246460    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-var-lib-kubelet\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.246498 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.246671 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smrn8\" (UniqueName: \"kubernetes.io/projected/bacc9c00-bbc6-4888-90e9-2b579136b810-kube-api-access-smrn8\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.246671 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-run-netns\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.246671 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-var-lib-cni-multus\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.246671 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-multus-cni-dir\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.246671 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246611    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-etc-selinux\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.246671 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cd5b8a2-941c-4540-a348-5faea8a1dc5f-tmp-dir\") pod \"node-resolver-65tvf\" (UID: \"6cd5b8a2-941c-4540-a348-5faea8a1dc5f\") " pod="openshift-dns/node-resolver-65tvf"
Jul 22 16:22:53.246671 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246666    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 16:22:53.247019 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-system-cni-dir\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.247019 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-etc-kubernetes\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.247019 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246837    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcdfe093-5973-4a2e-a507-e7783f3fc908-system-cni-dir\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.247019 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcdfe093-5973-4a2e-a507-e7783f3fc908-cni-binary-copy\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.247019 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcdfe093-5973-4a2e-a507-e7783f3fc908-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.247019 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246904    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 16:22:53.247019 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fcdfe093-5973-4a2e-a507-e7783f3fc908-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.247019 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgrnl\" (UniqueName: \"kubernetes.io/projected/fcdfe093-5973-4a2e-a507-e7783f3fc908-kube-api-access-mgrnl\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.247019 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-registration-dir\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.247019 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.246996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fcdfe093-5973-4a2e-a507-e7783f3fc908-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.247019 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.247020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-cnibin\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.247660 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.247042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-os-release\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.247660 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.247066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-run-k8s-cni-cncf-io\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.247660 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.247092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-sys-fs\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.247660 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.247133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k68p4\" (UniqueName: \"kubernetes.io/projected/6cd5b8a2-941c-4540-a348-5faea8a1dc5f-kube-api-access-k68p4\") pod \"node-resolver-65tvf\" (UID: \"6cd5b8a2-941c-4540-a348-5faea8a1dc5f\") " pod="openshift-dns/node-resolver-65tvf"
Jul 22 16:22:53.247660 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.247157    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcdfe093-5973-4a2e-a507-e7783f3fc908-cnibin\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.247660 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.247182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt8vx\" (UniqueName: \"kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx\") pod \"network-check-target-ls2js\" (UID: \"052c15fe-5980-4085-878c-4d2abaabd167\") " pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:22:53.247660 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.247212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57478d6c-8207-4831-ab7d-43c274460043-cni-binary-copy\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.247660 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.247237    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-multus-conf-dir\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.247660 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.247261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-run-multus-certs\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.247660 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.247287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs\") pod \"network-metrics-daemon-r8tkj\" (UID: \"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0\") " pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:22:53.248240 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.247737    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.248639 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.248622    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zbdf2"
Jul 22 16:22:53.249381 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.249340    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2bpg7\""
Jul 22 16:22:53.249652 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.249630    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 16:22:53.250146 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.250126    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 16:22:53.250262 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.250213    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7gqbl\""
Jul 22 16:22:53.250470 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.250452    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 16:22:53.250795 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.250777    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 16:22:53.251486 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.251449    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wb5db\""
Jul 22 16:22:53.251765 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.251746    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 16:22:53.252038 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.252020    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 16:22:53.252195 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.252176    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.255185 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.255158    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 16:22:53.255726 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.255687    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 16:22:53.255818 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.255794    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 16:22:53.256544 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.256524    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 16:22:53.256745 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.256532    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 16:22:53.256819 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.256542    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4zqt5\""
Jul 22 16:22:53.256881 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.256590    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 16:22:53.265224 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.265165    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4dps8"
Jul 22 16:22:53.274741 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.274373    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4dps8"
Jul 22 16:22:53.332910 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.332881    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 16:22:53.347620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.347591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs\") pod \"network-metrics-daemon-r8tkj\" (UID: \"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0\") " pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:22:53.347756 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.347634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-socket-dir\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.347756 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.347663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-hostroot\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.347756 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.347690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/57478d6c-8207-4831-ab7d-43c274460043-multus-daemon-config\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.347756 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.347718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-sysconfig\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.347756 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.347743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-var-lib-kubelet\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.347987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.347767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-slash\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.347987 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.347779    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:22:53.347987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.347791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-node-log\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.347987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.347808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-socket-dir\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.347987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.347859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-hostroot\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.347987 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.347877    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs podName:6b538e50-43f8-44c8-ab6f-5188c3b0a6d0 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:53.847829994 +0000 UTC m=+3.200106031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs") pod "network-metrics-daemon-r8tkj" (UID: "6b538e50-43f8-44c8-ab6f-5188c3b0a6d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:22:53.347987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.347904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7949k\" (UniqueName: \"kubernetes.io/projected/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-kube-api-access-7949k\") pod \"network-metrics-daemon-r8tkj\" (UID: \"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0\") " pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:22:53.348298 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-device-dir\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.348298 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cd5b8a2-941c-4540-a348-5faea8a1dc5f-hosts-file\") pod \"node-resolver-65tvf\" (UID: \"6cd5b8a2-941c-4540-a348-5faea8a1dc5f\") " pod="openshift-dns/node-resolver-65tvf"
Jul 22 16:22:53.348298 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fcdfe093-5973-4a2e-a507-e7783f3fc908-os-release\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.348298 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-var-lib-cni-bin\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.348298 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-device-dir\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.348298 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-var-lib-kubelet\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-var-lib-cni-bin\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348319    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-var-lib-kubelet\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348357    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cd5b8a2-941c-4540-a348-5faea8a1dc5f-hosts-file\") pod \"node-resolver-65tvf\" (UID: \"6cd5b8a2-941c-4540-a348-5faea8a1dc5f\") " pod="openshift-dns/node-resolver-65tvf"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348385    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fcdfe093-5973-4a2e-a507-e7783f3fc908-os-release\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-run-netns\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-env-overrides\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smrn8\" (UniqueName: \"kubernetes.io/projected/bacc9c00-bbc6-4888-90e9-2b579136b810-kube-api-access-smrn8\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/57478d6c-8207-4831-ab7d-43c274460043-multus-daemon-config\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-run-netns\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-var-lib-cni-multus\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8gd9\" (UniqueName: \"kubernetes.io/projected/29f4bc53-8423-444e-99e2-9a451218fffa-kube-api-access-f8gd9\") pod \"iptables-alerter-jtsgq\" (UID: \"29f4bc53-8423-444e-99e2-9a451218fffa\") " pod="openshift-network-operator/iptables-alerter-jtsgq"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348562    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f367069-f513-4d98-8aae-722c4b6dd495-konnectivity-ca\") pod \"konnectivity-agent-gm4w2\" (UID: \"3f367069-f513-4d98-8aae-722c4b6dd495\") " pod="kube-system/konnectivity-agent-gm4w2"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-run-netns\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348585    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-var-lib-cni-multus\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.348620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-run\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-multus-cni-dir\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-etc-selinux\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cd5b8a2-941c-4540-a348-5faea8a1dc5f-tmp-dir\") pod \"node-resolver-65tvf\" (UID: \"6cd5b8a2-941c-4540-a348-5faea8a1dc5f\") " pod="openshift-dns/node-resolver-65tvf"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f367069-f513-4d98-8aae-722c4b6dd495-agent-certs\") pod \"konnectivity-agent-gm4w2\" (UID: \"3f367069-f513-4d98-8aae-722c4b6dd495\") " pod="kube-system/konnectivity-agent-gm4w2"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-tuned\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-etc-openvswitch\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348831    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-multus-cni-dir\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-system-cni-dir\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29f4bc53-8423-444e-99e2-9a451218fffa-host-slash\") pod \"iptables-alerter-jtsgq\" (UID: \"29f4bc53-8423-444e-99e2-9a451218fffa\") " pod="openshift-network-operator/iptables-alerter-jtsgq"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348936    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-system-cni-dir\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.348996    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-etc-selinux\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349008    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-ovn-node-metrics-cert\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcdfe093-5973-4a2e-a507-e7783f3fc908-cni-binary-copy\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.349384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349067    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cd5b8a2-941c-4540-a348-5faea8a1dc5f-tmp-dir\") pod \"node-resolver-65tvf\" (UID: \"6cd5b8a2-941c-4540-a348-5faea8a1dc5f\") " pod="openshift-dns/node-resolver-65tvf"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcdfe093-5973-4a2e-a507-e7783f3fc908-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgrnl\" (UniqueName: \"kubernetes.io/projected/fcdfe093-5973-4a2e-a507-e7783f3fc908-kube-api-access-mgrnl\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29f4bc53-8423-444e-99e2-9a451218fffa-iptables-alerter-script\") pod \"iptables-alerter-jtsgq\" (UID: \"29f4bc53-8423-444e-99e2-9a451218fffa\") " pod="openshift-network-operator/iptables-alerter-jtsgq"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dce853aa-d400-49b5-8902-cb4bf7e2c732-kubelet-config\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-sysctl-conf\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349740    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-run-systemd\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-run-k8s-cni-cncf-io\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-cni-bin\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k68p4\" (UniqueName: \"kubernetes.io/projected/6cd5b8a2-941c-4540-a348-5faea8a1dc5f-kube-api-access-k68p4\") pod \"node-resolver-65tvf\" (UID: \"6cd5b8a2-941c-4540-a348-5faea8a1dc5f\") " pod="openshift-dns/node-resolver-65tvf"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349854    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcdfe093-5973-4a2e-a507-e7783f3fc908-cnibin\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt8vx\" (UniqueName: \"kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx\") pod \"network-check-target-ls2js\" (UID: \"052c15fe-5980-4085-878c-4d2abaabd167\") " pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-run-k8s-cni-cncf-io\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcdfe093-5973-4a2e-a507-e7783f3fc908-cnibin\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.350014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.349956    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57478d6c-8207-4831-ab7d-43c274460043-cni-binary-copy\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-run-multus-certs\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350154    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-kubernetes\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-var-lib-openvswitch\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350227    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-multus-socket-dir-parent\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350247    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcdfe093-5973-4a2e-a507-e7783f3fc908-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-sysctl-d\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350275    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-host-run-multus-certs\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-log-socket\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350323    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-multus-socket-dir-parent\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-kubelet\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-ovnkube-config\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350480    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-modprobe-d\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-systemd\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-sys\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcdfe093-5973-4a2e-a507-e7783f3fc908-cni-binary-copy\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.350738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350553    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-host\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-run-ovn\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350599    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-lib-modules\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57478d6c-8207-4831-ab7d-43c274460043-cni-binary-copy\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350625    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wz48\" (UniqueName: \"kubernetes.io/projected/e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6-kube-api-access-4wz48\") pod \"node-ca-zbdf2\" (UID: \"e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6\") " pod="openshift-image-registry/node-ca-zbdf2"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-run-openvswitch\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnm5x\" (UniqueName: \"kubernetes.io/projected/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-kube-api-access-lnm5x\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-etc-kubernetes\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6-host\") pod \"node-ca-zbdf2\" (UID: \"e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6\") " pod="openshift-image-registry/node-ca-zbdf2"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350772    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6-serviceca\") pod \"node-ca-zbdf2\" (UID: \"e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6\") " pod="openshift-image-registry/node-ca-zbdf2"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350824    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-etc-kubernetes\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcdfe093-5973-4a2e-a507-e7783f3fc908-system-cni-dir\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcdfe093-5973-4a2e-a507-e7783f3fc908-system-cni-dir\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.350951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fcdfe093-5973-4a2e-a507-e7783f3fc908-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351044    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0bdca61-4227-4b81-915c-0b12b46806d9-tmp\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.351602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351120    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-systemd-units\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-cni-netd\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-ovnkube-script-lib\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-registration-dir\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fcdfe093-5973-4a2e-a507-e7783f3fc908-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351293    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-cnibin\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-os-release\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351368    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dce853aa-d400-49b5-8902-cb4bf7e2c732-dbus\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351397    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h22cj\" (UniqueName: \"kubernetes.io/projected/d0bdca61-4227-4b81-915c-0b12b46806d9-kube-api-access-h22cj\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fcdfe093-5973-4a2e-a507-e7783f3fc908-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-sys-fs\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-multus-conf-dir\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqd5m\" (UniqueName: \"kubernetes.io/projected/57478d6c-8207-4831-ab7d-43c274460043-kube-api-access-sqd5m\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-os-release\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351732    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-sys-fs\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351736    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bacc9c00-bbc6-4888-90e9-2b579136b810-registration-dir\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.352496 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351790    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-multus-conf-dir\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.353404 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.351816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57478d6c-8207-4831-ab7d-43c274460043-cnibin\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.353404 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.352316    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fcdfe093-5973-4a2e-a507-e7783f3fc908-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.355541 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.355331    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 16:22:53.356687 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.356565    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:22:53.356687 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.356591    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:22:53.356687 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.356604    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rt8vx for pod openshift-network-diagnostics/network-check-target-ls2js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:22:53.356914 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.356692    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx podName:052c15fe-5980-4085-878c-4d2abaabd167 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:53.856673291 +0000 UTC m=+3.208949313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rt8vx" (UniqueName: "kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx") pod "network-check-target-ls2js" (UID: "052c15fe-5980-4085-878c-4d2abaabd167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:22:53.359629 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.359601    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k68p4\" (UniqueName: \"kubernetes.io/projected/6cd5b8a2-941c-4540-a348-5faea8a1dc5f-kube-api-access-k68p4\") pod \"node-resolver-65tvf\" (UID: \"6cd5b8a2-941c-4540-a348-5faea8a1dc5f\") " pod="openshift-dns/node-resolver-65tvf"
Jul 22 16:22:53.359724 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.359617    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7949k\" (UniqueName: \"kubernetes.io/projected/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-kube-api-access-7949k\") pod \"network-metrics-daemon-r8tkj\" (UID: \"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0\") " pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:22:53.359724 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.359606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smrn8\" (UniqueName: \"kubernetes.io/projected/bacc9c00-bbc6-4888-90e9-2b579136b810-kube-api-access-smrn8\") pod \"aws-ebs-csi-driver-node-wj84v\" (UID: \"bacc9c00-bbc6-4888-90e9-2b579136b810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.360520 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.360474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgrnl\" (UniqueName: \"kubernetes.io/projected/fcdfe093-5973-4a2e-a507-e7783f3fc908-kube-api-access-mgrnl\") pod \"multus-additional-cni-plugins-7q49k\" (UID: \"fcdfe093-5973-4a2e-a507-e7783f3fc908\") " pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.362645 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.362621    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqd5m\" (UniqueName: \"kubernetes.io/projected/57478d6c-8207-4831-ab7d-43c274460043-kube-api-access-sqd5m\") pod \"multus-mkxwr\" (UID: \"57478d6c-8207-4831-ab7d-43c274460043\") " pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.374198 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.374153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal" event={"ID":"6f9829d91eb47ddd7a62b2260080095f","Type":"ContainerStarted","Data":"ba6a9b9c8330a01e411f7e6798f6b44ffbbdbbaa785b6903cfe7b2715620d2d3"}
Jul 22 16:22:53.375360 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.375313    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-32.ec2.internal" event={"ID":"6e9fcf95a14b3457c9d6d94083569909","Type":"ContainerStarted","Data":"85217b87adcdf75122ad6e16a60458d7cf93c31cee4a3154893bfd115aace600"}
Jul 22 16:22:53.452593 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452548    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-slash\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.452593 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-node-log\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.452857 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-run-netns\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.452857 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-env-overrides\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.452857 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8gd9\" (UniqueName: \"kubernetes.io/projected/29f4bc53-8423-444e-99e2-9a451218fffa-kube-api-access-f8gd9\") pod \"iptables-alerter-jtsgq\" (UID: \"29f4bc53-8423-444e-99e2-9a451218fffa\") " pod="openshift-network-operator/iptables-alerter-jtsgq"
Jul 22 16:22:53.452857 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452678    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-slash\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.452857 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f367069-f513-4d98-8aae-722c4b6dd495-konnectivity-ca\") pod \"konnectivity-agent-gm4w2\" (UID: \"3f367069-f513-4d98-8aae-722c4b6dd495\") " pod="kube-system/konnectivity-agent-gm4w2"
Jul 22 16:22:53.452857 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-run\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.452857 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452751    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-run-netns\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.452857 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452786    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f367069-f513-4d98-8aae-722c4b6dd495-agent-certs\") pod \"konnectivity-agent-gm4w2\" (UID: \"3f367069-f513-4d98-8aae-722c4b6dd495\") " pod="kube-system/konnectivity-agent-gm4w2"
Jul 22 16:22:53.452857 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-run\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.452857 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-tuned\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.452857 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-etc-openvswitch\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.453526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29f4bc53-8423-444e-99e2-9a451218fffa-host-slash\") pod \"iptables-alerter-jtsgq\" (UID: \"29f4bc53-8423-444e-99e2-9a451218fffa\") " pod="openshift-network-operator/iptables-alerter-jtsgq"
Jul 22 16:22:53.453526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.453526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.452923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-ovn-node-metrics-cert\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.453526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.453367    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-env-overrides\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.453526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.453491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29f4bc53-8423-444e-99e2-9a451218fffa-host-slash\") pod \"iptables-alerter-jtsgq\" (UID: \"29f4bc53-8423-444e-99e2-9a451218fffa\") " pod="openshift-network-operator/iptables-alerter-jtsgq"
Jul 22 16:22:53.453870 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.453537    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-etc-openvswitch\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.453978    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f367069-f513-4d98-8aae-722c4b6dd495-konnectivity-ca\") pod \"konnectivity-agent-gm4w2\" (UID: \"3f367069-f513-4d98-8aae-722c4b6dd495\") " pod="kube-system/konnectivity-agent-gm4w2"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454023    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-node-log\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454052    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454412    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29f4bc53-8423-444e-99e2-9a451218fffa-iptables-alerter-script\") pod \"iptables-alerter-jtsgq\" (UID: \"29f4bc53-8423-444e-99e2-9a451218fffa\") " pod="openshift-network-operator/iptables-alerter-jtsgq"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dce853aa-d400-49b5-8902-cb4bf7e2c732-kubelet-config\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-sysctl-conf\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-run-systemd\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-cni-bin\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-kubernetes\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-var-lib-openvswitch\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-sysctl-d\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-log-socket\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-kubelet\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-ovnkube-config\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-modprobe-d\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454775    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-systemd\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.456667 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454801    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-sys\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-host\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-run-ovn\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-lib-modules\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wz48\" (UniqueName: \"kubernetes.io/projected/e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6-kube-api-access-4wz48\") pod \"node-ca-zbdf2\" (UID: \"e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6\") " pod="openshift-image-registry/node-ca-zbdf2"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-run-openvswitch\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnm5x\" (UniqueName: \"kubernetes.io/projected/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-kube-api-access-lnm5x\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.454991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6-host\") pod \"node-ca-zbdf2\" (UID: \"e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6\") " pod="openshift-image-registry/node-ca-zbdf2"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455012    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6-serviceca\") pod \"node-ca-zbdf2\" (UID: \"e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6\") " pod="openshift-image-registry/node-ca-zbdf2"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0bdca61-4227-4b81-915c-0b12b46806d9-tmp\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-systemd-units\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-cni-netd\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-ovnkube-script-lib\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dce853aa-d400-49b5-8902-cb4bf7e2c732-dbus\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455227    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h22cj\" (UniqueName: \"kubernetes.io/projected/d0bdca61-4227-4b81-915c-0b12b46806d9-kube-api-access-h22cj\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455254    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.457663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-kubernetes\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455311    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-sysconfig\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-var-lib-kubelet\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dce853aa-d400-49b5-8902-cb4bf7e2c732-kubelet-config\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455431    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-var-lib-openvswitch\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455432    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-log-socket\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455475    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-systemd\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-sys\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-host\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455598    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-sysctl-d\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455602    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29f4bc53-8423-444e-99e2-9a451218fffa-iptables-alerter-script\") pod \"iptables-alerter-jtsgq\" (UID: \"29f4bc53-8423-444e-99e2-9a451218fffa\") " pod="openshift-network-operator/iptables-alerter-jtsgq"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-run-ovn\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-lib-modules\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455749    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-systemd-units\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455749    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-run-systemd\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455780    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-cni-bin\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455794    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-modprobe-d\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.458530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.455894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dce853aa-d400-49b5-8902-cb4bf7e2c732-dbus\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.455963    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.456028    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret podName:dce853aa-d400-49b5-8902-cb4bf7e2c732 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:53.956010442 +0000 UTC m=+3.308286443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret") pod "global-pull-secret-syncer-x296k" (UID: "dce853aa-d400-49b5-8902-cb4bf7e2c732") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.456184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-run-openvswitch\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.456235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-cni-netd\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.456250    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6-serviceca\") pod \"node-ca-zbdf2\" (UID: \"e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6\") " pod="openshift-image-registry/node-ca-zbdf2"
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.456395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-host-kubelet\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.456403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-sysctl-conf\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.456449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-var-lib-kubelet\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.456449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-ovn-node-metrics-cert\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.456495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6-host\") pod \"node-ca-zbdf2\" (UID: \"e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6\") " pod="openshift-image-registry/node-ca-zbdf2"
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.456517    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-sysconfig\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.457055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-ovnkube-config\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.457361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-ovnkube-script-lib\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.459025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0bdca61-4227-4b81-915c-0b12b46806d9-tmp\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.459526 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.459438    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f367069-f513-4d98-8aae-722c4b6dd495-agent-certs\") pod \"konnectivity-agent-gm4w2\" (UID: \"3f367069-f513-4d98-8aae-722c4b6dd495\") " pod="kube-system/konnectivity-agent-gm4w2"
Jul 22 16:22:53.460302 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.460236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d0bdca61-4227-4b81-915c-0b12b46806d9-etc-tuned\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.462308 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.462281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8gd9\" (UniqueName: \"kubernetes.io/projected/29f4bc53-8423-444e-99e2-9a451218fffa-kube-api-access-f8gd9\") pod \"iptables-alerter-jtsgq\" (UID: \"29f4bc53-8423-444e-99e2-9a451218fffa\") " pod="openshift-network-operator/iptables-alerter-jtsgq"
Jul 22 16:22:53.467824 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.467793    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wz48\" (UniqueName: \"kubernetes.io/projected/e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6-kube-api-access-4wz48\") pod \"node-ca-zbdf2\" (UID: \"e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6\") " pod="openshift-image-registry/node-ca-zbdf2"
Jul 22 16:22:53.468977 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.468949    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h22cj\" (UniqueName: \"kubernetes.io/projected/d0bdca61-4227-4b81-915c-0b12b46806d9-kube-api-access-h22cj\") pod \"tuned-dfhbf\" (UID: \"d0bdca61-4227-4b81-915c-0b12b46806d9\") " pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.469408 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.469373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnm5x\" (UniqueName: \"kubernetes.io/projected/5d0dac07-ede3-473b-9ad2-1e0ab68660ca-kube-api-access-lnm5x\") pod \"ovnkube-node-r8kmz\" (UID: \"5d0dac07-ede3-473b-9ad2-1e0ab68660ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.552452 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.552364    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mkxwr"
Jul 22 16:22:53.561445 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.561419    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v"
Jul 22 16:22:53.572280 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.572260    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7q49k"
Jul 22 16:22:53.578969 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.578951    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-65tvf"
Jul 22 16:22:53.588618 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.588598    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jtsgq"
Jul 22 16:22:53.598200 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.598178    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gm4w2"
Jul 22 16:22:53.605805 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.605778    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dfhbf"
Jul 22 16:22:53.619523 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.619503    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zbdf2"
Jul 22 16:22:53.626262 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.626241    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:22:53.859290 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.859184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt8vx\" (UniqueName: \"kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx\") pod \"network-check-target-ls2js\" (UID: \"052c15fe-5980-4085-878c-4d2abaabd167\") " pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:22:53.859290 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.859286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs\") pod \"network-metrics-daemon-r8tkj\" (UID: \"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0\") " pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:22:53.859500 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.859381    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:22:53.859500 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.859400    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:22:53.859500 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.859482    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs podName:6b538e50-43f8-44c8-ab6f-5188c3b0a6d0 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:54.859460207 +0000 UTC m=+4.211736211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs") pod "network-metrics-daemon-r8tkj" (UID: "6b538e50-43f8-44c8-ab6f-5188c3b0a6d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:22:53.859500 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.859403    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:22:53.859656 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.859508    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rt8vx for pod openshift-network-diagnostics/network-check-target-ls2js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:22:53.859656 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.859561    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx podName:052c15fe-5980-4085-878c-4d2abaabd167 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:54.859542459 +0000 UTC m=+4.211818459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rt8vx" (UniqueName: "kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx") pod "network-check-target-ls2js" (UID: "052c15fe-5980-4085-878c-4d2abaabd167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:22:53.960347 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:53.960301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:53.960527 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.960500    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:22:53.960621 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:53.960602    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret podName:dce853aa-d400-49b5-8902-cb4bf7e2c732 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:54.960573918 +0000 UTC m=+4.312849919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret") pod "global-pull-secret-syncer-x296k" (UID: "dce853aa-d400-49b5-8902-cb4bf7e2c732") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:22:54.047199 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:54.047162    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 16:22:54.276819 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:54.276735    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 16:17:54 +0000 UTC" deadline="2028-02-03 15:10:58.208582454 +0000 UTC"
Jul 22 16:22:54.276819 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:54.276763    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13462h48m3.931822543s"
Jul 22 16:22:54.366977 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:54.366950    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:54.367095 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:54.366950    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:22:54.367095 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:54.367067    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:22:54.367230 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:54.367145    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:22:54.367230 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:54.366950    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:22:54.367230 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:54.367223    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:22:54.394143 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:54.394102    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcdfe093_5973_4a2e_a507_e7783f3fc908.slice/crio-95c4dc05b1915e7e2aa03b29979d92561377a65f28e6c65c7db523e530d61714 WatchSource:0}: Error finding container 95c4dc05b1915e7e2aa03b29979d92561377a65f28e6c65c7db523e530d61714: Status 404 returned error can't find the container with id 95c4dc05b1915e7e2aa03b29979d92561377a65f28e6c65c7db523e530d61714
Jul 22 16:22:54.396727 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:54.396699    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd5b8a2_941c_4540_a348_5faea8a1dc5f.slice/crio-245cacd71269a00efd761f67fefd1235b5ce518baab832c96977a4c7f2334ed2 WatchSource:0}: Error finding container 245cacd71269a00efd761f67fefd1235b5ce518baab832c96977a4c7f2334ed2: Status 404 returned error can't find the container with id 245cacd71269a00efd761f67fefd1235b5ce518baab832c96977a4c7f2334ed2
Jul 22 16:22:54.397039 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:54.396980    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f367069_f513_4d98_8aae_722c4b6dd495.slice/crio-ae4fe2549703d3e7dd9a3a3dbbe8df54be836c9ab384db7c5c4058de5f1fdc81 WatchSource:0}: Error finding container ae4fe2549703d3e7dd9a3a3dbbe8df54be836c9ab384db7c5c4058de5f1fdc81: Status 404 returned error can't find the container with id ae4fe2549703d3e7dd9a3a3dbbe8df54be836c9ab384db7c5c4058de5f1fdc81
Jul 22 16:22:54.398140 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:54.398009    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ab3c7a_0c2b_4baf_a92a_c641f928ddd6.slice/crio-9e9c237864f6f060fcbbe9b5007831b6974c677b2e79637e7f5033eefa5fdfbc WatchSource:0}: Error finding container 9e9c237864f6f060fcbbe9b5007831b6974c677b2e79637e7f5033eefa5fdfbc: Status 404 returned error can't find the container with id 9e9c237864f6f060fcbbe9b5007831b6974c677b2e79637e7f5033eefa5fdfbc
Jul 22 16:22:54.401649 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:54.401626    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0bdca61_4227_4b81_915c_0b12b46806d9.slice/crio-094c709c009e5f854507f268eeeffeabdb14494815061fde965f559c87c1774a WatchSource:0}: Error finding container 094c709c009e5f854507f268eeeffeabdb14494815061fde965f559c87c1774a: Status 404 returned error can't find the container with id 094c709c009e5f854507f268eeeffeabdb14494815061fde965f559c87c1774a
Jul 22 16:22:54.402149 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:54.402034    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f4bc53_8423_444e_99e2_9a451218fffa.slice/crio-f9adc83cde4a0e561ff0fb7224771db909cb43e2fc99f543f10b49bd00f9eab3 WatchSource:0}: Error finding container f9adc83cde4a0e561ff0fb7224771db909cb43e2fc99f543f10b49bd00f9eab3: Status 404 returned error can't find the container with id f9adc83cde4a0e561ff0fb7224771db909cb43e2fc99f543f10b49bd00f9eab3
Jul 22 16:22:54.403540 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:54.403514    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57478d6c_8207_4831_ab7d_43c274460043.slice/crio-70539ae25d01dd0fcc717a963e556606714ea8c34b62380bcef63937bfa1dafc WatchSource:0}: Error finding container 70539ae25d01dd0fcc717a963e556606714ea8c34b62380bcef63937bfa1dafc: Status 404 returned error can't find the container with id 70539ae25d01dd0fcc717a963e556606714ea8c34b62380bcef63937bfa1dafc
Jul 22 16:22:54.405378 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:22:54.404675    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbacc9c00_bbc6_4888_90e9_2b579136b810.slice/crio-83da18f0cda4fb4a0d96d94d58d824108fc1cb133a94eb60bb2a5fdb6145c616 WatchSource:0}: Error finding container 83da18f0cda4fb4a0d96d94d58d824108fc1cb133a94eb60bb2a5fdb6145c616: Status 404 returned error can't find the container with id 83da18f0cda4fb4a0d96d94d58d824108fc1cb133a94eb60bb2a5fdb6145c616
Jul 22 16:22:54.869923 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:54.869621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt8vx\" (UniqueName: \"kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx\") pod \"network-check-target-ls2js\" (UID: \"052c15fe-5980-4085-878c-4d2abaabd167\") " pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:22:54.870071 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:54.869946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs\") pod \"network-metrics-daemon-r8tkj\" (UID: \"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0\") " pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:22:54.870071 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:54.869819    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:22:54.870071 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:54.869988    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:22:54.870071 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:54.870004    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rt8vx for pod openshift-network-diagnostics/network-check-target-ls2js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:22:54.870316 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:54.870060    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:22:54.870316 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:54.870089    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx podName:052c15fe-5980-4085-878c-4d2abaabd167 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:56.870067179 +0000 UTC m=+6.222343182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rt8vx" (UniqueName: "kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx") pod "network-check-target-ls2js" (UID: "052c15fe-5980-4085-878c-4d2abaabd167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:22:54.870316 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:54.870131    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs podName:6b538e50-43f8-44c8-ab6f-5188c3b0a6d0 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:56.870114635 +0000 UTC m=+6.222390638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs") pod "network-metrics-daemon-r8tkj" (UID: "6b538e50-43f8-44c8-ab6f-5188c3b0a6d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:22:54.971113 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:54.970489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:54.971113 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:54.970687    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:22:54.971113 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:54.970751    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret podName:dce853aa-d400-49b5-8902-cb4bf7e2c732 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:56.970731652 +0000 UTC m=+6.323007656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret") pod "global-pull-secret-syncer-x296k" (UID: "dce853aa-d400-49b5-8902-cb4bf7e2c732") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:22:55.277880 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.277704    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 16:17:54 +0000 UTC" deadline="2028-02-19 05:08:26.337742777 +0000 UTC"
Jul 22 16:22:55.277880 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.277771    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13836h45m31.059977175s"
Jul 22 16:22:55.391677 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.391637    2580 generic.go:356] "Generic (PLEG): container finished" podID="6f9829d91eb47ddd7a62b2260080095f" containerID="46a0aaf2769f447c034681338d074a9c6a1251a53a69e7c09ad618d6f09b0f93" exitCode=0
Jul 22 16:22:55.391869 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.391740    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal" event={"ID":"6f9829d91eb47ddd7a62b2260080095f","Type":"ContainerDied","Data":"46a0aaf2769f447c034681338d074a9c6a1251a53a69e7c09ad618d6f09b0f93"}
Jul 22 16:22:55.405379 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.405345    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-32.ec2.internal" event={"ID":"6e9fcf95a14b3457c9d6d94083569909","Type":"ContainerStarted","Data":"55a0c689963727e5d46d0f9efccb672e33746d8ee0de8915738a3b7fb267bfc8"}
Jul 22 16:22:55.414773 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.414655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz" event={"ID":"5d0dac07-ede3-473b-9ad2-1e0ab68660ca","Type":"ContainerStarted","Data":"43c5ee18c01150d17bdd249a901b2aa3f66a782d087410208b355e03d28186a5"}
Jul 22 16:22:55.421118 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.421063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jtsgq" event={"ID":"29f4bc53-8423-444e-99e2-9a451218fffa","Type":"ContainerStarted","Data":"f9adc83cde4a0e561ff0fb7224771db909cb43e2fc99f543f10b49bd00f9eab3"}
Jul 22 16:22:55.425843 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.424615    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-32.ec2.internal" podStartSLOduration=2.424595162 podStartE2EDuration="2.424595162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:55.424438397 +0000 UTC m=+4.776714422" watchObservedRunningTime="2026-07-22 16:22:55.424595162 +0000 UTC m=+4.776871187"
Jul 22 16:22:55.432518 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.432432    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dfhbf" event={"ID":"d0bdca61-4227-4b81-915c-0b12b46806d9","Type":"ContainerStarted","Data":"094c709c009e5f854507f268eeeffeabdb14494815061fde965f559c87c1774a"}
Jul 22 16:22:55.444595 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.444502    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gm4w2" event={"ID":"3f367069-f513-4d98-8aae-722c4b6dd495","Type":"ContainerStarted","Data":"ae4fe2549703d3e7dd9a3a3dbbe8df54be836c9ab384db7c5c4058de5f1fdc81"}
Jul 22 16:22:55.456642 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.456602    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v" event={"ID":"bacc9c00-bbc6-4888-90e9-2b579136b810","Type":"ContainerStarted","Data":"83da18f0cda4fb4a0d96d94d58d824108fc1cb133a94eb60bb2a5fdb6145c616"}
Jul 22 16:22:55.458043 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.458013    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mkxwr" event={"ID":"57478d6c-8207-4831-ab7d-43c274460043","Type":"ContainerStarted","Data":"70539ae25d01dd0fcc717a963e556606714ea8c34b62380bcef63937bfa1dafc"}
Jul 22 16:22:55.475243 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.475208    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zbdf2" event={"ID":"e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6","Type":"ContainerStarted","Data":"9e9c237864f6f060fcbbe9b5007831b6974c677b2e79637e7f5033eefa5fdfbc"}
Jul 22 16:22:55.478893 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.478866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-65tvf" event={"ID":"6cd5b8a2-941c-4540-a348-5faea8a1dc5f","Type":"ContainerStarted","Data":"245cacd71269a00efd761f67fefd1235b5ce518baab832c96977a4c7f2334ed2"}
Jul 22 16:22:55.483729 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:55.483625    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q49k" event={"ID":"fcdfe093-5973-4a2e-a507-e7783f3fc908","Type":"ContainerStarted","Data":"95c4dc05b1915e7e2aa03b29979d92561377a65f28e6c65c7db523e530d61714"}
Jul 22 16:22:56.368062 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:56.367202    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:56.368062 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:56.367351    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:22:56.368062 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:56.367750    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:22:56.368062 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:56.367846    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:22:56.368062 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:56.367913    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:22:56.368062 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:56.367998    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:22:56.519506 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:56.519431    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal" event={"ID":"6f9829d91eb47ddd7a62b2260080095f","Type":"ContainerStarted","Data":"eee8b383f7be06f0e91cb4fdde43992e30ed973769fe959bbf614b3829479e9f"}
Jul 22 16:22:56.539638 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:56.539546    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-32.ec2.internal" podStartSLOduration=3.539523655 podStartE2EDuration="3.539523655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:56.538719678 +0000 UTC m=+5.890995703" watchObservedRunningTime="2026-07-22 16:22:56.539523655 +0000 UTC m=+5.891799681"
Jul 22 16:22:56.887220 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:56.887177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs\") pod \"network-metrics-daemon-r8tkj\" (UID: \"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0\") " pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:22:56.887401 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:56.887263    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt8vx\" (UniqueName: \"kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx\") pod \"network-check-target-ls2js\" (UID: \"052c15fe-5980-4085-878c-4d2abaabd167\") " pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:22:56.887477 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:56.887447    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:22:56.887477 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:56.887468    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:22:56.887615 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:56.887482    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rt8vx for pod openshift-network-diagnostics/network-check-target-ls2js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:22:56.887615 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:56.887545    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx podName:052c15fe-5980-4085-878c-4d2abaabd167 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:00.887524372 +0000 UTC m=+10.239800380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rt8vx" (UniqueName: "kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx") pod "network-check-target-ls2js" (UID: "052c15fe-5980-4085-878c-4d2abaabd167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:22:56.888115 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:56.887957    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:22:56.888115 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:56.888018    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs podName:6b538e50-43f8-44c8-ab6f-5188c3b0a6d0 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:00.887999904 +0000 UTC m=+10.240275906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs") pod "network-metrics-daemon-r8tkj" (UID: "6b538e50-43f8-44c8-ab6f-5188c3b0a6d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:22:56.988523 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:56.988475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:56.988733 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:56.988664    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:22:56.988810 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:56.988754    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret podName:dce853aa-d400-49b5-8902-cb4bf7e2c732 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:00.988724903 +0000 UTC m=+10.341000927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret") pod "global-pull-secret-syncer-x296k" (UID: "dce853aa-d400-49b5-8902-cb4bf7e2c732") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:22:58.366559 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:58.366467    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:22:58.366559 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:58.366478    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:22:58.367232 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:58.366646    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:22:58.367232 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:22:58.367052    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:22:58.367232 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:58.367184    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:22:58.367410 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:22:58.367275    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:00.366551 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:00.366519    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:00.367004 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:00.366519    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:00.367004 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:00.366669    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:00.367004 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:00.366774    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:00.367004 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:00.366519    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:00.367004 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:00.366875    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:00.927413 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:00.927374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt8vx\" (UniqueName: \"kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx\") pod \"network-check-target-ls2js\" (UID: \"052c15fe-5980-4085-878c-4d2abaabd167\") " pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:00.927587 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:00.927469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs\") pod \"network-metrics-daemon-r8tkj\" (UID: \"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0\") " pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:00.927654 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:00.927599    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:23:00.927710 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:00.927671    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs podName:6b538e50-43f8-44c8-ab6f-5188c3b0a6d0 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:08.927650044 +0000 UTC m=+18.279926063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs") pod "network-metrics-daemon-r8tkj" (UID: "6b538e50-43f8-44c8-ab6f-5188c3b0a6d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:23:00.928232 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:00.928112    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:23:00.928232 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:00.928138    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:23:00.928232 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:00.928151    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rt8vx for pod openshift-network-diagnostics/network-check-target-ls2js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:23:00.928232 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:00.928199    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx podName:052c15fe-5980-4085-878c-4d2abaabd167 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:08.928183927 +0000 UTC m=+18.280459929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rt8vx" (UniqueName: "kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx") pod "network-check-target-ls2js" (UID: "052c15fe-5980-4085-878c-4d2abaabd167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:23:01.028192 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:01.028146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:01.028380 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:01.028303    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:23:01.028464 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:01.028382    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret podName:dce853aa-d400-49b5-8902-cb4bf7e2c732 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:09.028359084 +0000 UTC m=+18.380635101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret") pod "global-pull-secret-syncer-x296k" (UID: "dce853aa-d400-49b5-8902-cb4bf7e2c732") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:23:02.366647 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:02.366610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:02.367153 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:02.366663    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:02.367153 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:02.366756    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:02.367153 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:02.366820    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:02.367153 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:02.366887    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:02.367153 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:02.366974    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:04.367225 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:04.367187    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:04.367225 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:04.367226    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:04.367869 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:04.367229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:04.367869 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:04.367319    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:04.367869 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:04.367427    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:04.367869 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:04.367531    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:06.366747 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:06.366659    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:06.366747 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:06.366703    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:06.366747 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:06.366698    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:06.367248 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:06.366808    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:06.367248 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:06.366912    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:06.367248 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:06.367002    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:08.367082 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:08.367044    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:08.367082 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:08.367081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:08.367626 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:08.367094    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:08.367626 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:08.367185    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:08.367626 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:08.367231    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:08.367626 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:08.367316    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:08.990333 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:08.990292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs\") pod \"network-metrics-daemon-r8tkj\" (UID: \"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0\") " pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:08.990547 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:08.990355    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt8vx\" (UniqueName: \"kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx\") pod \"network-check-target-ls2js\" (UID: \"052c15fe-5980-4085-878c-4d2abaabd167\") " pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:08.990547 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:08.990467    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:23:08.990649 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:08.990550    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs podName:6b538e50-43f8-44c8-ab6f-5188c3b0a6d0 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:24.990526157 +0000 UTC m=+34.342802158 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs") pod "network-metrics-daemon-r8tkj" (UID: "6b538e50-43f8-44c8-ab6f-5188c3b0a6d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:23:08.990649 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:08.990478    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:23:08.990649 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:08.990586    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:23:08.990649 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:08.990602    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rt8vx for pod openshift-network-diagnostics/network-check-target-ls2js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:23:08.990649 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:08.990646    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx podName:052c15fe-5980-4085-878c-4d2abaabd167 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:24.990634749 +0000 UTC m=+34.342910766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rt8vx" (UniqueName: "kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx") pod "network-check-target-ls2js" (UID: "052c15fe-5980-4085-878c-4d2abaabd167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:23:09.090900 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:09.090862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:09.091090 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:09.091031    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:23:09.091148 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:09.091105    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret podName:dce853aa-d400-49b5-8902-cb4bf7e2c732 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:25.091089891 +0000 UTC m=+34.443365891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret") pod "global-pull-secret-syncer-x296k" (UID: "dce853aa-d400-49b5-8902-cb4bf7e2c732") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:23:10.367153 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:10.367119    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:10.367577 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:10.367119    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:10.367577 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:10.367247    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:10.367577 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:10.367122    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:10.367577 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:10.367344    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:10.367577 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:10.367408    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:12.367135 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:12.367094    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:12.367135 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:12.367136    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:12.367634 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:12.367136    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:12.367634 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:12.367227    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:12.367634 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:12.367308    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:12.367634 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:12.367402    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:14.368271 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.367842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:14.368271 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:14.368184    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:14.368271 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.367897    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:14.368271 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.367855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:14.369141 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:14.368274    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:14.369141 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:14.368371    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:14.568377 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.568344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz" event={"ID":"5d0dac07-ede3-473b-9ad2-1e0ab68660ca","Type":"ContainerStarted","Data":"33734b601da4acc7ba3ad3307037f7606d8170427b6c686696ff2bde02500478"}
Jul 22 16:23:14.568503 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.568435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz" event={"ID":"5d0dac07-ede3-473b-9ad2-1e0ab68660ca","Type":"ContainerStarted","Data":"1a86e154b43f40035a1f1c4bf2ab4f59ac0b54f483405f561f718eedb4c4f327"}
Jul 22 16:23:14.568503 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.568494    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz" event={"ID":"5d0dac07-ede3-473b-9ad2-1e0ab68660ca","Type":"ContainerStarted","Data":"f7bda1f4c4dd5d1c20fce6627431957d5e8494f985c1ec2ba37e5449db949999"}
Jul 22 16:23:14.568622 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.568545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz" event={"ID":"5d0dac07-ede3-473b-9ad2-1e0ab68660ca","Type":"ContainerStarted","Data":"199e5ebc3f815e35aea15d5440c1d03fd03fdc82badb4d273bc948bfb803f68e"}
Jul 22 16:23:14.568622 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.568591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz" event={"ID":"5d0dac07-ede3-473b-9ad2-1e0ab68660ca","Type":"ContainerStarted","Data":"2611ba9ba459451c754815a6562c84898301bb528f02a2e7f3cb348dcb582158"}
Jul 22 16:23:14.570244 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.570174    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dfhbf" event={"ID":"d0bdca61-4227-4b81-915c-0b12b46806d9","Type":"ContainerStarted","Data":"95fc94fc13639ab55da18a6a5e16ccb883e6a1d54d522d4c7e4179c9b7941fc6"}
Jul 22 16:23:14.571760 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.571729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gm4w2" event={"ID":"3f367069-f513-4d98-8aae-722c4b6dd495","Type":"ContainerStarted","Data":"28a31238db2773e65614dbf9bdbb25776509ddb0f283fd688e985db89a609aab"}
Jul 22 16:23:14.573491 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.573468    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v" event={"ID":"bacc9c00-bbc6-4888-90e9-2b579136b810","Type":"ContainerStarted","Data":"2449ee727a83738b93eb52ef4318dd53934543dab8b592885dc1683c09835af6"}
Jul 22 16:23:14.575483 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.575230    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mkxwr" event={"ID":"57478d6c-8207-4831-ab7d-43c274460043","Type":"ContainerStarted","Data":"f6803ba61c9c716b8c50e786c5f1c4ea192f874b4d58976173413f03aaae3526"}
Jul 22 16:23:14.576980 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.576957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zbdf2" event={"ID":"e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6","Type":"ContainerStarted","Data":"775032035bf15d3d24b4ec1fb4a35b50f8b9e100a71b77aeba72ccb9ccf8f265"}
Jul 22 16:23:14.578592 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.578561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-65tvf" event={"ID":"6cd5b8a2-941c-4540-a348-5faea8a1dc5f","Type":"ContainerStarted","Data":"e85c4f6990bf5eb5f7497add894a7c9d450cd59a017ba3e6a0b678a6b53b8b7b"}
Jul 22 16:23:14.580273 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.580249    2580 generic.go:356] "Generic (PLEG): container finished" podID="fcdfe093-5973-4a2e-a507-e7783f3fc908" containerID="9c1a896b2d0b544d4d7df1df368d1c76de5218b715548bfed49bee6f6b6d95fa" exitCode=0
Jul 22 16:23:14.580364 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.580290    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q49k" event={"ID":"fcdfe093-5973-4a2e-a507-e7783f3fc908","Type":"ContainerDied","Data":"9c1a896b2d0b544d4d7df1df368d1c76de5218b715548bfed49bee6f6b6d95fa"}
Jul 22 16:23:14.587445 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.587400    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dfhbf" podStartSLOduration=3.040439625 podStartE2EDuration="22.587383655s" totalImagesPullingTime="19.54694403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:14.586962488 +0000 UTC m=+23.939238508" watchObservedRunningTime="2026-07-22 16:23:14.587383655 +0000 UTC m=+23.939659677"
Jul 22 16:23:14.600576 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.600529    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gm4w2" podStartSLOduration=7.199987612 podStartE2EDuration="22.60051297s" totalImagesPullingTime="15.400525358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:14.600436474 +0000 UTC m=+23.952712494" watchObservedRunningTime="2026-07-22 16:23:14.60051297 +0000 UTC m=+23.952788991"
Jul 22 16:23:14.617124 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.617077    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mkxwr" podStartSLOduration=3.034316618 podStartE2EDuration="22.617055472s" totalImagesPullingTime="19.582738854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:14.616393877 +0000 UTC m=+23.968669896" watchObservedRunningTime="2026-07-22 16:23:14.617055472 +0000 UTC m=+23.969331493"
Jul 22 16:23:14.632681 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.632047    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-65tvf" podStartSLOduration=3.0980222729999998 podStartE2EDuration="22.632028877s" totalImagesPullingTime="19.534006604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:14.631095531 +0000 UTC m=+23.983371551" watchObservedRunningTime="2026-07-22 16:23:14.632028877 +0000 UTC m=+23.984304892"
Jul 22 16:23:14.670871 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:14.670824    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zbdf2" podStartSLOduration=3.139089567 podStartE2EDuration="22.670810142s" totalImagesPullingTime="19.531720575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:14.67041053 +0000 UTC m=+24.022686606" watchObservedRunningTime="2026-07-22 16:23:14.670810142 +0000 UTC m=+24.023086161"
Jul 22 16:23:15.354947 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:15.354921    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 16:23:15.585409 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:15.585321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v" event={"ID":"bacc9c00-bbc6-4888-90e9-2b579136b810","Type":"ContainerStarted","Data":"21bc72b1dcd82df537f335f03d6dea1a3822c5f8e34fe9c921b48e740718bd8d"}
Jul 22 16:23:15.588711 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:15.588686    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz" event={"ID":"5d0dac07-ede3-473b-9ad2-1e0ab68660ca","Type":"ContainerStarted","Data":"3470b7a834fc3df189e7169061d72a2878d6170664764008baf7a9b50a1370eb"}
Jul 22 16:23:15.590422 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:15.590397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jtsgq" event={"ID":"29f4bc53-8423-444e-99e2-9a451218fffa","Type":"ContainerStarted","Data":"658b947863c125957f3d8da58da2fd8dc460ff8a0e1f4af22e5f20ce6ba64f5d"}
Jul 22 16:23:15.604950 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:15.604900    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jtsgq" podStartSLOduration=4.08135851 podStartE2EDuration="23.604884477s" totalImagesPullingTime="19.523525967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:15.604760647 +0000 UTC m=+24.957036668" watchObservedRunningTime="2026-07-22 16:23:15.604884477 +0000 UTC m=+24.957160496"
Jul 22 16:23:16.314620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:16.314518    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T16:23:15.354942919Z","UUID":"bd4c0446-5a18-4162-9ecb-a81625f7a89d","Handler":null,"Name":"","Endpoint":""}
Jul 22 16:23:16.316092 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:16.316071    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 16:23:16.316235 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:16.316106    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 16:23:16.367228 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:16.367202    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:16.367228 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:16.367217    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:16.367458 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:16.367208    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:16.367458 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:16.367298    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:16.367458 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:16.367405    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:16.368325 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:16.367499    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:17.597114 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:17.596829    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v" event={"ID":"bacc9c00-bbc6-4888-90e9-2b579136b810","Type":"ContainerStarted","Data":"cdc4830d7096858865efab5d865bd43d3c26f23ea739d8c70f2c1bcbc943d799"}
Jul 22 16:23:17.600625 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:17.600598    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz" event={"ID":"5d0dac07-ede3-473b-9ad2-1e0ab68660ca","Type":"ContainerStarted","Data":"10492947558ec058bfa11d93202f5c721a5ae2ae7419d44d0ac4b26c2c3662d7"}
Jul 22 16:23:17.615620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:17.615571    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj84v" podStartSLOduration=3.80812471 podStartE2EDuration="25.61555335s" totalImagesPullingTime="21.80742864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:17.614490176 +0000 UTC m=+26.966766196" watchObservedRunningTime="2026-07-22 16:23:17.61555335 +0000 UTC m=+26.967829371"
Jul 22 16:23:18.366277 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:18.366243    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:18.366277 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:18.366278    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:18.366539 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:18.366292    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:18.366539 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:18.366361    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:18.366539 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:18.366415    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:18.366666 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:18.366554    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:19.073310 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:19.073172    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gm4w2"
Jul 22 16:23:19.074002 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:19.073950    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gm4w2"
Jul 22 16:23:19.611131 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:19.611088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz" event={"ID":"5d0dac07-ede3-473b-9ad2-1e0ab68660ca","Type":"ContainerStarted","Data":"a76802a242b4cc0da15ea6b7541da95ca09ae1e34c141014ad8341fbbf5491dd"}
Jul 22 16:23:19.611417 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:19.611305    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:23:19.612886 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:19.612865    2580 generic.go:356] "Generic (PLEG): container finished" podID="fcdfe093-5973-4a2e-a507-e7783f3fc908" containerID="41013171d7c56af2707bce2ead3a4442cc50213b70ccb795ed5c3382e8ffd157" exitCode=0
Jul 22 16:23:19.613002 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:19.612938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q49k" event={"ID":"fcdfe093-5973-4a2e-a507-e7783f3fc908","Type":"ContainerDied","Data":"41013171d7c56af2707bce2ead3a4442cc50213b70ccb795ed5c3382e8ffd157"}
Jul 22 16:23:19.627172 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:19.627154    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:23:19.638377 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:19.638336    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz" podStartSLOduration=8.041096362 podStartE2EDuration="27.638322727s" totalImagesPullingTime="19.597226365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:19.637103818 +0000 UTC m=+28.989379837" watchObservedRunningTime="2026-07-22 16:23:19.638322727 +0000 UTC m=+28.990598744"
Jul 22 16:23:20.367385 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:20.367350    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:20.367993 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:20.367350    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:20.367993 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:20.367487    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:20.367993 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:20.367508    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:20.367993 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:20.367613    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:20.367993 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:20.367701    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:20.614692 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:20.614667    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 22 16:23:20.615121 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:20.615091    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:23:20.630049 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:20.629956    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:23:20.804166 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:20.804140    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-65tvf_6cd5b8a2-941c-4540-a348-5faea8a1dc5f/dns-node-resolver/0.log"
Jul 22 16:23:21.170113 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:21.170073    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ls2js"]
Jul 22 16:23:21.170621 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:21.170597    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:21.170764 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:21.170595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r8tkj"]
Jul 22 16:23:21.170764 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:21.170722    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:21.170876 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:21.170838    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:21.170965 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:21.170939    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:21.171440 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:21.171418    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x296k"]
Jul 22 16:23:21.171529 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:21.171516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:21.171632 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:21.171609    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:21.618631 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:21.618599    2580 generic.go:356] "Generic (PLEG): container finished" podID="fcdfe093-5973-4a2e-a507-e7783f3fc908" containerID="c10e98b7c83f9167e10a3f05ad18bb93f02d99c89d9b77338cd450ce23fac9d6" exitCode=0
Jul 22 16:23:21.619044 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:21.618688    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q49k" event={"ID":"fcdfe093-5973-4a2e-a507-e7783f3fc908","Type":"ContainerDied","Data":"c10e98b7c83f9167e10a3f05ad18bb93f02d99c89d9b77338cd450ce23fac9d6"}
Jul 22 16:23:21.619044 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:21.618851    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 22 16:23:22.184520 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:22.184494    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zbdf2_e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6/node-ca/0.log"
Jul 22 16:23:22.232302 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:22.232270    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:23:22.366681 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:22.366648    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:22.366838 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:22.366660    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:22.366838 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:22.366774    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:22.366968 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:22.366862    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:22.450143 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:22.450066    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gm4w2"
Jul 22 16:23:22.450297 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:22.450195    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 22 16:23:22.451359 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:22.451338    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gm4w2"
Jul 22 16:23:23.367210 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:23.367138    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:23.367629 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:23.367291    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:23.626825 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:23.626733    2580 generic.go:356] "Generic (PLEG): container finished" podID="fcdfe093-5973-4a2e-a507-e7783f3fc908" containerID="7010b3e0330afa7fc0d14a39b8cd168378fbe40d8f9b3f3663424a2d8bcec092" exitCode=0
Jul 22 16:23:23.626825 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:23.626799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q49k" event={"ID":"fcdfe093-5973-4a2e-a507-e7783f3fc908","Type":"ContainerDied","Data":"7010b3e0330afa7fc0d14a39b8cd168378fbe40d8f9b3f3663424a2d8bcec092"}
Jul 22 16:23:23.639659 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:23.639619    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz" podUID="5d0dac07-ede3-473b-9ad2-1e0ab68660ca" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 22 16:23:24.367328 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:24.367291    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:24.367878 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:24.367416    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:24.367878 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:24.367447    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:24.367878 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:24.367569    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:25.018508 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:25.018473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt8vx\" (UniqueName: \"kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx\") pod \"network-check-target-ls2js\" (UID: \"052c15fe-5980-4085-878c-4d2abaabd167\") " pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:25.018690 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:25.018538    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs\") pod \"network-metrics-daemon-r8tkj\" (UID: \"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0\") " pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:25.018690 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:25.018660    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:23:25.018774 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:25.018731    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs podName:6b538e50-43f8-44c8-ab6f-5188c3b0a6d0 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:57.018711522 +0000 UTC m=+66.370987523 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs") pod "network-metrics-daemon-r8tkj" (UID: "6b538e50-43f8-44c8-ab6f-5188c3b0a6d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:23:25.018774 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:25.018662    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:23:25.018872 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:25.018776    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:23:25.018872 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:25.018793    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rt8vx for pod openshift-network-diagnostics/network-check-target-ls2js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:23:25.018872 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:25.018850    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx podName:052c15fe-5980-4085-878c-4d2abaabd167 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:57.018833631 +0000 UTC m=+66.371109631 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rt8vx" (UniqueName: "kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx") pod "network-check-target-ls2js" (UID: "052c15fe-5980-4085-878c-4d2abaabd167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:23:25.119682 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:25.119649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:25.119849 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:25.119773    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:23:25.119849 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:25.119830    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret podName:dce853aa-d400-49b5-8902-cb4bf7e2c732 nodeName:}" failed. No retries permitted until 2026-07-22 16:23:57.119815744 +0000 UTC m=+66.472091741 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret") pod "global-pull-secret-syncer-x296k" (UID: "dce853aa-d400-49b5-8902-cb4bf7e2c732") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:23:25.366408 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:25.366325    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:25.366547 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:25.366473    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:26.366448 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:26.366407    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:26.366883 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:26.366407    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:26.366883 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:26.366562    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:26.366883 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:26.366642    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:27.366623 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:27.366589    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:27.367188 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:27.366710    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:27.639487 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:27.639454    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q49k" event={"ID":"fcdfe093-5973-4a2e-a507-e7783f3fc908","Type":"ContainerStarted","Data":"bc4d84c17b24f04a6fcae5530f2a6695256eedaad3f9c64f6f1af139748ded3e"}
Jul 22 16:23:28.366273 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:28.366237    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:28.366471 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:28.366245    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:28.366471 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:28.366360    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:28.366471 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:28.366419    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:28.644594 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:28.644560    2580 generic.go:356] "Generic (PLEG): container finished" podID="fcdfe093-5973-4a2e-a507-e7783f3fc908" containerID="bc4d84c17b24f04a6fcae5530f2a6695256eedaad3f9c64f6f1af139748ded3e" exitCode=0
Jul 22 16:23:28.644994 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:28.644622    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q49k" event={"ID":"fcdfe093-5973-4a2e-a507-e7783f3fc908","Type":"ContainerDied","Data":"bc4d84c17b24f04a6fcae5530f2a6695256eedaad3f9c64f6f1af139748ded3e"}
Jul 22 16:23:29.367007 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:29.366974    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:29.367175 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:29.367107    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:29.649590 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:29.649552    2580 generic.go:356] "Generic (PLEG): container finished" podID="fcdfe093-5973-4a2e-a507-e7783f3fc908" containerID="cb9614592aa3fd85c674b240b306fd9b8a7fed8512b5b4604d42c928335ff5b3" exitCode=0
Jul 22 16:23:29.650065 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:29.649618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q49k" event={"ID":"fcdfe093-5973-4a2e-a507-e7783f3fc908","Type":"ContainerDied","Data":"cb9614592aa3fd85c674b240b306fd9b8a7fed8512b5b4604d42c928335ff5b3"}
Jul 22 16:23:30.366908 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:30.366725    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:30.367090 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:30.366732    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:30.367090 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:30.366972    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:30.367175 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:30.367091    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:30.656421 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:30.656392    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q49k" event={"ID":"fcdfe093-5973-4a2e-a507-e7783f3fc908","Type":"ContainerStarted","Data":"037672f49425064924efe25ef7574552ae54f0e9d34042b5476d72fb8f236258"}
Jul 22 16:23:30.679278 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:30.679236    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7q49k" podStartSLOduration=8.814328052 podStartE2EDuration="38.679221494s" totalImagesPullingTime="29.864893442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:30.678763818 +0000 UTC m=+40.031039850" watchObservedRunningTime="2026-07-22 16:23:30.679221494 +0000 UTC m=+40.031497514"
Jul 22 16:23:31.367086 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:31.367059    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:31.367268 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:31.367135    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:32.367172 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:32.367142    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:32.367539 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:32.367150    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:32.367539 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:32.367239    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:32.367539 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:32.367332    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:33.367099 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:33.367061    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:33.367297 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:33.367193    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:34.366409 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:34.366376    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:34.366409 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:34.366411    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:34.366592 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:34.366490    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:34.366647 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:34.366622    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:35.366467 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:35.366440    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:35.366832 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:35.366539    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:36.366529 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:36.366495    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:36.366898 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:36.366505    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:36.366898 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:36.366594    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:36.366898 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:36.366677    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:37.366847 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:37.366818    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:37.367325 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:37.366909    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:38.366636 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:38.366607    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:38.366801 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:38.366610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:38.366801 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:38.366697    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:38.366801 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:38.366778    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:39.366935 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:39.366904    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:39.367369 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:39.367039    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:40.366384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:40.366351    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:40.366540 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:40.366351    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:40.366540 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:40.366480    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x296k" podUID="dce853aa-d400-49b5-8902-cb4bf7e2c732"
Jul 22 16:23:40.366540 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:40.366531    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8tkj" podUID="6b538e50-43f8-44c8-ab6f-5188c3b0a6d0"
Jul 22 16:23:41.367613 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:41.367581    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:41.368001 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:41.367709    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2js" podUID="052c15fe-5980-4085-878c-4d2abaabd167"
Jul 22 16:23:41.903602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:41.903577    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-32.ec2.internal" event="NodeReady"
Jul 22 16:23:41.903755 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:41.903705    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 16:23:41.991074 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:41.991044    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5bb8q"]
Jul 22 16:23:42.008258 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.008232    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mtv44"]
Jul 22 16:23:42.008385 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.008349    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5bb8q"
Jul 22 16:23:42.011485 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.011460    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 16:23:42.011606 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.011489    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8zl58\""
Jul 22 16:23:42.011606 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.011506    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 16:23:42.011844 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.011802    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 16:23:42.019740 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.019718    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5bb8q"]
Jul 22 16:23:42.019841 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.019823    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.025000 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.024957    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 16:23:42.025142 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.025058    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 16:23:42.025142 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.025081    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 16:23:42.025142 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.025104    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qp2c5\""
Jul 22 16:23:42.025428 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.025276    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 16:23:42.032221 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.032204    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mtv44"]
Jul 22 16:23:42.053702 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.053673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a425a4f-8adf-4012-95c7-580429622b1d-data-volume\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.053702 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.053710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a425a4f-8adf-4012-95c7-580429622b1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.053868 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.053730    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f5cfb28-29dd-42d3-8eba-1154596ddbe7-cert\") pod \"ingress-canary-5bb8q\" (UID: \"5f5cfb28-29dd-42d3-8eba-1154596ddbe7\") " pod="openshift-ingress-canary/ingress-canary-5bb8q"
Jul 22 16:23:42.053868 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.053771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhmvq\" (UniqueName: \"kubernetes.io/projected/8a425a4f-8adf-4012-95c7-580429622b1d-kube-api-access-mhmvq\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.053868 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.053804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfmt7\" (UniqueName: \"kubernetes.io/projected/5f5cfb28-29dd-42d3-8eba-1154596ddbe7-kube-api-access-pfmt7\") pod \"ingress-canary-5bb8q\" (UID: \"5f5cfb28-29dd-42d3-8eba-1154596ddbe7\") " pod="openshift-ingress-canary/ingress-canary-5bb8q"
Jul 22 16:23:42.053962 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.053877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a425a4f-8adf-4012-95c7-580429622b1d-crio-socket\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.054007 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.053955    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a425a4f-8adf-4012-95c7-580429622b1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.082627 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.082609    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k7qtt"]
Jul 22 16:23:42.106074 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.106047    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k7qtt"]
Jul 22 16:23:42.106183 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.106170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.109199 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.109183    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 16:23:42.109284 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.109186    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cfcr6\""
Jul 22 16:23:42.109539 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.109524    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 16:23:42.154359 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.154295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a425a4f-8adf-4012-95c7-580429622b1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.154359 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.154328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce82ee36-977e-423a-9e0f-25d0359aaf21-metrics-tls\") pod \"dns-default-k7qtt\" (UID: \"ce82ee36-977e-423a-9e0f-25d0359aaf21\") " pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.154535 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.154372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a425a4f-8adf-4012-95c7-580429622b1d-data-volume\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.154535 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.154392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a425a4f-8adf-4012-95c7-580429622b1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.154535 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.154408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f5cfb28-29dd-42d3-8eba-1154596ddbe7-cert\") pod \"ingress-canary-5bb8q\" (UID: \"5f5cfb28-29dd-42d3-8eba-1154596ddbe7\") " pod="openshift-ingress-canary/ingress-canary-5bb8q"
Jul 22 16:23:42.154535 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.154430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhmvq\" (UniqueName: \"kubernetes.io/projected/8a425a4f-8adf-4012-95c7-580429622b1d-kube-api-access-mhmvq\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.154535 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.154455    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmt7\" (UniqueName: \"kubernetes.io/projected/5f5cfb28-29dd-42d3-8eba-1154596ddbe7-kube-api-access-pfmt7\") pod \"ingress-canary-5bb8q\" (UID: \"5f5cfb28-29dd-42d3-8eba-1154596ddbe7\") " pod="openshift-ingress-canary/ingress-canary-5bb8q"
Jul 22 16:23:42.154774 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.154585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce82ee36-977e-423a-9e0f-25d0359aaf21-config-volume\") pod \"dns-default-k7qtt\" (UID: \"ce82ee36-977e-423a-9e0f-25d0359aaf21\") " pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.154774 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.154646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt7ws\" (UniqueName: \"kubernetes.io/projected/ce82ee36-977e-423a-9e0f-25d0359aaf21-kube-api-access-vt7ws\") pod \"dns-default-k7qtt\" (UID: \"ce82ee36-977e-423a-9e0f-25d0359aaf21\") " pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.154774 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.154715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a425a4f-8adf-4012-95c7-580429622b1d-crio-socket\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.154774 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.154743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce82ee36-977e-423a-9e0f-25d0359aaf21-tmp-dir\") pod \"dns-default-k7qtt\" (UID: \"ce82ee36-977e-423a-9e0f-25d0359aaf21\") " pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.154774 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.154768    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8a425a4f-8adf-4012-95c7-580429622b1d-data-volume\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.155015 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.154880    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8a425a4f-8adf-4012-95c7-580429622b1d-crio-socket\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.155169 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.155149    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8a425a4f-8adf-4012-95c7-580429622b1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.158361 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.158343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8a425a4f-8adf-4012-95c7-580429622b1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.158520 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.158504    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f5cfb28-29dd-42d3-8eba-1154596ddbe7-cert\") pod \"ingress-canary-5bb8q\" (UID: \"5f5cfb28-29dd-42d3-8eba-1154596ddbe7\") " pod="openshift-ingress-canary/ingress-canary-5bb8q"
Jul 22 16:23:42.164140 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.164119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhmvq\" (UniqueName: \"kubernetes.io/projected/8a425a4f-8adf-4012-95c7-580429622b1d-kube-api-access-mhmvq\") pod \"insights-runtime-extractor-mtv44\" (UID: \"8a425a4f-8adf-4012-95c7-580429622b1d\") " pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.164514 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.164498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfmt7\" (UniqueName: \"kubernetes.io/projected/5f5cfb28-29dd-42d3-8eba-1154596ddbe7-kube-api-access-pfmt7\") pod \"ingress-canary-5bb8q\" (UID: \"5f5cfb28-29dd-42d3-8eba-1154596ddbe7\") " pod="openshift-ingress-canary/ingress-canary-5bb8q"
Jul 22 16:23:42.255836 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.255808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce82ee36-977e-423a-9e0f-25d0359aaf21-config-volume\") pod \"dns-default-k7qtt\" (UID: \"ce82ee36-977e-423a-9e0f-25d0359aaf21\") " pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.255836 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.255838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt7ws\" (UniqueName: \"kubernetes.io/projected/ce82ee36-977e-423a-9e0f-25d0359aaf21-kube-api-access-vt7ws\") pod \"dns-default-k7qtt\" (UID: \"ce82ee36-977e-423a-9e0f-25d0359aaf21\") " pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.255996 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.255878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce82ee36-977e-423a-9e0f-25d0359aaf21-tmp-dir\") pod \"dns-default-k7qtt\" (UID: \"ce82ee36-977e-423a-9e0f-25d0359aaf21\") " pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.255996 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.255927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce82ee36-977e-423a-9e0f-25d0359aaf21-metrics-tls\") pod \"dns-default-k7qtt\" (UID: \"ce82ee36-977e-423a-9e0f-25d0359aaf21\") " pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.256257 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.256240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce82ee36-977e-423a-9e0f-25d0359aaf21-tmp-dir\") pod \"dns-default-k7qtt\" (UID: \"ce82ee36-977e-423a-9e0f-25d0359aaf21\") " pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.256448 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.256430    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce82ee36-977e-423a-9e0f-25d0359aaf21-config-volume\") pod \"dns-default-k7qtt\" (UID: \"ce82ee36-977e-423a-9e0f-25d0359aaf21\") " pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.258089 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.258073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce82ee36-977e-423a-9e0f-25d0359aaf21-metrics-tls\") pod \"dns-default-k7qtt\" (UID: \"ce82ee36-977e-423a-9e0f-25d0359aaf21\") " pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.270048 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.270011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt7ws\" (UniqueName: \"kubernetes.io/projected/ce82ee36-977e-423a-9e0f-25d0359aaf21-kube-api-access-vt7ws\") pod \"dns-default-k7qtt\" (UID: \"ce82ee36-977e-423a-9e0f-25d0359aaf21\") " pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.318783 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.318745    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5bb8q"
Jul 22 16:23:42.327895 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.327873    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mtv44"
Jul 22 16:23:42.366778 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.366753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:42.366939 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.366919    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:42.373982 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.373960    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vhlm5\""
Jul 22 16:23:42.374909 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.374847    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 16:23:42.375139 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.375120    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 16:23:42.414670 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.414597    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:42.560991 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.560961    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5bb8q"]
Jul 22 16:23:42.564686 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:23:42.564660    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5cfb28_29dd_42d3_8eba_1154596ddbe7.slice/crio-27386abc57666e3925b7ff7d0a84838aa5d4710e2d7f7bb41e054f85f6ec42c7 WatchSource:0}: Error finding container 27386abc57666e3925b7ff7d0a84838aa5d4710e2d7f7bb41e054f85f6ec42c7: Status 404 returned error can't find the container with id 27386abc57666e3925b7ff7d0a84838aa5d4710e2d7f7bb41e054f85f6ec42c7
Jul 22 16:23:42.569221 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.569178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mtv44"]
Jul 22 16:23:42.574967 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:23:42.574948    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a425a4f_8adf_4012_95c7_580429622b1d.slice/crio-57d92239ddefe884442226b6bd674484c01dee2b87d7e64d519f0dee28b9733c WatchSource:0}: Error finding container 57d92239ddefe884442226b6bd674484c01dee2b87d7e64d519f0dee28b9733c: Status 404 returned error can't find the container with id 57d92239ddefe884442226b6bd674484c01dee2b87d7e64d519f0dee28b9733c
Jul 22 16:23:42.584640 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.584619    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k7qtt"]
Jul 22 16:23:42.587653 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:23:42.587631    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce82ee36_977e_423a_9e0f_25d0359aaf21.slice/crio-6dd25f56a5d570d71f781ac59b72127dbde1a3334dd832a935b0a6fc9ebc2dcc WatchSource:0}: Error finding container 6dd25f56a5d570d71f781ac59b72127dbde1a3334dd832a935b0a6fc9ebc2dcc: Status 404 returned error can't find the container with id 6dd25f56a5d570d71f781ac59b72127dbde1a3334dd832a935b0a6fc9ebc2dcc
Jul 22 16:23:42.683198 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.683120    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k7qtt" event={"ID":"ce82ee36-977e-423a-9e0f-25d0359aaf21","Type":"ContainerStarted","Data":"6dd25f56a5d570d71f781ac59b72127dbde1a3334dd832a935b0a6fc9ebc2dcc"}
Jul 22 16:23:42.684286 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.684262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mtv44" event={"ID":"8a425a4f-8adf-4012-95c7-580429622b1d","Type":"ContainerStarted","Data":"57d92239ddefe884442226b6bd674484c01dee2b87d7e64d519f0dee28b9733c"}
Jul 22 16:23:42.685363 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:42.685342    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5bb8q" event={"ID":"5f5cfb28-29dd-42d3-8eba-1154596ddbe7","Type":"ContainerStarted","Data":"27386abc57666e3925b7ff7d0a84838aa5d4710e2d7f7bb41e054f85f6ec42c7"}
Jul 22 16:23:43.366457 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:43.366424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:43.371759 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:43.370893    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 16:23:43.371759 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:43.371247    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 16:23:43.371759 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:43.371568    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h7v2l\""
Jul 22 16:23:49.705384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:49.705345    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k7qtt" event={"ID":"ce82ee36-977e-423a-9e0f-25d0359aaf21","Type":"ContainerStarted","Data":"5694e1fc18e01fbd48ff609362a198f79b0ef7b19160f54dfaf871e838e31e38"}
Jul 22 16:23:49.706751 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:49.706726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5bb8q" event={"ID":"5f5cfb28-29dd-42d3-8eba-1154596ddbe7","Type":"ContainerStarted","Data":"6c72e9100b8984a970863ad7c800a289bc9c880480e3482402ed108d9f1b3d4e"}
Jul 22 16:23:49.725744 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:49.725687    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5bb8q" podStartSLOduration=1.7969532529999999 podStartE2EDuration="8.7256696s" totalImagesPullingTime="6.928716347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:49.724825765 +0000 UTC m=+59.077101779" watchObservedRunningTime="2026-07-22 16:23:49.7256696 +0000 UTC m=+59.077945624"
Jul 22 16:23:49.946465 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:49.946424    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4dfkr"]
Jul 22 16:23:49.961564 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:49.961538    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4dfkr"]
Jul 22 16:23:49.961693 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:49.961620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4dfkr"
Jul 22 16:23:49.963987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:49.963966    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 22 16:23:49.964163 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:49.964145    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jlmlh\""
Jul 22 16:23:50.023737 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:50.023661    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae1613d5-4a55-4aac-8fc1-3723fd760a24-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-4dfkr\" (UID: \"ae1613d5-4a55-4aac-8fc1-3723fd760a24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4dfkr"
Jul 22 16:23:50.124948 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:50.124917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae1613d5-4a55-4aac-8fc1-3723fd760a24-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-4dfkr\" (UID: \"ae1613d5-4a55-4aac-8fc1-3723fd760a24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4dfkr"
Jul 22 16:23:50.127404 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:50.127380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae1613d5-4a55-4aac-8fc1-3723fd760a24-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-4dfkr\" (UID: \"ae1613d5-4a55-4aac-8fc1-3723fd760a24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4dfkr"
Jul 22 16:23:50.270435 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:50.270398    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4dfkr"
Jul 22 16:23:50.392323 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:50.392293    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4dfkr"]
Jul 22 16:23:50.395409 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:23:50.395383    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1613d5_4a55_4aac_8fc1_3723fd760a24.slice/crio-23c2898029b348626e5d93aedaf64d7f73c022cd500bb101029d945938e6db55 WatchSource:0}: Error finding container 23c2898029b348626e5d93aedaf64d7f73c022cd500bb101029d945938e6db55: Status 404 returned error can't find the container with id 23c2898029b348626e5d93aedaf64d7f73c022cd500bb101029d945938e6db55
Jul 22 16:23:50.713218 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:50.713180    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k7qtt" event={"ID":"ce82ee36-977e-423a-9e0f-25d0359aaf21","Type":"ContainerStarted","Data":"bfb693fd4a7952164b88f5c4c09e1e4e99c1b1cddbf6936a52266836ab0b7ad6"}
Jul 22 16:23:50.713715 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:50.713324    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:23:50.715377 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:50.715347    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mtv44" event={"ID":"8a425a4f-8adf-4012-95c7-580429622b1d","Type":"ContainerStarted","Data":"219ac71a213d379142af8882645442f14b77fbe4ff265e1e471709c49c5e48ac"}
Jul 22 16:23:50.716860 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:50.716823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4dfkr" event={"ID":"ae1613d5-4a55-4aac-8fc1-3723fd760a24","Type":"ContainerStarted","Data":"23c2898029b348626e5d93aedaf64d7f73c022cd500bb101029d945938e6db55"}
Jul 22 16:23:50.736374 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:50.736313    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k7qtt" podStartSLOduration=1.830674752 podStartE2EDuration="8.736291414s" totalImagesPullingTime="6.905616662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:50.735529896 +0000 UTC m=+60.087805918" watchObservedRunningTime="2026-07-22 16:23:50.736291414 +0000 UTC m=+60.088567436"
Jul 22 16:23:53.636662 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:53.636631    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r8kmz"
Jul 22 16:23:53.729377 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:53.729286    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4dfkr" event={"ID":"ae1613d5-4a55-4aac-8fc1-3723fd760a24","Type":"ContainerStarted","Data":"555eb4f43146b94446e8ab6bf52a2a1237cc7e3ba0eeff86ca9b3a68c1ce2eec"}
Jul 22 16:23:53.729548 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:53.729460    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4dfkr"
Jul 22 16:23:53.731249 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:53.731210    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mtv44" event={"ID":"8a425a4f-8adf-4012-95c7-580429622b1d","Type":"ContainerStarted","Data":"c505910732fdee2ba62f25131bc0c880622af96554bf71a5e714b540c75a52be"}
Jul 22 16:23:53.734448 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:53.734429    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4dfkr"
Jul 22 16:23:53.757008 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:53.756964    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4dfkr" podStartSLOduration=1.762651493 podStartE2EDuration="4.756949162s" totalImagesPullingTime="2.994297669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:53.756608277 +0000 UTC m=+63.108884300" watchObservedRunningTime="2026-07-22 16:23:53.756949162 +0000 UTC m=+63.109225184"
Jul 22 16:23:54.009442 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.009361    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"]
Jul 22 16:23:54.011630 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.011609    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.014488 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.014412    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 22 16:23:54.014585 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.014496    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 16:23:54.014585 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.014567    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-n478p\""
Jul 22 16:23:54.014788 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.014770    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 16:23:54.014897 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.014802    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 16:23:54.015262 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.015242    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 22 16:23:54.022588 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.022560    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"]
Jul 22 16:23:54.157879 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.157841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7668\" (UniqueName: \"kubernetes.io/projected/507c9870-86fa-4388-b8ba-433bc5c528dd-kube-api-access-n7668\") pod \"prometheus-operator-5945b5cfd-wj5zd\" (UID: \"507c9870-86fa-4388-b8ba-433bc5c528dd\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.158081 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.157945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/507c9870-86fa-4388-b8ba-433bc5c528dd-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-wj5zd\" (UID: \"507c9870-86fa-4388-b8ba-433bc5c528dd\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.158081 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.157969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/507c9870-86fa-4388-b8ba-433bc5c528dd-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-wj5zd\" (UID: \"507c9870-86fa-4388-b8ba-433bc5c528dd\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.158081 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.158009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/507c9870-86fa-4388-b8ba-433bc5c528dd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-wj5zd\" (UID: \"507c9870-86fa-4388-b8ba-433bc5c528dd\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.258786 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.258753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/507c9870-86fa-4388-b8ba-433bc5c528dd-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-wj5zd\" (UID: \"507c9870-86fa-4388-b8ba-433bc5c528dd\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.258971 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.258793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/507c9870-86fa-4388-b8ba-433bc5c528dd-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-wj5zd\" (UID: \"507c9870-86fa-4388-b8ba-433bc5c528dd\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.258971 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.258837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/507c9870-86fa-4388-b8ba-433bc5c528dd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-wj5zd\" (UID: \"507c9870-86fa-4388-b8ba-433bc5c528dd\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.258971 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:54.258888    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 22 16:23:54.258971 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:23:54.258968    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/507c9870-86fa-4388-b8ba-433bc5c528dd-prometheus-operator-tls podName:507c9870-86fa-4388-b8ba-433bc5c528dd nodeName:}" failed. No retries permitted until 2026-07-22 16:23:54.758948986 +0000 UTC m=+64.111225005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/507c9870-86fa-4388-b8ba-433bc5c528dd-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-wj5zd" (UID: "507c9870-86fa-4388-b8ba-433bc5c528dd") : secret "prometheus-operator-tls" not found
Jul 22 16:23:54.259219 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.258990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7668\" (UniqueName: \"kubernetes.io/projected/507c9870-86fa-4388-b8ba-433bc5c528dd-kube-api-access-n7668\") pod \"prometheus-operator-5945b5cfd-wj5zd\" (UID: \"507c9870-86fa-4388-b8ba-433bc5c528dd\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.259693 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.259629    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/507c9870-86fa-4388-b8ba-433bc5c528dd-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-wj5zd\" (UID: \"507c9870-86fa-4388-b8ba-433bc5c528dd\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.261375 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.261351    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/507c9870-86fa-4388-b8ba-433bc5c528dd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-wj5zd\" (UID: \"507c9870-86fa-4388-b8ba-433bc5c528dd\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.268533 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.268512    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7668\" (UniqueName: \"kubernetes.io/projected/507c9870-86fa-4388-b8ba-433bc5c528dd-kube-api-access-n7668\") pod \"prometheus-operator-5945b5cfd-wj5zd\" (UID: \"507c9870-86fa-4388-b8ba-433bc5c528dd\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.763680 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.763636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/507c9870-86fa-4388-b8ba-433bc5c528dd-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-wj5zd\" (UID: \"507c9870-86fa-4388-b8ba-433bc5c528dd\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.766492 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.766464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/507c9870-86fa-4388-b8ba-433bc5c528dd-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-wj5zd\" (UID: \"507c9870-86fa-4388-b8ba-433bc5c528dd\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:54.921764 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:54.921735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"
Jul 22 16:23:55.058393 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:55.058306    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd"]
Jul 22 16:23:55.062406 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:23:55.062256    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507c9870_86fa_4388_b8ba_433bc5c528dd.slice/crio-3921b168a8400c6e70a213c0dad127f9af5acd34d15bf3103fb50cc77a5bb65b WatchSource:0}: Error finding container 3921b168a8400c6e70a213c0dad127f9af5acd34d15bf3103fb50cc77a5bb65b: Status 404 returned error can't find the container with id 3921b168a8400c6e70a213c0dad127f9af5acd34d15bf3103fb50cc77a5bb65b
Jul 22 16:23:55.740626 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:55.740582    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd" event={"ID":"507c9870-86fa-4388-b8ba-433bc5c528dd","Type":"ContainerStarted","Data":"3921b168a8400c6e70a213c0dad127f9af5acd34d15bf3103fb50cc77a5bb65b"}
Jul 22 16:23:57.080741 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.080707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs\") pod \"network-metrics-daemon-r8tkj\" (UID: \"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0\") " pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:57.081274 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.080877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt8vx\" (UniqueName: \"kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx\") pod \"network-check-target-ls2js\" (UID: \"052c15fe-5980-4085-878c-4d2abaabd167\") " pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:57.083680 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.083658    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 16:23:57.083797 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.083662    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 16:23:57.093736 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.093708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b538e50-43f8-44c8-ab6f-5188c3b0a6d0-metrics-certs\") pod \"network-metrics-daemon-r8tkj\" (UID: \"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0\") " pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:57.094162 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.094142    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 16:23:57.104868 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.104844    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt8vx\" (UniqueName: \"kubernetes.io/projected/052c15fe-5980-4085-878c-4d2abaabd167-kube-api-access-rt8vx\") pod \"network-check-target-ls2js\" (UID: \"052c15fe-5980-4085-878c-4d2abaabd167\") " pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:57.181840 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.181749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:57.182443 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.182424    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h7v2l\""
Jul 22 16:23:57.184393 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.184362    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 16:23:57.190451 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.190433    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:23:57.194619 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.194597    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dce853aa-d400-49b5-8902-cb4bf7e2c732-original-pull-secret\") pod \"global-pull-secret-syncer-x296k\" (UID: \"dce853aa-d400-49b5-8902-cb4bf7e2c732\") " pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:57.334064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.334014    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ls2js"]
Jul 22 16:23:57.337555 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:23:57.337519    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod052c15fe_5980_4085_878c_4d2abaabd167.slice/crio-34f0bd71d8302cae38fc904ed77a425cbb28e0b6910be4b5ecb05dc749603620 WatchSource:0}: Error finding container 34f0bd71d8302cae38fc904ed77a425cbb28e0b6910be4b5ecb05dc749603620: Status 404 returned error can't find the container with id 34f0bd71d8302cae38fc904ed77a425cbb28e0b6910be4b5ecb05dc749603620
Jul 22 16:23:57.382411 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.382378    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vhlm5\""
Jul 22 16:23:57.385537 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.385519    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x296k"
Jul 22 16:23:57.390214 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.390198    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8tkj"
Jul 22 16:23:57.750092 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.750053    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ls2js" event={"ID":"052c15fe-5980-4085-878c-4d2abaabd167","Type":"ContainerStarted","Data":"34f0bd71d8302cae38fc904ed77a425cbb28e0b6910be4b5ecb05dc749603620"}
Jul 22 16:23:57.752461 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.752434    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mtv44" event={"ID":"8a425a4f-8adf-4012-95c7-580429622b1d","Type":"ContainerStarted","Data":"d26f9dad5766a577cc40294563e6f069c902edd54009bfbdf7fdb95f3bbc41d5"}
Jul 22 16:23:57.772204 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.772151    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mtv44" podStartSLOduration=2.573263027 podStartE2EDuration="16.772128298s" totalImagesPullingTime="14.198865271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:23:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:57.770973833 +0000 UTC m=+67.123249877" watchObservedRunningTime="2026-07-22 16:23:57.772128298 +0000 UTC m=+67.124404319"
Jul 22 16:23:57.811586 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.811531    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x296k"]
Jul 22 16:23:57.817183 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:23:57.817155    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce853aa_d400_49b5_8902_cb4bf7e2c732.slice/crio-7fbc4827ab3836ff04cb4577b1c550fafe5df59901f8aa32a7174843b1b365eb WatchSource:0}: Error finding container 7fbc4827ab3836ff04cb4577b1c550fafe5df59901f8aa32a7174843b1b365eb: Status 404 returned error can't find the container with id 7fbc4827ab3836ff04cb4577b1c550fafe5df59901f8aa32a7174843b1b365eb
Jul 22 16:23:57.833610 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:57.833436    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r8tkj"]
Jul 22 16:23:57.837931 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:23:57.837905    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b538e50_43f8_44c8_ab6f_5188c3b0a6d0.slice/crio-d40606304cac4a100e311ca3fb949d544099f1d13e64d5ccae8b59de4d00c180 WatchSource:0}: Error finding container d40606304cac4a100e311ca3fb949d544099f1d13e64d5ccae8b59de4d00c180: Status 404 returned error can't find the container with id d40606304cac4a100e311ca3fb949d544099f1d13e64d5ccae8b59de4d00c180
Jul 22 16:23:58.758948 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:58.758908    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8tkj" event={"ID":"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0","Type":"ContainerStarted","Data":"d40606304cac4a100e311ca3fb949d544099f1d13e64d5ccae8b59de4d00c180"}
Jul 22 16:23:58.761407 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:58.761317    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd" event={"ID":"507c9870-86fa-4388-b8ba-433bc5c528dd","Type":"ContainerStarted","Data":"69895c0cd0a92d65fe27e4e4a7a986cc9a199dbf52a5e91b7874869ef4f4d47e"}
Jul 22 16:23:58.761407 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:58.761371    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd" event={"ID":"507c9870-86fa-4388-b8ba-433bc5c528dd","Type":"ContainerStarted","Data":"09e61faed39721125e255bb6d54bbdc800744377df8781f026674c7f81dd9139"}
Jul 22 16:23:58.763599 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:58.763576    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x296k" event={"ID":"dce853aa-d400-49b5-8902-cb4bf7e2c732","Type":"ContainerStarted","Data":"7fbc4827ab3836ff04cb4577b1c550fafe5df59901f8aa32a7174843b1b365eb"}
Jul 22 16:23:58.782356 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:58.782305    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-wj5zd" podStartSLOduration=3.150371612 podStartE2EDuration="5.782285437s" totalImagesPullingTime="2.631913825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:58.781505147 +0000 UTC m=+68.133781162" watchObservedRunningTime="2026-07-22 16:23:58.782285437 +0000 UTC m=+68.134561459"
Jul 22 16:23:59.769643 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:59.769598    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8tkj" event={"ID":"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0","Type":"ContainerStarted","Data":"0fa39e90c0b2b9021f50a2ce21e54f8de1316f8e2f460d80e48804415ce2f15b"}
Jul 22 16:23:59.769643 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:59.769665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8tkj" event={"ID":"6b538e50-43f8-44c8-ab6f-5188c3b0a6d0","Type":"ContainerStarted","Data":"e4f44165b223b088f6d839f11ff2f90c9fc5c64865c0b4525c6d1186da8c9183"}
Jul 22 16:23:59.785484 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:23:59.785433    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r8tkj" podStartSLOduration=66.648847501 podStartE2EDuration="1m7.785414402s" totalImagesPullingTime="1.136566901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:59.785159401 +0000 UTC m=+69.137435420" watchObservedRunningTime="2026-07-22 16:23:59.785414402 +0000 UTC m=+69.137690423"
Jul 22 16:24:00.360921 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.360831    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"]
Jul 22 16:24:00.364615 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.364588    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.368028 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.367998    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-24bzq\""
Jul 22 16:24:00.368254 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.368236    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 22 16:24:00.368319 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.368249    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 22 16:24:00.393427 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.393164    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"]
Jul 22 16:24:00.395612 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.395591    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"]
Jul 22 16:24:00.395726 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.395704    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.399083 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.399059    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 22 16:24:00.399498 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.399475    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 22 16:24:00.399733 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.399716    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rt6hb\""
Jul 22 16:24:00.399945 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.399928    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 22 16:24:00.428417 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.428386    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"]
Jul 22 16:24:00.444282 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.444256    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q7jnp"]
Jul 22 16:24:00.449742 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.449715    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.455629 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.455187    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 16:24:00.455629 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.455452    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 16:24:00.456361 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.456189    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jsxbv\""
Jul 22 16:24:00.456361 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.456202    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 16:24:00.506711 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.506681    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/208a0947-cccd-4830-a739-683d3c8a6dac-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-4m6f7\" (UID: \"208a0947-cccd-4830-a739-683d3c8a6dac\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.506903 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.506732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3f92cae0-2bcd-4330-8786-ddea0a803ea7-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.506903 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.506821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f92cae0-2bcd-4330-8786-ddea0a803ea7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.506903 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.506861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th4x9\" (UniqueName: \"kubernetes.io/projected/208a0947-cccd-4830-a739-683d3c8a6dac-kube-api-access-th4x9\") pod \"openshift-state-metrics-79f6958cdf-4m6f7\" (UID: \"208a0947-cccd-4830-a739-683d3c8a6dac\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.506903 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.506891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2aa76515-4335-4435-ab78-78492c7b83f8-sys\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.507117 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.506942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2aa76515-4335-4435-ab78-78492c7b83f8-root\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.507117 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.506979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2aa76515-4335-4435-ab78-78492c7b83f8-metrics-client-ca\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.507117 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.507011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/208a0947-cccd-4830-a739-683d3c8a6dac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4m6f7\" (UID: \"208a0947-cccd-4830-a739-683d3c8a6dac\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.507117 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.507071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3f92cae0-2bcd-4330-8786-ddea0a803ea7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.507117 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.507096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-textfile\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.507309 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.507129    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkchk\" (UniqueName: \"kubernetes.io/projected/2aa76515-4335-4435-ab78-78492c7b83f8-kube-api-access-tkchk\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.507309 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.507157    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-tls\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.507309 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.507185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f92cae0-2bcd-4330-8786-ddea0a803ea7-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.507309 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.507237    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.507309 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.507263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/208a0947-cccd-4830-a739-683d3c8a6dac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-4m6f7\" (UID: \"208a0947-cccd-4830-a739-683d3c8a6dac\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.507490 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.507350    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f92cae0-2bcd-4330-8786-ddea0a803ea7-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.507490 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.507380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-wtmp\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.507490 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.507413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrvmj\" (UniqueName: \"kubernetes.io/projected/3f92cae0-2bcd-4330-8786-ddea0a803ea7-kube-api-access-jrvmj\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.507490 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.507438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.608138 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f92cae0-2bcd-4330-8786-ddea0a803ea7-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.608226 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-wtmp\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.608226 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608189    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrvmj\" (UniqueName: \"kubernetes.io/projected/3f92cae0-2bcd-4330-8786-ddea0a803ea7-kube-api-access-jrvmj\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.608226 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608213    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.608436 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/208a0947-cccd-4830-a739-683d3c8a6dac-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-4m6f7\" (UID: \"208a0947-cccd-4830-a739-683d3c8a6dac\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.608436 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3f92cae0-2bcd-4330-8786-ddea0a803ea7-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.608436 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f92cae0-2bcd-4330-8786-ddea0a803ea7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.608436 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th4x9\" (UniqueName: \"kubernetes.io/projected/208a0947-cccd-4830-a739-683d3c8a6dac-kube-api-access-th4x9\") pod \"openshift-state-metrics-79f6958cdf-4m6f7\" (UID: \"208a0947-cccd-4830-a739-683d3c8a6dac\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.608436 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-wtmp\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.608436 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2aa76515-4335-4435-ab78-78492c7b83f8-sys\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.608796 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2aa76515-4335-4435-ab78-78492c7b83f8-root\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.608796 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2aa76515-4335-4435-ab78-78492c7b83f8-sys\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.608796 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2aa76515-4335-4435-ab78-78492c7b83f8-metrics-client-ca\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.608796 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/208a0947-cccd-4830-a739-683d3c8a6dac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4m6f7\" (UID: \"208a0947-cccd-4830-a739-683d3c8a6dac\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.608796 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3f92cae0-2bcd-4330-8786-ddea0a803ea7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.608796 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-textfile\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.608796 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkchk\" (UniqueName: \"kubernetes.io/projected/2aa76515-4335-4435-ab78-78492c7b83f8-kube-api-access-tkchk\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.608796 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608630    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-tls\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.608796 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f92cae0-2bcd-4330-8786-ddea0a803ea7-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.608796 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.608796 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/208a0947-cccd-4830-a739-683d3c8a6dac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-4m6f7\" (UID: \"208a0947-cccd-4830-a739-683d3c8a6dac\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.608796 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608745    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3f92cae0-2bcd-4330-8786-ddea0a803ea7-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.609520 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.608983    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/208a0947-cccd-4830-a739-683d3c8a6dac-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-4m6f7\" (UID: \"208a0947-cccd-4830-a739-683d3c8a6dac\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.609520 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.609072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2aa76515-4335-4435-ab78-78492c7b83f8-root\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.609520 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.609115    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2aa76515-4335-4435-ab78-78492c7b83f8-metrics-client-ca\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.610064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.609748    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f92cae0-2bcd-4330-8786-ddea0a803ea7-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.610064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.609859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.610064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.609985    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3f92cae0-2bcd-4330-8786-ddea0a803ea7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.610064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.610006    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-textfile\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.611714 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.611654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f92cae0-2bcd-4330-8786-ddea0a803ea7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.611868 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.611846    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-tls\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.611990 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.611967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/208a0947-cccd-4830-a739-683d3c8a6dac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-4m6f7\" (UID: \"208a0947-cccd-4830-a739-683d3c8a6dac\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.612080 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.612050    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/208a0947-cccd-4830-a739-683d3c8a6dac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-4m6f7\" (UID: \"208a0947-cccd-4830-a739-683d3c8a6dac\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.612150 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.612128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f92cae0-2bcd-4330-8786-ddea0a803ea7-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.612383 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.612361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2aa76515-4335-4435-ab78-78492c7b83f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.616398 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.616372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrvmj\" (UniqueName: \"kubernetes.io/projected/3f92cae0-2bcd-4330-8786-ddea0a803ea7-kube-api-access-jrvmj\") pod \"kube-state-metrics-56c5594674-wfmdq\" (UID: \"3f92cae0-2bcd-4330-8786-ddea0a803ea7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.616491 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.616380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkchk\" (UniqueName: \"kubernetes.io/projected/2aa76515-4335-4435-ab78-78492c7b83f8-kube-api-access-tkchk\") pod \"node-exporter-q7jnp\" (UID: \"2aa76515-4335-4435-ab78-78492c7b83f8\") " pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.616640 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.616620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th4x9\" (UniqueName: \"kubernetes.io/projected/208a0947-cccd-4830-a739-683d3c8a6dac-kube-api-access-th4x9\") pod \"openshift-state-metrics-79f6958cdf-4m6f7\" (UID: \"208a0947-cccd-4830-a739-683d3c8a6dac\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.677099 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.677072    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"
Jul 22 16:24:00.708190 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.708154    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"
Jul 22 16:24:00.722358 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.722335    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k7qtt"
Jul 22 16:24:00.761566 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.761535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q7jnp"
Jul 22 16:24:00.775688 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.775579    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ls2js" event={"ID":"052c15fe-5980-4085-878c-4d2abaabd167","Type":"ContainerStarted","Data":"b029586228a5d8230340ba890590f4c507c1f4d2ff2ff4f981be656591bd5743"}
Jul 22 16:24:00.776137 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.775905    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:24:00.790926 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:00.790837    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ls2js" podStartSLOduration=65.519040603 podStartE2EDuration="1m8.79081831s" totalImagesPullingTime="3.271777707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:00.790077192 +0000 UTC m=+70.142353212" watchObservedRunningTime="2026-07-22 16:24:00.79081831 +0000 UTC m=+70.143094330"
Jul 22 16:24:01.411983 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.411953    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 16:24:01.431457 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.431427    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 16:24:01.431636 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.431558    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.434875 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.434212    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d2pmn\""
Jul 22 16:24:01.434875 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.434251    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 16:24:01.434875 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.434357    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 16:24:01.434875 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.434458    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 16:24:01.434875 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.434596    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 16:24:01.434875 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.434608    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 16:24:01.434875 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.434642    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 16:24:01.434875 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.434643    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 16:24:01.434875 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.434689    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 16:24:01.435588 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.434955    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 16:24:01.515188 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.515157    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-config-out\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.515379 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.515208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.515379 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.515236    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.515379 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.515279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.515379 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.515313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.515379 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.515342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.515379 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.515369    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.515680 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.515401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.515680 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.515424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59hxv\" (UniqueName: \"kubernetes.io/projected/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-kube-api-access-59hxv\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.515680 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.515447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.515680 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.515478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-web-config\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.515680 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.515515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.515680 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.515545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.616866 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.616835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-web-config\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.617079 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.616883    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.617079 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.616912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.617079 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.616936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-config-out\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.617079 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.616975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.617301 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.617144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.617301 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.617191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.617301 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.617233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.617301 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.617267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.617301 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.617298    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.617545 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.617334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.617545 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.617358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59hxv\" (UniqueName: \"kubernetes.io/projected/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-kube-api-access-59hxv\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.617545 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.617391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.618548 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.618195    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.619449 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.619104    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.619702 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.619676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.620711 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.620685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.621660 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.621618    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-config-out\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.621774 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.621669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.621774 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.621698    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.622164 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.622115    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.622402 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.622355    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.622826 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.622801    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.622980 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.622960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-web-config\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.624148 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.624106    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.628070 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.628052    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59hxv\" (UniqueName: \"kubernetes.io/projected/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-kube-api-access-59hxv\") pod \"alertmanager-main-0\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:01.743593 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:01.743513    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:24:02.160288 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:24:02.160257    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa76515_4335_4435_ab78_78492c7b83f8.slice/crio-4d964f5261461acad855a4990f50ef0c00123e4d6d2142654be092b015fb0fd7 WatchSource:0}: Error finding container 4d964f5261461acad855a4990f50ef0c00123e4d6d2142654be092b015fb0fd7: Status 404 returned error can't find the container with id 4d964f5261461acad855a4990f50ef0c00123e4d6d2142654be092b015fb0fd7
Jul 22 16:24:02.298755 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.298661    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-wfmdq"]
Jul 22 16:24:02.318997 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:24:02.318962    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f92cae0_2bcd_4330_8786_ddea0a803ea7.slice/crio-a001ead989e18ac22dd5c7eaffe07a15e6f887d20023a1a63a8e0f583d4200d1 WatchSource:0}: Error finding container a001ead989e18ac22dd5c7eaffe07a15e6f887d20023a1a63a8e0f583d4200d1: Status 404 returned error can't find the container with id a001ead989e18ac22dd5c7eaffe07a15e6f887d20023a1a63a8e0f583d4200d1
Jul 22 16:24:02.409270 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.409247    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-9d846c47-6h5tq"]
Jul 22 16:24:02.411533 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.411516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.414240 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.414217    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vrr5g\""
Jul 22 16:24:02.414360 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.414263    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7t9rc5apu743v\""
Jul 22 16:24:02.414360 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.414263    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 22 16:24:02.414467 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.414263    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 22 16:24:02.414714 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.414698    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 22 16:24:02.415182 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.415168    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 22 16:24:02.415251 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.415197    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 22 16:24:02.428127 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.428033    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9d846c47-6h5tq"]
Jul 22 16:24:02.523811 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.523773    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.523997 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.523841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-grpc-tls\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.523997 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.523895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-tls\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.523997 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.523927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be3261be-5dcd-4bef-9ead-16434d548b18-metrics-client-ca\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.523997 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.523982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.523997 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.523995    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7"]
Jul 22 16:24:02.524454 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.524050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l85rm\" (UniqueName: \"kubernetes.io/projected/be3261be-5dcd-4bef-9ead-16434d548b18-kube-api-access-l85rm\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.524610 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.524574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.524682 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.524640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.530671 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.529791    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 16:24:02.532683 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:24:02.532584    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208a0947_cccd_4830_a739_683d3c8a6dac.slice/crio-883b8b1f80023d8aedcad1ee4a8c9585c252d7e24eb1ac7354f12cce8dbbb427 WatchSource:0}: Error finding container 883b8b1f80023d8aedcad1ee4a8c9585c252d7e24eb1ac7354f12cce8dbbb427: Status 404 returned error can't find the container with id 883b8b1f80023d8aedcad1ee4a8c9585c252d7e24eb1ac7354f12cce8dbbb427
Jul 22 16:24:02.534616 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:24:02.534591    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35c3a09a_fd5a_414f_b6ba_c58fe3f1e6ed.slice/crio-cde10d86bbea50fa1754f2995b8ee98cc7bcdc2c1aa5dacd79ca561a6e9865d1 WatchSource:0}: Error finding container cde10d86bbea50fa1754f2995b8ee98cc7bcdc2c1aa5dacd79ca561a6e9865d1: Status 404 returned error can't find the container with id cde10d86bbea50fa1754f2995b8ee98cc7bcdc2c1aa5dacd79ca561a6e9865d1
Jul 22 16:24:02.626792 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.626095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.626792 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.626153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.626792 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.626201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.626792 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.626248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-grpc-tls\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.626792 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.626285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-tls\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.626792 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.626313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be3261be-5dcd-4bef-9ead-16434d548b18-metrics-client-ca\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.626792 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.626347    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.626792 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.626385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l85rm\" (UniqueName: \"kubernetes.io/projected/be3261be-5dcd-4bef-9ead-16434d548b18-kube-api-access-l85rm\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.627392 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.627247    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be3261be-5dcd-4bef-9ead-16434d548b18-metrics-client-ca\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.630372 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.630160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.630372 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.630344    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-tls\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.630552 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.630369    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-grpc-tls\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.630747 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.630728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.631182 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.631140    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.633010 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.632969    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/be3261be-5dcd-4bef-9ead-16434d548b18-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.635207 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.635167    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l85rm\" (UniqueName: \"kubernetes.io/projected/be3261be-5dcd-4bef-9ead-16434d548b18-kube-api-access-l85rm\") pod \"thanos-querier-9d846c47-6h5tq\" (UID: \"be3261be-5dcd-4bef-9ead-16434d548b18\") " pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.721626 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.721390    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:02.788617 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.788579    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7" event={"ID":"208a0947-cccd-4830-a739-683d3c8a6dac","Type":"ContainerStarted","Data":"4bb92cff718c28a1c05698d5cbbbd6168ac1d4142d56c0ad8c8aaa6de55631bf"}
Jul 22 16:24:02.788762 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.788659    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7" event={"ID":"208a0947-cccd-4830-a739-683d3c8a6dac","Type":"ContainerStarted","Data":"e5ed088971fa1598c442c8e9cf3ee36c7670d5e860a2c86f11e8ac3a15bed476"}
Jul 22 16:24:02.788762 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.788687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7" event={"ID":"208a0947-cccd-4830-a739-683d3c8a6dac","Type":"ContainerStarted","Data":"883b8b1f80023d8aedcad1ee4a8c9585c252d7e24eb1ac7354f12cce8dbbb427"}
Jul 22 16:24:02.790624 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.790599    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q7jnp" event={"ID":"2aa76515-4335-4435-ab78-78492c7b83f8","Type":"ContainerStarted","Data":"4d964f5261461acad855a4990f50ef0c00123e4d6d2142654be092b015fb0fd7"}
Jul 22 16:24:02.792153 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.792117    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerStarted","Data":"cde10d86bbea50fa1754f2995b8ee98cc7bcdc2c1aa5dacd79ca561a6e9865d1"}
Jul 22 16:24:02.793721 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.793694    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq" event={"ID":"3f92cae0-2bcd-4330-8786-ddea0a803ea7","Type":"ContainerStarted","Data":"a001ead989e18ac22dd5c7eaffe07a15e6f887d20023a1a63a8e0f583d4200d1"}
Jul 22 16:24:02.796135 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.796084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x296k" event={"ID":"dce853aa-d400-49b5-8902-cb4bf7e2c732","Type":"ContainerStarted","Data":"a516790ecb520ddd8c8a4ec593725b3c6c152cbb40fc19bb3a4fd91751847e1e"}
Jul 22 16:24:02.866319 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.865927    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x296k" podStartSLOduration=66.353754695 podStartE2EDuration="1m10.865901607s" totalImagesPullingTime="4.512146912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:02.814143918 +0000 UTC m=+72.166419940" watchObservedRunningTime="2026-07-22 16:24:02.865901607 +0000 UTC m=+72.218177628"
Jul 22 16:24:02.866319 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:02.866309    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9d846c47-6h5tq"]
Jul 22 16:24:03.077149 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:24:03.077069    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3261be_5dcd_4bef_9ead_16434d548b18.slice/crio-74588e86216b0d2a2312bb1ebae4ecc24c2aece0699b53b319fd27b7ffc74fd5 WatchSource:0}: Error finding container 74588e86216b0d2a2312bb1ebae4ecc24c2aece0699b53b319fd27b7ffc74fd5: Status 404 returned error can't find the container with id 74588e86216b0d2a2312bb1ebae4ecc24c2aece0699b53b319fd27b7ffc74fd5
Jul 22 16:24:03.801263 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:03.801223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq" event={"ID":"be3261be-5dcd-4bef-9ead-16434d548b18","Type":"ContainerStarted","Data":"74588e86216b0d2a2312bb1ebae4ecc24c2aece0699b53b319fd27b7ffc74fd5"}
Jul 22 16:24:03.803127 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:03.803096    2580 generic.go:356] "Generic (PLEG): container finished" podID="2aa76515-4335-4435-ab78-78492c7b83f8" containerID="b0d2740374516ac31a0721a86aed49249b8c08c3b3fd6bd6ccf12d3e53886539" exitCode=0
Jul 22 16:24:03.803261 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:03.803176    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q7jnp" event={"ID":"2aa76515-4335-4435-ab78-78492c7b83f8","Type":"ContainerDied","Data":"b0d2740374516ac31a0721a86aed49249b8c08c3b3fd6bd6ccf12d3e53886539"}
Jul 22 16:24:04.733839 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.733805    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c75c584d6-8hkbl"]
Jul 22 16:24:04.736536 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.736513    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.740366 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.740344    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 22 16:24:04.741059 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.741038    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bq8dp\""
Jul 22 16:24:04.741652 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.741632    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 22 16:24:04.741761 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.741710    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5kp0jt3llin8r\""
Jul 22 16:24:04.741996 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.741959    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 22 16:24:04.742101 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.742065    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 16:24:04.750226 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.750206    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c75c584d6-8hkbl"]
Jul 22 16:24:04.810687 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.810649    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7" event={"ID":"208a0947-cccd-4830-a739-683d3c8a6dac","Type":"ContainerStarted","Data":"432613d302528b29e284f016c8b8432dc8a594c3802ffa72310f6da480d25693"}
Jul 22 16:24:04.815042 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.814480    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q7jnp" event={"ID":"2aa76515-4335-4435-ab78-78492c7b83f8","Type":"ContainerStarted","Data":"fb327784bcb3bf5802e7f5e9c012613c4ff4cf2313f2e92d2f9819b8bd077bf4"}
Jul 22 16:24:04.815042 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.814545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q7jnp" event={"ID":"2aa76515-4335-4435-ab78-78492c7b83f8","Type":"ContainerStarted","Data":"36fd8e449f53691ef1fa0ba0e9880e2b5682b007d6459eccffdacc78c32226a4"}
Jul 22 16:24:04.816901 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.816876    2580 generic.go:356] "Generic (PLEG): container finished" podID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerID="602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a" exitCode=0
Jul 22 16:24:04.817157 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.816924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerDied","Data":"602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a"}
Jul 22 16:24:04.824872 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.824843    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq" event={"ID":"3f92cae0-2bcd-4330-8786-ddea0a803ea7","Type":"ContainerStarted","Data":"fc5034651401322e04bb32270943c6bb2c8df6892efd765a77c743b2ee368793"}
Jul 22 16:24:04.824998 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.824901    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq" event={"ID":"3f92cae0-2bcd-4330-8786-ddea0a803ea7","Type":"ContainerStarted","Data":"d08236fa7c750dd2704d67beeeded163bfdb69a3a8a77146fabb26fc6608f05b"}
Jul 22 16:24:04.824998 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.824933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq" event={"ID":"3f92cae0-2bcd-4330-8786-ddea0a803ea7","Type":"ContainerStarted","Data":"17d291c23af6ebbc555be58a7eb85bacf4d52a57dcec170422532bd271a553bd"}
Jul 22 16:24:04.833956 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.833890    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-4m6f7" podStartSLOduration=3.261908202 podStartE2EDuration="4.833867208s" totalImagesPullingTime="1.571959006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:04.833550266 +0000 UTC m=+74.185826287" watchObservedRunningTime="2026-07-22 16:24:04.833867208 +0000 UTC m=+74.186143229"
Jul 22 16:24:04.847202 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.847170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ad098e57-57db-497b-85d3-a919ecbf3dce-secret-metrics-server-client-certs\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.847331 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.847212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad098e57-57db-497b-85d3-a919ecbf3dce-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.847331 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.847232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ad098e57-57db-497b-85d3-a919ecbf3dce-audit-log\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.847331 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.847256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ad098e57-57db-497b-85d3-a919ecbf3dce-metrics-server-audit-profiles\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.847331 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.847294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ad098e57-57db-497b-85d3-a919ecbf3dce-secret-metrics-server-tls\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.847331 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.847314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad098e57-57db-497b-85d3-a919ecbf3dce-client-ca-bundle\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.847587 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.847414    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkkjb\" (UniqueName: \"kubernetes.io/projected/ad098e57-57db-497b-85d3-a919ecbf3dce-kube-api-access-bkkjb\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.853514 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.853473    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-wfmdq" podStartSLOduration=2.920469421 podStartE2EDuration="4.853459795s" totalImagesPullingTime="1.932990374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:04.85209154 +0000 UTC m=+74.204367561" watchObservedRunningTime="2026-07-22 16:24:04.853459795 +0000 UTC m=+74.205735815"
Jul 22 16:24:04.898139 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.898094    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q7jnp" podStartSLOduration=3.885117674 podStartE2EDuration="4.898078934s" totalImagesPullingTime="941.482252ms" totalInitContainerRuntime="71.479008ms" isStatefulPod=true podCreationTimestamp="2026-07-22 16:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:04.870598055 +0000 UTC m=+74.222874088" watchObservedRunningTime="2026-07-22 16:24:04.898078934 +0000 UTC m=+74.250354954"
Jul 22 16:24:04.948066 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.948004    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkkjb\" (UniqueName: \"kubernetes.io/projected/ad098e57-57db-497b-85d3-a919ecbf3dce-kube-api-access-bkkjb\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.948559 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.948521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ad098e57-57db-497b-85d3-a919ecbf3dce-secret-metrics-server-client-certs\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.948701 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.948677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad098e57-57db-497b-85d3-a919ecbf3dce-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.948909 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.948849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ad098e57-57db-497b-85d3-a919ecbf3dce-audit-log\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.948909 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.948893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ad098e57-57db-497b-85d3-a919ecbf3dce-metrics-server-audit-profiles\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.949084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.949050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ad098e57-57db-497b-85d3-a919ecbf3dce-secret-metrics-server-tls\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.949152 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.949108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad098e57-57db-497b-85d3-a919ecbf3dce-client-ca-bundle\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.949726 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.949293    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ad098e57-57db-497b-85d3-a919ecbf3dce-audit-log\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.950053 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.949805    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad098e57-57db-497b-85d3-a919ecbf3dce-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.950182 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.950154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ad098e57-57db-497b-85d3-a919ecbf3dce-metrics-server-audit-profiles\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.951616 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.951572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ad098e57-57db-497b-85d3-a919ecbf3dce-secret-metrics-server-client-certs\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.952071 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.952052    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad098e57-57db-497b-85d3-a919ecbf3dce-client-ca-bundle\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.952136 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.952125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ad098e57-57db-497b-85d3-a919ecbf3dce-secret-metrics-server-tls\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:04.956573 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:04.956539    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkkjb\" (UniqueName: \"kubernetes.io/projected/ad098e57-57db-497b-85d3-a919ecbf3dce-kube-api-access-bkkjb\") pod \"metrics-server-6c75c584d6-8hkbl\" (UID: \"ad098e57-57db-497b-85d3-a919ecbf3dce\") " pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:05.049193 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.049106    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:05.115440 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.115406    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf"]
Jul 22 16:24:05.117862 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.117836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf"
Jul 22 16:24:05.120432 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.120415    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 22 16:24:05.120432 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.120426    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dntvt\""
Jul 22 16:24:05.126541 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.126513    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf"]
Jul 22 16:24:05.251560 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.251528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39de0651-9bb7-4640-a69f-94c984485dd9-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hmwzf\" (UID: \"39de0651-9bb7-4640-a69f-94c984485dd9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf"
Jul 22 16:24:05.251664 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.251598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r67dz\" (UniqueName: \"kubernetes.io/projected/39de0651-9bb7-4640-a69f-94c984485dd9-kube-api-access-r67dz\") pod \"monitoring-plugin-7b7b7bc8bf-hmwzf\" (UID: \"39de0651-9bb7-4640-a69f-94c984485dd9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf"
Jul 22 16:24:05.352592 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.352387    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r67dz\" (UniqueName: \"kubernetes.io/projected/39de0651-9bb7-4640-a69f-94c984485dd9-kube-api-access-r67dz\") pod \"monitoring-plugin-7b7b7bc8bf-hmwzf\" (UID: \"39de0651-9bb7-4640-a69f-94c984485dd9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf"
Jul 22 16:24:05.352592 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.352467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39de0651-9bb7-4640-a69f-94c984485dd9-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hmwzf\" (UID: \"39de0651-9bb7-4640-a69f-94c984485dd9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf"
Jul 22 16:24:05.356222 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.356173    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39de0651-9bb7-4640-a69f-94c984485dd9-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hmwzf\" (UID: \"39de0651-9bb7-4640-a69f-94c984485dd9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf"
Jul 22 16:24:05.356222 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.356208    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c75c584d6-8hkbl"]
Jul 22 16:24:05.360524 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:24:05.360496    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad098e57_57db_497b_85d3_a919ecbf3dce.slice/crio-5e3d0cca72e654d699b1600c2013540301aa5988c12644fc18929d3ed4c07539 WatchSource:0}: Error finding container 5e3d0cca72e654d699b1600c2013540301aa5988c12644fc18929d3ed4c07539: Status 404 returned error can't find the container with id 5e3d0cca72e654d699b1600c2013540301aa5988c12644fc18929d3ed4c07539
Jul 22 16:24:05.362100 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.362010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r67dz\" (UniqueName: \"kubernetes.io/projected/39de0651-9bb7-4640-a69f-94c984485dd9-kube-api-access-r67dz\") pod \"monitoring-plugin-7b7b7bc8bf-hmwzf\" (UID: \"39de0651-9bb7-4640-a69f-94c984485dd9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf"
Jul 22 16:24:05.429851 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.429818    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf"
Jul 22 16:24:05.572215 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.572191    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf"]
Jul 22 16:24:05.574370 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:24:05.574338    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39de0651_9bb7_4640_a69f_94c984485dd9.slice/crio-b5bf2be09e857d2014bc59456db0251dab3713e775c696aac9140f668cb5051e WatchSource:0}: Error finding container b5bf2be09e857d2014bc59456db0251dab3713e775c696aac9140f668cb5051e: Status 404 returned error can't find the container with id b5bf2be09e857d2014bc59456db0251dab3713e775c696aac9140f668cb5051e
Jul 22 16:24:05.666568 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.666532    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8bd5465d9-s47tg"]
Jul 22 16:24:05.669229 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.669200    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.672196 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.672155    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 22 16:24:05.672319 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.672213    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 22 16:24:05.672319 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.672265    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 22 16:24:05.672480 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.672461    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-c9jzz\""
Jul 22 16:24:05.672679 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.672567    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 22 16:24:05.672679 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.672614    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 22 16:24:05.677797 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.677772    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 22 16:24:05.683522 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.683501    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8bd5465d9-s47tg"]
Jul 22 16:24:05.755986 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.755955    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6863f7ee-c966-4e64-b433-52c305dd55a2-metrics-client-ca\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.756169 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.756001    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6863f7ee-c966-4e64-b433-52c305dd55a2-federate-client-tls\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.756169 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.756039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6863f7ee-c966-4e64-b433-52c305dd55a2-telemeter-client-tls\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.756169 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.756068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6863f7ee-c966-4e64-b433-52c305dd55a2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.756169 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.756148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkxbq\" (UniqueName: \"kubernetes.io/projected/6863f7ee-c966-4e64-b433-52c305dd55a2-kube-api-access-wkxbq\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.756320 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.756184    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6863f7ee-c966-4e64-b433-52c305dd55a2-secret-telemeter-client\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.756320 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.756205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6863f7ee-c966-4e64-b433-52c305dd55a2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.756320 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.756249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6863f7ee-c966-4e64-b433-52c305dd55a2-serving-certs-ca-bundle\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.832651 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.832569    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq" event={"ID":"be3261be-5dcd-4bef-9ead-16434d548b18","Type":"ContainerStarted","Data":"77aa8c87c263026259770521f75eb44d5ae2b934a0ecc32ab7f559f1f472aae8"}
Jul 22 16:24:05.832651 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.832641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq" event={"ID":"be3261be-5dcd-4bef-9ead-16434d548b18","Type":"ContainerStarted","Data":"a68ae67d17ee309fbf4ca39284484c602c1031414d48b50514a619d27ba62d8e"}
Jul 22 16:24:05.833156 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.832682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq" event={"ID":"be3261be-5dcd-4bef-9ead-16434d548b18","Type":"ContainerStarted","Data":"deb206f8b463a6cd41b7434cca55be3b6b9c2518cd118df364a3a287d9bec1e8"}
Jul 22 16:24:05.833888 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.833855    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf" event={"ID":"39de0651-9bb7-4640-a69f-94c984485dd9","Type":"ContainerStarted","Data":"b5bf2be09e857d2014bc59456db0251dab3713e775c696aac9140f668cb5051e"}
Jul 22 16:24:05.835323 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.835289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl" event={"ID":"ad098e57-57db-497b-85d3-a919ecbf3dce","Type":"ContainerStarted","Data":"5e3d0cca72e654d699b1600c2013540301aa5988c12644fc18929d3ed4c07539"}
Jul 22 16:24:05.857442 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.857418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6863f7ee-c966-4e64-b433-52c305dd55a2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.857549 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.857466    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkxbq\" (UniqueName: \"kubernetes.io/projected/6863f7ee-c966-4e64-b433-52c305dd55a2-kube-api-access-wkxbq\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.857549 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.857501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6863f7ee-c966-4e64-b433-52c305dd55a2-secret-telemeter-client\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.857549 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.857529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6863f7ee-c966-4e64-b433-52c305dd55a2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.857715 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.857556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6863f7ee-c966-4e64-b433-52c305dd55a2-serving-certs-ca-bundle\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.857818 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.857793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6863f7ee-c966-4e64-b433-52c305dd55a2-metrics-client-ca\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.857888 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.857848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6863f7ee-c966-4e64-b433-52c305dd55a2-federate-client-tls\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.857888 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.857880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6863f7ee-c966-4e64-b433-52c305dd55a2-telemeter-client-tls\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.858446 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.858379    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6863f7ee-c966-4e64-b433-52c305dd55a2-serving-certs-ca-bundle\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.858557 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.858533    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6863f7ee-c966-4e64-b433-52c305dd55a2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.858617 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.858548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6863f7ee-c966-4e64-b433-52c305dd55a2-metrics-client-ca\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.860588 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.860568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6863f7ee-c966-4e64-b433-52c305dd55a2-telemeter-client-tls\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.860679 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.860655    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6863f7ee-c966-4e64-b433-52c305dd55a2-secret-telemeter-client\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.860724 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.860686    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6863f7ee-c966-4e64-b433-52c305dd55a2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.860917 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.860895    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6863f7ee-c966-4e64-b433-52c305dd55a2-federate-client-tls\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.866216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.866190    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkxbq\" (UniqueName: \"kubernetes.io/projected/6863f7ee-c966-4e64-b433-52c305dd55a2-kube-api-access-wkxbq\") pod \"telemeter-client-8bd5465d9-s47tg\" (UID: \"6863f7ee-c966-4e64-b433-52c305dd55a2\") " pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:05.983674 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:05.983641    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg"
Jul 22 16:24:06.157345 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.157307    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8bd5465d9-s47tg"]
Jul 22 16:24:06.492793 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:24:06.492724    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6863f7ee_c966_4e64_b433_52c305dd55a2.slice/crio-0894531920bf8b4ec68d35c0faf80508c930752ccc2d8a6a4852a7ef9759649b WatchSource:0}: Error finding container 0894531920bf8b4ec68d35c0faf80508c930752ccc2d8a6a4852a7ef9759649b: Status 404 returned error can't find the container with id 0894531920bf8b4ec68d35c0faf80508c930752ccc2d8a6a4852a7ef9759649b
Jul 22 16:24:06.665889 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.665735    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:24:06.669966 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.669387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.672497 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.672472    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 16:24:06.672632 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.672553    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 16:24:06.672632 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.672596    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 16:24:06.672751 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.672701    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 16:24:06.672751 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.672741    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 16:24:06.672827 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.672480    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 16:24:06.672871 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.672477    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 16:24:06.672988 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.672968    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 16:24:06.673244 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.673225    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 16:24:06.673464 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.673448    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-prplv\""
Jul 22 16:24:06.673551 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.673508    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 16:24:06.673653 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.673633    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 16:24:06.673721 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.673673    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-euo7onv6ikssn\""
Jul 22 16:24:06.674144 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.673917    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 16:24:06.676755 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.676569    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 16:24:06.678263 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.678219    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 16:24:06.687930 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.687878    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:24:06.766598 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.766598 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.766598 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.766884 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766620    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-web-config\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.766884 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766647    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.766884 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.766884 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.766884 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.766884 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.766884 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71e22c1e-d766-44f7-a696-0bade791739a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.767176 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766892    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.767176 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.767176 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766950    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-config\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.767176 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.766971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpzqc\" (UniqueName: \"kubernetes.io/projected/71e22c1e-d766-44f7-a696-0bade791739a-kube-api-access-qpzqc\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.767176 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.767006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.767176 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.767089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71e22c1e-d766-44f7-a696-0bade791739a-config-out\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.767176 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.767113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.767176 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.767148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.767517 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.767201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.767517 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.767240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.844912 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.844844    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg" event={"ID":"6863f7ee-c966-4e64-b433-52c305dd55a2","Type":"ContainerStarted","Data":"0894531920bf8b4ec68d35c0faf80508c930752ccc2d8a6a4852a7ef9759649b"}
Jul 22 16:24:06.868403 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868355    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.868583 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.868583 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.868583 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.868738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.868738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.868738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-web-config\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.868738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.868738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.868738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.869058 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.869058 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.869058 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71e22c1e-d766-44f7-a696-0bade791739a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.869058 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.869058 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.869058 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-config\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.869058 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpzqc\" (UniqueName: \"kubernetes.io/projected/71e22c1e-d766-44f7-a696-0bade791739a-kube-api-access-qpzqc\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.869058 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.869058 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.868983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71e22c1e-d766-44f7-a696-0bade791739a-config-out\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.869058 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.869004    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.869694 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.869669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.870655 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.870627    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.875055 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.871474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.875055 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.871810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.875055 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.873513    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.875055 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.873704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-web-config\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.875055 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.874918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.875363 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.875001    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.876440 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.876140    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71e22c1e-d766-44f7-a696-0bade791739a-config-out\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.876440 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.876142    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.876618 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.876596    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.878533 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.878486    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.879345 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.879306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.880522 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.880113    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-config\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.880522 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.880283    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.880522 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.880481    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71e22c1e-d766-44f7-a696-0bade791739a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.881533 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.881479    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.881984 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.881943    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.884900 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.884876    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.890917 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.890877    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpzqc\" (UniqueName: \"kubernetes.io/projected/71e22c1e-d766-44f7-a696-0bade791739a-kube-api-access-qpzqc\") pod \"prometheus-k8s-0\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:06.982769 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:06.982588    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:07.400312 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:07.399816    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:24:07.405314 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:24:07.405293    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e22c1e_d766_44f7_a696_0bade791739a.slice/crio-e73b31a2bd969c4a6baa2d97f3e597a1819c80f62eb7615c7cd616addff01750 WatchSource:0}: Error finding container e73b31a2bd969c4a6baa2d97f3e597a1819c80f62eb7615c7cd616addff01750: Status 404 returned error can't find the container with id e73b31a2bd969c4a6baa2d97f3e597a1819c80f62eb7615c7cd616addff01750
Jul 22 16:24:07.853588 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:07.853479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerStarted","Data":"2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860"}
Jul 22 16:24:07.853588 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:07.853557    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerStarted","Data":"260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76"}
Jul 22 16:24:07.856898 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:07.855993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl" event={"ID":"ad098e57-57db-497b-85d3-a919ecbf3dce","Type":"ContainerStarted","Data":"eb9a6a49cff025f034a6cd5a5de71515e8c2f18fd9eff9523b2ae55643fef6e5"}
Jul 22 16:24:07.860719 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:07.860616    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerStarted","Data":"e73b31a2bd969c4a6baa2d97f3e597a1819c80f62eb7615c7cd616addff01750"}
Jul 22 16:24:07.865515 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:07.864410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq" event={"ID":"be3261be-5dcd-4bef-9ead-16434d548b18","Type":"ContainerStarted","Data":"1c01c60c1e0ba372fbb207ebe432e95845117cde7d931ec262761efd749832c6"}
Jul 22 16:24:07.865515 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:07.864488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq" event={"ID":"be3261be-5dcd-4bef-9ead-16434d548b18","Type":"ContainerStarted","Data":"64b542dfde8a381f1e3f2834c235cf5bcdcf3d6d763b1c604a6ffebb3f9e855b"}
Jul 22 16:24:08.870965 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.870924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq" event={"ID":"be3261be-5dcd-4bef-9ead-16434d548b18","Type":"ContainerStarted","Data":"e3427dd4f4dbe7a5b7a42b60941aee4a5922453147c900e6b8478feb1ca856d4"}
Jul 22 16:24:08.871386 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.871156    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:08.872521 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.872499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf" event={"ID":"39de0651-9bb7-4640-a69f-94c984485dd9","Type":"ContainerStarted","Data":"89cec6018435b114f5207f7e4f0b98b6675e58c00a058fb3a27b7b1d62c50ce0"}
Jul 22 16:24:08.872691 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.872676    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf"
Jul 22 16:24:08.876364 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.876337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerStarted","Data":"73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f"}
Jul 22 16:24:08.876492 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.876405    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerStarted","Data":"664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b"}
Jul 22 16:24:08.876492 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.876448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerStarted","Data":"cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2"}
Jul 22 16:24:08.876601 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.876492    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerStarted","Data":"ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b"}
Jul 22 16:24:08.878860 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.878835    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf"
Jul 22 16:24:08.879119 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.879097    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg" event={"ID":"6863f7ee-c966-4e64-b433-52c305dd55a2","Type":"ContainerStarted","Data":"ffc1cee35840f4dbdc88c34c047285934f16813651b4d1b22efb474684d2ca5f"}
Jul 22 16:24:08.879215 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.879144    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg" event={"ID":"6863f7ee-c966-4e64-b433-52c305dd55a2","Type":"ContainerStarted","Data":"b00807cd203ae4be5ce333a1af7ff8d3a20027e3812c619c744662d7bfb08de0"}
Jul 22 16:24:08.879215 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.879175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg" event={"ID":"6863f7ee-c966-4e64-b433-52c305dd55a2","Type":"ContainerStarted","Data":"ea91550bfa2c610ea506a8cab5d09d3e64234fcba2d4596214b55be3be2a3087"}
Jul 22 16:24:08.880590 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.880560    2580 generic.go:356] "Generic (PLEG): container finished" podID="71e22c1e-d766-44f7-a696-0bade791739a" containerID="f9b30e16c64d45bf10460abffac8eb9bbca02c643e72ea6deb458fc66979f25a" exitCode=0
Jul 22 16:24:08.880740 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.880641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerDied","Data":"f9b30e16c64d45bf10460abffac8eb9bbca02c643e72ea6deb458fc66979f25a"}
Jul 22 16:24:08.894582 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.894544    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl" podStartSLOduration=3.046999674 podStartE2EDuration="4.894530071s" totalImagesPullingTime="1.847530397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:07.877434002 +0000 UTC m=+77.229710023" watchObservedRunningTime="2026-07-22 16:24:08.894530071 +0000 UTC m=+78.246806097"
Jul 22 16:24:08.895198 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.895133    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq" podStartSLOduration=2.981287217 podStartE2EDuration="6.895121859s" totalImagesPullingTime="3.913834642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:24:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:08.89403928 +0000 UTC m=+78.246315293" watchObservedRunningTime="2026-07-22 16:24:08.895121859 +0000 UTC m=+78.247397879"
Jul 22 16:24:08.923705 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.923660    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.808068888 podStartE2EDuration="7.923646741s" totalImagesPullingTime="4.105947605s" totalInitContainerRuntime="9.630248ms" isStatefulPod=false podCreationTimestamp="2026-07-22 16:24:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:08.92169232 +0000 UTC m=+78.273968339" watchObservedRunningTime="2026-07-22 16:24:08.923646741 +0000 UTC m=+78.275922761"
Jul 22 16:24:08.942398 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.942357    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hmwzf" podStartSLOduration=1.646072639 podStartE2EDuration="3.9423444s" totalImagesPullingTime="2.296271761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:08.941841092 +0000 UTC m=+78.294117114" watchObservedRunningTime="2026-07-22 16:24:08.9423444 +0000 UTC m=+78.294620453"
Jul 22 16:24:08.964614 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:08.964564    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8bd5465d9-s47tg" podStartSLOduration=1.8210618840000001 podStartE2EDuration="3.964548462s" totalImagesPullingTime="2.143486578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:08.9636072 +0000 UTC m=+78.315883221" watchObservedRunningTime="2026-07-22 16:24:08.964548462 +0000 UTC m=+78.316824478"
Jul 22 16:24:12.903338 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:12.903305    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerStarted","Data":"f2a3f0ac0b62b63be5ad6fbfb1cff5cd896a6f7999b37f744b5221cf8521a28a"}
Jul 22 16:24:12.903679 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:12.903401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerStarted","Data":"22bdf45f5dfe1bb5a015ce6cddab4dbd50dc07f76707593fb64fb8e45ee230a6"}
Jul 22 16:24:12.903679 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:12.903428    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerStarted","Data":"cb12cadb17c018352dc60bf03c5e202408a26b59223508ee6c967cfdd9a2a23e"}
Jul 22 16:24:12.903679 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:12.903453    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerStarted","Data":"9bee1adddde17b9931e40bee0ee020eac76479bc1dfe1061eef393ca527cdd0a"}
Jul 22 16:24:12.903679 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:12.903487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerStarted","Data":"69eec938a0e9b5e4d8843576b3f1762a0370eb6edc08630906799f370b5ee5bd"}
Jul 22 16:24:12.903679 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:12.903515    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerStarted","Data":"7f00dd1cf7995da5ece11657bb470c551d840b35f60f14c99e3c33c97471bb81"}
Jul 22 16:24:12.935612 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:12.935562    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.408190053 podStartE2EDuration="6.935541314s" totalImagesPullingTime="3.498873332s" totalInitContainerRuntime="28.477929ms" isStatefulPod=false podCreationTimestamp="2026-07-22 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:24:12.932886902 +0000 UTC m=+82.285162953" watchObservedRunningTime="2026-07-22 16:24:12.935541314 +0000 UTC m=+82.287817335"
Jul 22 16:24:14.891875 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:14.891841    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-9d846c47-6h5tq"
Jul 22 16:24:16.983132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:16.983099    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:25.050291 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:25.050235    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:25.050824 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:25.050328    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:31.782682 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:31.782651    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ls2js"
Jul 22 16:24:34.918477 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:34.918441    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed/init-config-reloader/0.log"
Jul 22 16:24:35.118493 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:35.118458    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed/alertmanager/0.log"
Jul 22 16:24:35.319300 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:35.319221    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed/config-reloader/0.log"
Jul 22 16:24:35.518764 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:35.518721    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed/kube-rbac-proxy-web/0.log"
Jul 22 16:24:35.719259 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:35.719229    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed/kube-rbac-proxy/0.log"
Jul 22 16:24:35.918757 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:35.918721    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed/kube-rbac-proxy-metric/0.log"
Jul 22 16:24:36.118999 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:36.118930    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed/prom-label-proxy/0.log"
Jul 22 16:24:36.518879 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:36.518851    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-wfmdq_3f92cae0-2bcd-4330-8786-ddea0a803ea7/kube-state-metrics/0.log"
Jul 22 16:24:36.719158 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:36.719129    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-wfmdq_3f92cae0-2bcd-4330-8786-ddea0a803ea7/kube-rbac-proxy-main/0.log"
Jul 22 16:24:36.919274 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:36.919247    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-wfmdq_3f92cae0-2bcd-4330-8786-ddea0a803ea7/kube-rbac-proxy-self/0.log"
Jul 22 16:24:37.118163 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:37.118136    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c75c584d6-8hkbl_ad098e57-57db-497b-85d3-a919ecbf3dce/metrics-server/0.log"
Jul 22 16:24:37.319655 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:37.319587    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-hmwzf_39de0651-9bb7-4640-a69f-94c984485dd9/monitoring-plugin/0.log"
Jul 22 16:24:38.718626 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:38.718594    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q7jnp_2aa76515-4335-4435-ab78-78492c7b83f8/init-textfile/0.log"
Jul 22 16:24:38.919827 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:38.919796    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q7jnp_2aa76515-4335-4435-ab78-78492c7b83f8/node-exporter/0.log"
Jul 22 16:24:39.120546 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:39.120472    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q7jnp_2aa76515-4335-4435-ab78-78492c7b83f8/kube-rbac-proxy/0.log"
Jul 22 16:24:39.319556 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:39.319529    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4m6f7_208a0947-cccd-4830-a739-683d3c8a6dac/kube-rbac-proxy-main/0.log"
Jul 22 16:24:39.519133 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:39.519102    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4m6f7_208a0947-cccd-4830-a739-683d3c8a6dac/kube-rbac-proxy-self/0.log"
Jul 22 16:24:39.719352 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:39.719326    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4m6f7_208a0947-cccd-4830-a739-683d3c8a6dac/openshift-state-metrics/0.log"
Jul 22 16:24:39.919103 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:39.919077    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_71e22c1e-d766-44f7-a696-0bade791739a/init-config-reloader/0.log"
Jul 22 16:24:40.119483 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:40.119450    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_71e22c1e-d766-44f7-a696-0bade791739a/prometheus/0.log"
Jul 22 16:24:40.319447 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:40.319380    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_71e22c1e-d766-44f7-a696-0bade791739a/config-reloader/0.log"
Jul 22 16:24:40.518791 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:40.518763    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_71e22c1e-d766-44f7-a696-0bade791739a/thanos-sidecar/0.log"
Jul 22 16:24:40.719137 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:40.719106    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_71e22c1e-d766-44f7-a696-0bade791739a/kube-rbac-proxy-web/0.log"
Jul 22 16:24:40.919216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:40.919190    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_71e22c1e-d766-44f7-a696-0bade791739a/kube-rbac-proxy/0.log"
Jul 22 16:24:41.119300 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:41.119219    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_71e22c1e-d766-44f7-a696-0bade791739a/kube-rbac-proxy-thanos/0.log"
Jul 22 16:24:41.322273 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:41.322246    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-wj5zd_507c9870-86fa-4388-b8ba-433bc5c528dd/prometheus-operator/0.log"
Jul 22 16:24:41.518701 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:41.518666    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-wj5zd_507c9870-86fa-4388-b8ba-433bc5c528dd/kube-rbac-proxy/0.log"
Jul 22 16:24:41.718922 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:41.718850    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-4dfkr_ae1613d5-4a55-4aac-8fc1-3723fd760a24/prometheus-operator-admission-webhook/0.log"
Jul 22 16:24:41.918714 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:41.918683    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8bd5465d9-s47tg_6863f7ee-c966-4e64-b433-52c305dd55a2/telemeter-client/0.log"
Jul 22 16:24:42.119480 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:42.119447    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8bd5465d9-s47tg_6863f7ee-c966-4e64-b433-52c305dd55a2/reload/0.log"
Jul 22 16:24:42.318868 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:42.318762    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8bd5465d9-s47tg_6863f7ee-c966-4e64-b433-52c305dd55a2/kube-rbac-proxy/0.log"
Jul 22 16:24:42.523036 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:42.522988    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9d846c47-6h5tq_be3261be-5dcd-4bef-9ead-16434d548b18/thanos-query/0.log"
Jul 22 16:24:42.719173 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:42.719146    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9d846c47-6h5tq_be3261be-5dcd-4bef-9ead-16434d548b18/kube-rbac-proxy-web/0.log"
Jul 22 16:24:42.920228 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:42.920201    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9d846c47-6h5tq_be3261be-5dcd-4bef-9ead-16434d548b18/kube-rbac-proxy/0.log"
Jul 22 16:24:43.118440 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:43.118367    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9d846c47-6h5tq_be3261be-5dcd-4bef-9ead-16434d548b18/prom-label-proxy/0.log"
Jul 22 16:24:43.318408 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:43.318377    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9d846c47-6h5tq_be3261be-5dcd-4bef-9ead-16434d548b18/kube-rbac-proxy-rules/0.log"
Jul 22 16:24:43.519573 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:43.519545    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9d846c47-6h5tq_be3261be-5dcd-4bef-9ead-16434d548b18/kube-rbac-proxy-metrics/0.log"
Jul 22 16:24:45.054640 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:45.054613    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:45.058410 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:45.058385    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c75c584d6-8hkbl"
Jul 22 16:24:45.119207 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:24:45.119182    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5bb8q_5f5cfb28-29dd-42d3-8eba-1154596ddbe7/serve-healthcheck-canary/0.log"
Jul 22 16:25:06.983315 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:06.983268    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:07.003127 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:07.003100    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:07.139946 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:07.139919    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:20.729001 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:20.728968    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 16:25:20.729533 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:20.729282    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="alertmanager" containerID="cri-o://260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76" gracePeriod=120
Jul 22 16:25:20.729533 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:20.729347    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="kube-rbac-proxy-metric" containerID="cri-o://664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b" gracePeriod=120
Jul 22 16:25:20.729533 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:20.729379    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="kube-rbac-proxy-web" containerID="cri-o://ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b" gracePeriod=120
Jul 22 16:25:20.729533 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:20.729406    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="prom-label-proxy" containerID="cri-o://73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f" gracePeriod=120
Jul 22 16:25:20.729533 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:20.729452    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="config-reloader" containerID="cri-o://2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860" gracePeriod=120
Jul 22 16:25:20.729533 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:20.729421    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="kube-rbac-proxy" containerID="cri-o://cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2" gracePeriod=120
Jul 22 16:25:21.189713 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:21.189680    2580 generic.go:356] "Generic (PLEG): container finished" podID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerID="73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f" exitCode=0
Jul 22 16:25:21.189713 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:21.189705    2580 generic.go:356] "Generic (PLEG): container finished" podID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerID="cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2" exitCode=0
Jul 22 16:25:21.189713 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:21.189711    2580 generic.go:356] "Generic (PLEG): container finished" podID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerID="2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860" exitCode=0
Jul 22 16:25:21.189713 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:21.189717    2580 generic.go:356] "Generic (PLEG): container finished" podID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerID="260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76" exitCode=0
Jul 22 16:25:21.189971 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:21.189750    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerDied","Data":"73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f"}
Jul 22 16:25:21.189971 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:21.189816    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerDied","Data":"cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2"}
Jul 22 16:25:21.189971 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:21.189843    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerDied","Data":"2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860"}
Jul 22 16:25:21.189971 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:21.189867    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerDied","Data":"260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76"}
Jul 22 16:25:21.974487 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:21.974456    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.028554 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028521    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") "
Jul 22 16:25:22.028737 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028567    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-cluster-tls-config\") pod \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") "
Jul 22 16:25:22.028737 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028602    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-metrics-client-ca\") pod \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") "
Jul 22 16:25:22.028737 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028632    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy\") pod \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") "
Jul 22 16:25:22.028737 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028673    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-main-tls\") pod \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") "
Jul 22 16:25:22.028737 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028706    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-alertmanager-trusted-ca-bundle\") pod \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") "
Jul 22 16:25:22.029052 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028742    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-web-config\") pod \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") "
Jul 22 16:25:22.029052 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028771    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-config-volume\") pod \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") "
Jul 22 16:25:22.029052 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028809    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") "
Jul 22 16:25:22.029052 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028843    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-alertmanager-main-db\") pod \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") "
Jul 22 16:25:22.029052 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028890    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-config-out\") pod \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") "
Jul 22 16:25:22.029052 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028914    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59hxv\" (UniqueName: \"kubernetes.io/projected/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-kube-api-access-59hxv\") pod \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") "
Jul 22 16:25:22.029052 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028980    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-tls-assets\") pod \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\" (UID: \"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed\") "
Jul 22 16:25:22.029052 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.028988    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" (UID: "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:25:22.029430 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.029283    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-metrics-client-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:22.029430 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.029347    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" (UID: "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:25:22.029430 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.029405    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" (UID: "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:25:22.031732 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.031682    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" (UID: "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:22.032314 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.032284    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" (UID: "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:22.032431 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.032349    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" (UID: "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:25:22.032882 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.032801    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" (UID: "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:22.033241 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.033166    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-config-out" (OuterVolumeSpecName: "config-out") pod "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" (UID: "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:25:22.033561 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.033465    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" (UID: "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:22.033561 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.033475    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-kube-api-access-59hxv" (OuterVolumeSpecName: "kube-api-access-59hxv") pod "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" (UID: "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed"). InnerVolumeSpecName "kube-api-access-59hxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:25:22.033782 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.033762    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-config-volume" (OuterVolumeSpecName: "config-volume") pod "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" (UID: "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:22.038110 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.038088    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" (UID: "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:22.046332 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.046304    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-web-config" (OuterVolumeSpecName: "web-config") pod "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" (UID: "35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:22.130250 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.130220    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:22.130250 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.130250    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-alertmanager-main-db\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:22.130437 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.130261    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-config-out\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:22.130437 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.130270    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59hxv\" (UniqueName: \"kubernetes.io/projected/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-kube-api-access-59hxv\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:22.130437 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.130279    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-tls-assets\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:22.130437 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.130299    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:22.130437 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.130311    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-cluster-tls-config\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:22.130437 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.130320    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:22.130437 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.130328    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-secret-alertmanager-main-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:22.130437 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.130337    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:22.130437 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.130346    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-web-config\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:22.130437 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.130353    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed-config-volume\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:22.197057 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.197007    2580 generic.go:356] "Generic (PLEG): container finished" podID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerID="664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b" exitCode=0
Jul 22 16:25:22.197057 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.197045    2580 generic.go:356] "Generic (PLEG): container finished" podID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerID="ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b" exitCode=0
Jul 22 16:25:22.197057 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.197049    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerDied","Data":"664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b"}
Jul 22 16:25:22.197298 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.197112    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.197298 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.197121    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerDied","Data":"ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b"}
Jul 22 16:25:22.197298 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.197150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed","Type":"ContainerDied","Data":"cde10d86bbea50fa1754f2995b8ee98cc7bcdc2c1aa5dacd79ca561a6e9865d1"}
Jul 22 16:25:22.197298 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.197180    2580 scope.go:117] "RemoveContainer" containerID="73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f"
Jul 22 16:25:22.204988 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.204971    2580 scope.go:117] "RemoveContainer" containerID="664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b"
Jul 22 16:25:22.212289 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.212273    2580 scope.go:117] "RemoveContainer" containerID="cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2"
Jul 22 16:25:22.219177 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.219151    2580 scope.go:117] "RemoveContainer" containerID="ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b"
Jul 22 16:25:22.221731 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.221712    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 16:25:22.226333 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.226308    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 16:25:22.227749 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.227734    2580 scope.go:117] "RemoveContainer" containerID="2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860"
Jul 22 16:25:22.234764 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.234747    2580 scope.go:117] "RemoveContainer" containerID="260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76"
Jul 22 16:25:22.242296 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.242278    2580 scope.go:117] "RemoveContainer" containerID="602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a"
Jul 22 16:25:22.249138 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.249117    2580 scope.go:117] "RemoveContainer" containerID="73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f"
Jul 22 16:25:22.249478 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:25:22.249447    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f\": container with ID starting with 73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f not found: ID does not exist" containerID="73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f"
Jul 22 16:25:22.249581 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.249487    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f"} err="failed to get container status \"73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f\": rpc error: code = NotFound desc = could not find container \"73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f\": container with ID starting with 73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f not found: ID does not exist"
Jul 22 16:25:22.249581 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.249544    2580 scope.go:117] "RemoveContainer" containerID="664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b"
Jul 22 16:25:22.249851 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:25:22.249824    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b\": container with ID starting with 664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b not found: ID does not exist" containerID="664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b"
Jul 22 16:25:22.249955 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.249860    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b"} err="failed to get container status \"664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b\": rpc error: code = NotFound desc = could not find container \"664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b\": container with ID starting with 664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b not found: ID does not exist"
Jul 22 16:25:22.249955 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.249891    2580 scope.go:117] "RemoveContainer" containerID="cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2"
Jul 22 16:25:22.250213 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:25:22.250182    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2\": container with ID starting with cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2 not found: ID does not exist" containerID="cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2"
Jul 22 16:25:22.250281 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.250219    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2"} err="failed to get container status \"cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2\": rpc error: code = NotFound desc = could not find container \"cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2\": container with ID starting with cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2 not found: ID does not exist"
Jul 22 16:25:22.250281 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.250236    2580 scope.go:117] "RemoveContainer" containerID="ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b"
Jul 22 16:25:22.250445 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:25:22.250430    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b\": container with ID starting with ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b not found: ID does not exist" containerID="ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b"
Jul 22 16:25:22.250500 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.250446    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b"} err="failed to get container status \"ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b\": rpc error: code = NotFound desc = could not find container \"ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b\": container with ID starting with ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b not found: ID does not exist"
Jul 22 16:25:22.250500 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.250458    2580 scope.go:117] "RemoveContainer" containerID="2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860"
Jul 22 16:25:22.250694 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:25:22.250675    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860\": container with ID starting with 2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860 not found: ID does not exist" containerID="2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860"
Jul 22 16:25:22.250751 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.250696    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860"} err="failed to get container status \"2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860\": rpc error: code = NotFound desc = could not find container \"2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860\": container with ID starting with 2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860 not found: ID does not exist"
Jul 22 16:25:22.250751 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.250708    2580 scope.go:117] "RemoveContainer" containerID="260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76"
Jul 22 16:25:22.250843 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.250774    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 16:25:22.250987 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:25:22.250963    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76\": container with ID starting with 260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76 not found: ID does not exist" containerID="260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76"
Jul 22 16:25:22.251062 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.250997    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76"} err="failed to get container status \"260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76\": rpc error: code = NotFound desc = could not find container \"260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76\": container with ID starting with 260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76 not found: ID does not exist"
Jul 22 16:25:22.251062 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.251042    2580 scope.go:117] "RemoveContainer" containerID="602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255246    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="alertmanager"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255273    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="alertmanager"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255296    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="kube-rbac-proxy-web"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255307    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="kube-rbac-proxy-web"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255332    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="kube-rbac-proxy"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255340    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="kube-rbac-proxy"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255381    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="init-config-reloader"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255396    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="init-config-reloader"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255409    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="prom-label-proxy"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255417    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="prom-label-proxy"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255427    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="config-reloader"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255435    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="config-reloader"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255459    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="kube-rbac-proxy-metric"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255468    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="kube-rbac-proxy-metric"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255605    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="kube-rbac-proxy-web"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255620    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="kube-rbac-proxy"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255637    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="config-reloader"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255646    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="alertmanager"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255662    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="kube-rbac-proxy-metric"
Jul 22 16:25:22.256064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.255671    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" containerName="prom-label-proxy"
Jul 22 16:25:22.256939 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:25:22.256147    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a\": container with ID starting with 602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a not found: ID does not exist" containerID="602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a"
Jul 22 16:25:22.256939 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.256230    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a"} err="failed to get container status \"602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a\": rpc error: code = NotFound desc = could not find container \"602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a\": container with ID starting with 602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a not found: ID does not exist"
Jul 22 16:25:22.258313 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.256437    2580 scope.go:117] "RemoveContainer" containerID="73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f"
Jul 22 16:25:22.258601 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.258570    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f"} err="failed to get container status \"73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f\": rpc error: code = NotFound desc = could not find container \"73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f\": container with ID starting with 73603932e11fd7df28079e4e494a00395bb6ac0e791db3ffba6412149831199f not found: ID does not exist"
Jul 22 16:25:22.258601 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.258599    2580 scope.go:117] "RemoveContainer" containerID="664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b"
Jul 22 16:25:22.258907 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.258888    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b"} err="failed to get container status \"664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b\": rpc error: code = NotFound desc = could not find container \"664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b\": container with ID starting with 664b737d3264a64424caf6ca6e9e4e6f2149ba3ced6425684d4010783dd95a5b not found: ID does not exist"
Jul 22 16:25:22.258983 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.258909    2580 scope.go:117] "RemoveContainer" containerID="cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2"
Jul 22 16:25:22.259196 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.259174    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2"} err="failed to get container status \"cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2\": rpc error: code = NotFound desc = could not find container \"cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2\": container with ID starting with cf9aec57748b316ba58cd1985a0b295b7551d0731b14bd84423e521de3112ed2 not found: ID does not exist"
Jul 22 16:25:22.259334 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.259199    2580 scope.go:117] "RemoveContainer" containerID="ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b"
Jul 22 16:25:22.259470 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.259450    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b"} err="failed to get container status \"ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b\": rpc error: code = NotFound desc = could not find container \"ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b\": container with ID starting with ca2ae34a90577c3ae9b0c9ec18d70a4504ac273cfab388b22c36f803660cd65b not found: ID does not exist"
Jul 22 16:25:22.259470 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.259468    2580 scope.go:117] "RemoveContainer" containerID="2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860"
Jul 22 16:25:22.259707 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.259683    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860"} err="failed to get container status \"2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860\": rpc error: code = NotFound desc = could not find container \"2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860\": container with ID starting with 2b13288d27e06a9a44f0309294a2e1400f23030f1e55e9f2c765b33996d0f860 not found: ID does not exist"
Jul 22 16:25:22.259760 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.259710    2580 scope.go:117] "RemoveContainer" containerID="260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76"
Jul 22 16:25:22.259987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.259952    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76"} err="failed to get container status \"260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76\": rpc error: code = NotFound desc = could not find container \"260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76\": container with ID starting with 260f2ba53be6c59e8e340076458d7d472c1acd5adce0ca4c4ec7ec27eef2ca76 not found: ID does not exist"
Jul 22 16:25:22.260098 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.259989    2580 scope.go:117] "RemoveContainer" containerID="602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a"
Jul 22 16:25:22.260249 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.260233    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a"} err="failed to get container status \"602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a\": rpc error: code = NotFound desc = could not find container \"602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a\": container with ID starting with 602e129594d3c2d21092917e2eaf1caa4b9784b00c522ea8765edc8fc7b30c5a not found: ID does not exist"
Jul 22 16:25:22.260883 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.260869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.263487 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.263464    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 16:25:22.263589 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.263490    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 16:25:22.263589 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.263512    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 16:25:22.263589 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.263470    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 16:25:22.263589 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.263517    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 16:25:22.263751 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.263474    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 16:25:22.263907 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.263886    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 16:25:22.264014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.263990    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 16:25:22.264242 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.264224    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d2pmn\""
Jul 22 16:25:22.269097 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.269002    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 16:25:22.269196 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.269177    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 16:25:22.332062 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.331969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvmv6\" (UniqueName: \"kubernetes.io/projected/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-kube-api-access-vvmv6\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.332062 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.332031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.332258 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.332070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-web-config\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.332258 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.332096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.332258 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.332125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-config-out\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.332258 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.332145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.332258 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.332167    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.332258 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.332202    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.332258 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.332239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.332467 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.332281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.332467 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.332327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.332467 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.332355    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.332467 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.332396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.433352 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.433321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.433352 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.433360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-web-config\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.433582 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.433380    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.433582 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.433410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-config-out\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.433582 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.433434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.433582 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.433458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.433582 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.433481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.433582 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.433503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.433844 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.433637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.433844 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.433689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.434873 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.434098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.434873 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.434158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.434873 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.434218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvmv6\" (UniqueName: \"kubernetes.io/projected/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-kube-api-access-vvmv6\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.434873 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.434516    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.434873 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.434806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.435280 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.435122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.436552 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.436487    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.436552 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.436506    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-config-out\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.436738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.436651    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.436799 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.436780    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.436799 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.436786    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.437459 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.437440    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.437546 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.437442    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-web-config\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.437620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.437598    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.437970 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.437949    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.443984 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.443967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvmv6\" (UniqueName: \"kubernetes.io/projected/e64f9da1-af5a-4f1d-afe8-8566ddaa824b-kube-api-access-vvmv6\") pod \"alertmanager-main-0\" (UID: \"e64f9da1-af5a-4f1d-afe8-8566ddaa824b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.572100 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.572068    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 16:25:22.711039 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:22.708041    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 16:25:22.729455 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:25:22.712661    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64f9da1_af5a_4f1d_afe8_8566ddaa824b.slice/crio-5c497972b869a0d7c01d36ca2ac90cc2e2ab7dae5d60231a45fc880494dd6990 WatchSource:0}: Error finding container 5c497972b869a0d7c01d36ca2ac90cc2e2ab7dae5d60231a45fc880494dd6990: Status 404 returned error can't find the container with id 5c497972b869a0d7c01d36ca2ac90cc2e2ab7dae5d60231a45fc880494dd6990
Jul 22 16:25:23.202711 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:23.202676    2580 generic.go:356] "Generic (PLEG): container finished" podID="e64f9da1-af5a-4f1d-afe8-8566ddaa824b" containerID="8f6fdc0f55562993c02df16612246b7968428af644e4cf8b44e12d4b31db32f6" exitCode=0
Jul 22 16:25:23.203193 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:23.202733    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64f9da1-af5a-4f1d-afe8-8566ddaa824b","Type":"ContainerDied","Data":"8f6fdc0f55562993c02df16612246b7968428af644e4cf8b44e12d4b31db32f6"}
Jul 22 16:25:23.203193 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:23.202797    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64f9da1-af5a-4f1d-afe8-8566ddaa824b","Type":"ContainerStarted","Data":"5c497972b869a0d7c01d36ca2ac90cc2e2ab7dae5d60231a45fc880494dd6990"}
Jul 22 16:25:23.371770 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:23.371746    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed" path="/var/lib/kubelet/pods/35c3a09a-fd5a-414f-b6ba-c58fe3f1e6ed/volumes"
Jul 22 16:25:24.211712 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.211679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64f9da1-af5a-4f1d-afe8-8566ddaa824b","Type":"ContainerStarted","Data":"5041de98b3f92da3487e1bf3090ef12bc6eb233198d3b059f06db4a2d1576729"}
Jul 22 16:25:24.212085 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.211744    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64f9da1-af5a-4f1d-afe8-8566ddaa824b","Type":"ContainerStarted","Data":"da9d60c522d3da28594831f774f8d58cfcfac4c6f273c9be7038c733fbf06019"}
Jul 22 16:25:24.212085 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.211774    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64f9da1-af5a-4f1d-afe8-8566ddaa824b","Type":"ContainerStarted","Data":"34bb0ccd618f511faeea68cdd21ffb25ab29b39ab95e139954fb721ae59a8bca"}
Jul 22 16:25:24.212085 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.211803    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64f9da1-af5a-4f1d-afe8-8566ddaa824b","Type":"ContainerStarted","Data":"6ee3ed9f4ce88396816a4cebf085db4d8cd3280f53487c82fd7ff0bc5e4c9e73"}
Jul 22 16:25:24.212085 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.211826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64f9da1-af5a-4f1d-afe8-8566ddaa824b","Type":"ContainerStarted","Data":"ebf42185389ba6cb7934725db94d2ab742770ccb2f25fc0d7959fb5b4f3d33bf"}
Jul 22 16:25:24.212085 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.211854    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64f9da1-af5a-4f1d-afe8-8566ddaa824b","Type":"ContainerStarted","Data":"78069216c02cd1f2f06c5316c2d765a9c80fdaf1062e2bcbf5eb1319bf1feec9"}
Jul 22 16:25:24.238186 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.238135    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.223221892 podStartE2EDuration="2.238113446s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.891554ms" isStatefulPod=false podCreationTimestamp="2026-07-22 16:25:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:25:24.23611643 +0000 UTC m=+153.588392456" watchObservedRunningTime="2026-07-22 16:25:24.238113446 +0000 UTC m=+153.590389468"
Jul 22 16:25:24.969739 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.969701    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:25:24.970179 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.970126    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="prometheus" containerID="cri-o://7f00dd1cf7995da5ece11657bb470c551d840b35f60f14c99e3c33c97471bb81" gracePeriod=600
Jul 22 16:25:24.970356 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.970333    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f2a3f0ac0b62b63be5ad6fbfb1cff5cd896a6f7999b37f744b5221cf8521a28a" gracePeriod=600
Jul 22 16:25:24.970512 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.970474    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="thanos-sidecar" containerID="cri-o://9bee1adddde17b9931e40bee0ee020eac76479bc1dfe1061eef393ca527cdd0a" gracePeriod=600
Jul 22 16:25:24.971067 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.970500    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="config-reloader" containerID="cri-o://69eec938a0e9b5e4d8843576b3f1762a0370eb6edc08630906799f370b5ee5bd" gracePeriod=600
Jul 22 16:25:24.971164 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.970820    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="kube-rbac-proxy" containerID="cri-o://22bdf45f5dfe1bb5a015ce6cddab4dbd50dc07f76707593fb64fb8e45ee230a6" gracePeriod=600
Jul 22 16:25:24.971294 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:24.970885    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="kube-rbac-proxy-web" containerID="cri-o://cb12cadb17c018352dc60bf03c5e202408a26b59223508ee6c967cfdd9a2a23e" gracePeriod=600
Jul 22 16:25:25.222992 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.222905    2580 generic.go:356] "Generic (PLEG): container finished" podID="71e22c1e-d766-44f7-a696-0bade791739a" containerID="f2a3f0ac0b62b63be5ad6fbfb1cff5cd896a6f7999b37f744b5221cf8521a28a" exitCode=0
Jul 22 16:25:25.222992 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.222947    2580 generic.go:356] "Generic (PLEG): container finished" podID="71e22c1e-d766-44f7-a696-0bade791739a" containerID="22bdf45f5dfe1bb5a015ce6cddab4dbd50dc07f76707593fb64fb8e45ee230a6" exitCode=0
Jul 22 16:25:25.222992 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.222956    2580 generic.go:356] "Generic (PLEG): container finished" podID="71e22c1e-d766-44f7-a696-0bade791739a" containerID="cb12cadb17c018352dc60bf03c5e202408a26b59223508ee6c967cfdd9a2a23e" exitCode=0
Jul 22 16:25:25.222992 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.222962    2580 generic.go:356] "Generic (PLEG): container finished" podID="71e22c1e-d766-44f7-a696-0bade791739a" containerID="9bee1adddde17b9931e40bee0ee020eac76479bc1dfe1061eef393ca527cdd0a" exitCode=0
Jul 22 16:25:25.222992 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.222968    2580 generic.go:356] "Generic (PLEG): container finished" podID="71e22c1e-d766-44f7-a696-0bade791739a" containerID="69eec938a0e9b5e4d8843576b3f1762a0370eb6edc08630906799f370b5ee5bd" exitCode=0
Jul 22 16:25:25.222992 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.222977    2580 generic.go:356] "Generic (PLEG): container finished" podID="71e22c1e-d766-44f7-a696-0bade791739a" containerID="7f00dd1cf7995da5ece11657bb470c551d840b35f60f14c99e3c33c97471bb81" exitCode=0
Jul 22 16:25:25.223564 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.222999    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerDied","Data":"f2a3f0ac0b62b63be5ad6fbfb1cff5cd896a6f7999b37f744b5221cf8521a28a"}
Jul 22 16:25:25.223564 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.223089    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerDied","Data":"22bdf45f5dfe1bb5a015ce6cddab4dbd50dc07f76707593fb64fb8e45ee230a6"}
Jul 22 16:25:25.223564 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.223129    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerDied","Data":"cb12cadb17c018352dc60bf03c5e202408a26b59223508ee6c967cfdd9a2a23e"}
Jul 22 16:25:25.223564 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.223166    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerDied","Data":"9bee1adddde17b9931e40bee0ee020eac76479bc1dfe1061eef393ca527cdd0a"}
Jul 22 16:25:25.223564 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.223202    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerDied","Data":"69eec938a0e9b5e4d8843576b3f1762a0370eb6edc08630906799f370b5ee5bd"}
Jul 22 16:25:25.223564 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.223240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerDied","Data":"7f00dd1cf7995da5ece11657bb470c551d840b35f60f14c99e3c33c97471bb81"}
Jul 22 16:25:25.229404 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.229384    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:25.359278 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.359247    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71e22c1e-d766-44f7-a696-0bade791739a-tls-assets\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.359446 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.359289    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-serving-certs-ca-bundle\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.359446 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.359317    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-kube-rbac-proxy\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.359446 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.359359    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-metrics-client-ca\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.359446 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.359384    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71e22c1e-d766-44f7-a696-0bade791739a-config-out\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.359446 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.359430    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-metrics-client-certs\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.359684 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.359491    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-1\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.359684 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.359520    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-tls\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.359684 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.359603    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-thanos-prometheus-http-client-file\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.359684 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.359667    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:25:25.359893 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.359772    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:25:25.359946 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.359902    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:25:25.359997 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.359958    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-config\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.360301 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.360277    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpzqc\" (UniqueName: \"kubernetes.io/projected/71e22c1e-d766-44f7-a696-0bade791739a-kube-api-access-qpzqc\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.360397 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.360346    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-trusted-ca-bundle\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.360464 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.360395    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.360464 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.360453    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-db\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.360566 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.360501    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-2\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.360566 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.360550    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.360694 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.360675    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-0\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.360749 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.360714    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-kubelet-serving-ca-bundle\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.360749 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.360739    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-grpc-tls\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.360854 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.360745    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:25:25.360854 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.360798    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-web-config\") pod \"71e22c1e-d766-44f7-a696-0bade791739a\" (UID: \"71e22c1e-d766-44f7-a696-0bade791739a\") "
Jul 22 16:25:25.361187 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.361157    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:25:25.361187 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.361172    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:25:25.361315 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.361300    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.361362 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.361320    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.361362 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.361334    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.361362 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.361348    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.361498 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.361362    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.361498 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.361377    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-configmap-metrics-client-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.362707 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.361904    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71e22c1e-d766-44f7-a696-0bade791739a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:25:25.362707 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.362420    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:25:25.362707 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.362468    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:25.362707 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.362486    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:25:25.363223 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.363182    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71e22c1e-d766-44f7-a696-0bade791739a-config-out" (OuterVolumeSpecName: "config-out") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:25:25.363460 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.363404    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:25.363742 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.363708    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:25.364077 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.364051    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:25.364248 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.364223    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-config" (OuterVolumeSpecName: "config") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:25.364841 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.364821    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:25.364930 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.364901    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:25.364975 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.364924    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71e22c1e-d766-44f7-a696-0bade791739a-kube-api-access-qpzqc" (OuterVolumeSpecName: "kube-api-access-qpzqc") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "kube-api-access-qpzqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:25:25.365008 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.364964    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:25.375572 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.375538    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-web-config" (OuterVolumeSpecName: "web-config") pod "71e22c1e-d766-44f7-a696-0bade791739a" (UID: "71e22c1e-d766-44f7-a696-0bade791739a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:25:25.462223 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462177    2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-grpc-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.462223 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462218    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-web-config\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.462223 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462230    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71e22c1e-d766-44f7-a696-0bade791739a-tls-assets\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.462223 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462239    2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-kube-rbac-proxy\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.462462 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462248    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71e22c1e-d766-44f7-a696-0bade791739a-config-out\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.462462 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462256    2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-metrics-client-certs\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.462462 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462266    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.462462 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462275    2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.462462 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462285    2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-config\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.462462 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462293    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpzqc\" (UniqueName: \"kubernetes.io/projected/71e22c1e-d766-44f7-a696-0bade791739a-kube-api-access-qpzqc\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.462462 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462302    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.462462 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462310    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-db\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.462462 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462319    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71e22c1e-d766-44f7-a696-0bade791739a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:25.462462 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:25.462329    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/71e22c1e-d766-44f7-a696-0bade791739a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:25:26.230732 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.230700    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"71e22c1e-d766-44f7-a696-0bade791739a","Type":"ContainerDied","Data":"e73b31a2bd969c4a6baa2d97f3e597a1819c80f62eb7615c7cd616addff01750"}
Jul 22 16:25:26.231204 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.230745    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.231204 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.230776    2580 scope.go:117] "RemoveContainer" containerID="f2a3f0ac0b62b63be5ad6fbfb1cff5cd896a6f7999b37f744b5221cf8521a28a"
Jul 22 16:25:26.239239 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.239218    2580 scope.go:117] "RemoveContainer" containerID="22bdf45f5dfe1bb5a015ce6cddab4dbd50dc07f76707593fb64fb8e45ee230a6"
Jul 22 16:25:26.245996 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.245977    2580 scope.go:117] "RemoveContainer" containerID="cb12cadb17c018352dc60bf03c5e202408a26b59223508ee6c967cfdd9a2a23e"
Jul 22 16:25:26.252973 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.252956    2580 scope.go:117] "RemoveContainer" containerID="9bee1adddde17b9931e40bee0ee020eac76479bc1dfe1061eef393ca527cdd0a"
Jul 22 16:25:26.253781 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.253761    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:25:26.258474 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.258453    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:25:26.260313 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.260290    2580 scope.go:117] "RemoveContainer" containerID="69eec938a0e9b5e4d8843576b3f1762a0370eb6edc08630906799f370b5ee5bd"
Jul 22 16:25:26.266771 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.266755    2580 scope.go:117] "RemoveContainer" containerID="7f00dd1cf7995da5ece11657bb470c551d840b35f60f14c99e3c33c97471bb81"
Jul 22 16:25:26.274102 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.274084    2580 scope.go:117] "RemoveContainer" containerID="f9b30e16c64d45bf10460abffac8eb9bbca02c643e72ea6deb458fc66979f25a"
Jul 22 16:25:26.286684 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.286664    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:25:26.286986 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.286974    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="init-config-reloader"
Jul 22 16:25:26.287064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.286988    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="init-config-reloader"
Jul 22 16:25:26.287064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287004    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="prometheus"
Jul 22 16:25:26.287064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287010    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="prometheus"
Jul 22 16:25:26.287064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287046    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="config-reloader"
Jul 22 16:25:26.287064 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287056    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="config-reloader"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287070    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="kube-rbac-proxy-web"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287079    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="kube-rbac-proxy-web"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287101    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="kube-rbac-proxy"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287106    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="kube-rbac-proxy"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287114    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="thanos-sidecar"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287119    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="thanos-sidecar"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287127    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="kube-rbac-proxy-thanos"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287132    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="kube-rbac-proxy-thanos"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287184    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="prometheus"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287192    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="kube-rbac-proxy"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287199    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="config-reloader"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287206    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="thanos-sidecar"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287211    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="kube-rbac-proxy-thanos"
Jul 22 16:25:26.287216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.287218    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e22c1e-d766-44f7-a696-0bade791739a" containerName="kube-rbac-proxy-web"
Jul 22 16:25:26.291192 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.291172    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.293841 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.293822    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 16:25:26.293975 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.293956    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 16:25:26.294098 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.294012    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 16:25:26.294167 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.294107    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 16:25:26.294167 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.294162    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-euo7onv6ikssn\""
Jul 22 16:25:26.294372 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.294357    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 16:25:26.294514 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.294499    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 16:25:26.294584 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.294516    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 16:25:26.294584 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.294550    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 16:25:26.294685 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.294639    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-prplv\""
Jul 22 16:25:26.294929 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.294915    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 16:25:26.294997 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.294975    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 16:25:26.295080 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.295001    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 16:25:26.295080 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.294977    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 16:25:26.297702 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.297685    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 16:25:26.299448 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.299410    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 16:25:26.304802 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.304780    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:25:26.370519 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.370519 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-config\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.370848 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370540    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.370848 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370626    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.370848 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.370848 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.370848 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.370848 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.370848 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370794    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c70aa80e-a948-44a7-bea9-f59c951a238d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.371191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.371191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370892    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.371191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.371191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c70aa80e-a948-44a7-bea9-f59c951a238d-config-out\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.371191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.370970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7d74\" (UniqueName: \"kubernetes.io/projected/c70aa80e-a948-44a7-bea9-f59c951a238d-kube-api-access-l7d74\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.371191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.371059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.371191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.371088    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.371191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.371113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-web-config\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.371191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.371142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.371191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.371166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.371191 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.371194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.471734 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.471687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-config\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.471734 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.471734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.471974 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.471863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.471974 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.471915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.471974 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.471947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472163 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.471977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472163 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472163 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c70aa80e-a948-44a7-bea9-f59c951a238d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472163 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472163 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472143    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472406 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472406 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c70aa80e-a948-44a7-bea9-f59c951a238d-config-out\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472406 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7d74\" (UniqueName: \"kubernetes.io/projected/c70aa80e-a948-44a7-bea9-f59c951a238d-kube-api-access-l7d74\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472406 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472406 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472406 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-web-config\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472406 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472406 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472855 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472855 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472855 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.472855 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.472808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.474712 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.474182    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.474712 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.474475    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.482084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.475535    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.482084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.475563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-config\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.482084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.475629    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.482084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.475919    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.482084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.476192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.482084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.476670    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.482084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.476670    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.482084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.477517    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.482084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.478116    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c70aa80e-a948-44a7-bea9-f59c951a238d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.482084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.478551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c70aa80e-a948-44a7-bea9-f59c951a238d-config-out\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.482084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.479280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-web-config\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.482084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.479915    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.483103 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.482709    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.483478 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.483457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c70aa80e-a948-44a7-bea9-f59c951a238d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.483647 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.483629    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7d74\" (UniqueName: \"kubernetes.io/projected/c70aa80e-a948-44a7-bea9-f59c951a238d-kube-api-access-l7d74\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.483976 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.483956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c70aa80e-a948-44a7-bea9-f59c951a238d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c70aa80e-a948-44a7-bea9-f59c951a238d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.601726 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.601634    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:26.740359 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:26.740336    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:25:26.741634 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:25:26.741609    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70aa80e_a948_44a7_bea9_f59c951a238d.slice/crio-20d580d92dd3ed0a091794cb36db3a26efca829c1d6216d3206d21cc68491384 WatchSource:0}: Error finding container 20d580d92dd3ed0a091794cb36db3a26efca829c1d6216d3206d21cc68491384: Status 404 returned error can't find the container with id 20d580d92dd3ed0a091794cb36db3a26efca829c1d6216d3206d21cc68491384
Jul 22 16:25:27.237210 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:27.237171    2580 generic.go:356] "Generic (PLEG): container finished" podID="c70aa80e-a948-44a7-bea9-f59c951a238d" containerID="d4ce394a7986aa926851c413816a4b123d0f6639e040ad75e3832d0c7acca202" exitCode=0
Jul 22 16:25:27.237591 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:27.237254    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c70aa80e-a948-44a7-bea9-f59c951a238d","Type":"ContainerDied","Data":"d4ce394a7986aa926851c413816a4b123d0f6639e040ad75e3832d0c7acca202"}
Jul 22 16:25:27.237591 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:27.237320    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c70aa80e-a948-44a7-bea9-f59c951a238d","Type":"ContainerStarted","Data":"20d580d92dd3ed0a091794cb36db3a26efca829c1d6216d3206d21cc68491384"}
Jul 22 16:25:27.373906 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:27.373875    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71e22c1e-d766-44f7-a696-0bade791739a" path="/var/lib/kubelet/pods/71e22c1e-d766-44f7-a696-0bade791739a/volumes"
Jul 22 16:25:28.244797 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:28.244759    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c70aa80e-a948-44a7-bea9-f59c951a238d","Type":"ContainerStarted","Data":"3d767006f991ff6916939899f07331680707ae3d3590de50da5b9689b15e6090"}
Jul 22 16:25:28.245238 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:28.244843    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c70aa80e-a948-44a7-bea9-f59c951a238d","Type":"ContainerStarted","Data":"b049bebd0f2f51a0ff198c823eda955cc913a01b02c6f725ecda4e54e1bfa493"}
Jul 22 16:25:28.245238 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:28.244885    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c70aa80e-a948-44a7-bea9-f59c951a238d","Type":"ContainerStarted","Data":"e06db58fe57fb389ce358684de16552f93ca239a417f17d0a181b6e052a1f612"}
Jul 22 16:25:28.245238 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:28.244935    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c70aa80e-a948-44a7-bea9-f59c951a238d","Type":"ContainerStarted","Data":"d4cc25e25a0bdf7d086b1113bc2bbd687e937acfc6537a4d5972bb938feb279b"}
Jul 22 16:25:28.245238 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:28.244969    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c70aa80e-a948-44a7-bea9-f59c951a238d","Type":"ContainerStarted","Data":"62ef0f7bf5e78adaf191fb6b308586ac93c09112605805d18af040785a928176"}
Jul 22 16:25:28.245238 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:28.245012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c70aa80e-a948-44a7-bea9-f59c951a238d","Type":"ContainerStarted","Data":"7fe235cc903cfc200b79d367aa66e751e3fb762b156f72a0a332e267c26363b8"}
Jul 22 16:25:28.298403 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:28.298341    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.278687994 podStartE2EDuration="2.298320888s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.632894ms" isStatefulPod=false podCreationTimestamp="2026-07-22 16:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:25:28.296464889 +0000 UTC m=+157.648740920" watchObservedRunningTime="2026-07-22 16:25:28.298320888 +0000 UTC m=+157.650596909"
Jul 22 16:25:31.601746 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:25:31.601712    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:26:26.602410 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:26:26.602376    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:26:26.618409 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:26:26.618375    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:26:27.495079 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:26:27.495050    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:27:14.059647 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.059565    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nmdn4"]
Jul 22 16:27:14.062683 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.062667    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nmdn4"
Jul 22 16:27:14.066645 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.066615    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 22 16:27:14.066757 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.066672    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 22 16:27:14.078877 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.078856    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nmdn4"]
Jul 22 16:27:14.133800 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.133777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjhzb\" (UniqueName: \"kubernetes.io/projected/1d173622-9b19-4c81-96b7-240dbb329a73-kube-api-access-rjhzb\") pod \"cert-manager-webhook-6486ffd997-nmdn4\" (UID: \"1d173622-9b19-4c81-96b7-240dbb329a73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nmdn4"
Jul 22 16:27:14.133926 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.133805    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d173622-9b19-4c81-96b7-240dbb329a73-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nmdn4\" (UID: \"1d173622-9b19-4c81-96b7-240dbb329a73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nmdn4"
Jul 22 16:27:14.234875 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.234829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjhzb\" (UniqueName: \"kubernetes.io/projected/1d173622-9b19-4c81-96b7-240dbb329a73-kube-api-access-rjhzb\") pod \"cert-manager-webhook-6486ffd997-nmdn4\" (UID: \"1d173622-9b19-4c81-96b7-240dbb329a73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nmdn4"
Jul 22 16:27:14.235068 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.234885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d173622-9b19-4c81-96b7-240dbb329a73-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nmdn4\" (UID: \"1d173622-9b19-4c81-96b7-240dbb329a73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nmdn4"
Jul 22 16:27:14.245189 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.245164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjhzb\" (UniqueName: \"kubernetes.io/projected/1d173622-9b19-4c81-96b7-240dbb329a73-kube-api-access-rjhzb\") pod \"cert-manager-webhook-6486ffd997-nmdn4\" (UID: \"1d173622-9b19-4c81-96b7-240dbb329a73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nmdn4"
Jul 22 16:27:14.245676 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.245655    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d173622-9b19-4c81-96b7-240dbb329a73-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nmdn4\" (UID: \"1d173622-9b19-4c81-96b7-240dbb329a73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nmdn4"
Jul 22 16:27:14.382983 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.382895    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nmdn4"
Jul 22 16:27:14.538361 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.538334    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nmdn4"]
Jul 22 16:27:14.540889 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:27:14.540859    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d173622_9b19_4c81_96b7_240dbb329a73.slice/crio-7b7f56f1a2e9345cc49dc4dcc466353f5b21c59eb5b9a6088f9d76db82c0dadd WatchSource:0}: Error finding container 7b7f56f1a2e9345cc49dc4dcc466353f5b21c59eb5b9a6088f9d76db82c0dadd: Status 404 returned error can't find the container with id 7b7f56f1a2e9345cc49dc4dcc466353f5b21c59eb5b9a6088f9d76db82c0dadd
Jul 22 16:27:14.666070 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:14.666043    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nmdn4" event={"ID":"1d173622-9b19-4c81-96b7-240dbb329a73","Type":"ContainerStarted","Data":"7b7f56f1a2e9345cc49dc4dcc466353f5b21c59eb5b9a6088f9d76db82c0dadd"}
Jul 22 16:27:17.656573 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.656545    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx"]
Jul 22 16:27:17.660303 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.660282    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx"
Jul 22 16:27:17.663210 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.663191    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-p57t4\""
Jul 22 16:27:17.668943 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.668919    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx"]
Jul 22 16:27:17.683685 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.683648    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nmdn4" event={"ID":"1d173622-9b19-4c81-96b7-240dbb329a73","Type":"ContainerStarted","Data":"b0195864c9e82161eeb1cf055ded88b62fe44634ae8f014cef2de1c2cbcd14e2"}
Jul 22 16:27:17.683908 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.683893    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nmdn4"
Jul 22 16:27:17.703405 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.703350    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-nmdn4" podStartSLOduration=0.656597655 podStartE2EDuration="3.703333696s" totalImagesPullingTime="3.046736041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:27:17.702300173 +0000 UTC m=+267.054576217" watchObservedRunningTime="2026-07-22 16:27:17.703333696 +0000 UTC m=+267.055609715"
Jul 22 16:27:17.767125 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.767087    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed093a13-955f-46e4-ae24-a63590c5d13b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8fmtx\" (UID: \"ed093a13-955f-46e4-ae24-a63590c5d13b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx"
Jul 22 16:27:17.767349 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.767171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27hfd\" (UniqueName: \"kubernetes.io/projected/ed093a13-955f-46e4-ae24-a63590c5d13b-kube-api-access-27hfd\") pod \"cert-manager-cainjector-559cdd8c87-8fmtx\" (UID: \"ed093a13-955f-46e4-ae24-a63590c5d13b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx"
Jul 22 16:27:17.868169 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.868070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed093a13-955f-46e4-ae24-a63590c5d13b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8fmtx\" (UID: \"ed093a13-955f-46e4-ae24-a63590c5d13b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx"
Jul 22 16:27:17.868169 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.868151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27hfd\" (UniqueName: \"kubernetes.io/projected/ed093a13-955f-46e4-ae24-a63590c5d13b-kube-api-access-27hfd\") pod \"cert-manager-cainjector-559cdd8c87-8fmtx\" (UID: \"ed093a13-955f-46e4-ae24-a63590c5d13b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx"
Jul 22 16:27:17.876708 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.876680    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed093a13-955f-46e4-ae24-a63590c5d13b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8fmtx\" (UID: \"ed093a13-955f-46e4-ae24-a63590c5d13b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx"
Jul 22 16:27:17.876906 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.876884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27hfd\" (UniqueName: \"kubernetes.io/projected/ed093a13-955f-46e4-ae24-a63590c5d13b-kube-api-access-27hfd\") pod \"cert-manager-cainjector-559cdd8c87-8fmtx\" (UID: \"ed093a13-955f-46e4-ae24-a63590c5d13b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx"
Jul 22 16:27:17.969791 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:17.969753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx"
Jul 22 16:27:18.119971 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:18.119946    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx"]
Jul 22 16:27:18.122074 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:27:18.122051    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded093a13_955f_46e4_ae24_a63590c5d13b.slice/crio-5b085cd33e0ea3873848543dc0cc4563594cc9f6102104f78e0b850a660be524 WatchSource:0}: Error finding container 5b085cd33e0ea3873848543dc0cc4563594cc9f6102104f78e0b850a660be524: Status 404 returned error can't find the container with id 5b085cd33e0ea3873848543dc0cc4563594cc9f6102104f78e0b850a660be524
Jul 22 16:27:18.689116 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:18.689079    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx" event={"ID":"ed093a13-955f-46e4-ae24-a63590c5d13b","Type":"ContainerStarted","Data":"566cf4ec52d448f2488b2ef85c02e7412ff8d9ded52815e7d3bc0249b7a2cac9"}
Jul 22 16:27:18.689116 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:18.689119    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx" event={"ID":"ed093a13-955f-46e4-ae24-a63590c5d13b","Type":"ContainerStarted","Data":"5b085cd33e0ea3873848543dc0cc4563594cc9f6102104f78e0b850a660be524"}
Jul 22 16:27:18.709390 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:18.709333    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fmtx" podStartSLOduration=1.709311224 podStartE2EDuration="1.709311224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:27:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:27:18.7067682 +0000 UTC m=+268.059044221" watchObservedRunningTime="2026-07-22 16:27:18.709311224 +0000 UTC m=+268.061587247"
Jul 22 16:27:23.691820 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:23.691782    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nmdn4"
Jul 22 16:27:51.264801 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:51.264766    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 16:27:52.257742 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.257706    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"]
Jul 22 16:27:52.259924 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.259909    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.266878 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.266858    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 16:27:52.268081 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.268057    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 16:27:52.268168 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.268093    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 16:27:52.268168 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.268065    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 16:27:52.268268 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.268066    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 16:27:52.268268 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.268210    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wdh7w\""
Jul 22 16:27:52.293007 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.292977    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"]
Jul 22 16:27:52.369785 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.369754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7845b25b-66dc-4a20-b417-778775a23f61-manager-config\") pod \"lws-controller-manager-65dd5d6b6d-4nd7m\" (UID: \"7845b25b-66dc-4a20-b417-778775a23f61\") " pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.369956 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.369809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh77l\" (UniqueName: \"kubernetes.io/projected/7845b25b-66dc-4a20-b417-778775a23f61-kube-api-access-hh77l\") pod \"lws-controller-manager-65dd5d6b6d-4nd7m\" (UID: \"7845b25b-66dc-4a20-b417-778775a23f61\") " pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.369996 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.369970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7845b25b-66dc-4a20-b417-778775a23f61-metrics-cert\") pod \"lws-controller-manager-65dd5d6b6d-4nd7m\" (UID: \"7845b25b-66dc-4a20-b417-778775a23f61\") " pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.370075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.370061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7845b25b-66dc-4a20-b417-778775a23f61-cert\") pod \"lws-controller-manager-65dd5d6b6d-4nd7m\" (UID: \"7845b25b-66dc-4a20-b417-778775a23f61\") " pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.470849 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.470814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7845b25b-66dc-4a20-b417-778775a23f61-cert\") pod \"lws-controller-manager-65dd5d6b6d-4nd7m\" (UID: \"7845b25b-66dc-4a20-b417-778775a23f61\") " pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.470849 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.470855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7845b25b-66dc-4a20-b417-778775a23f61-manager-config\") pod \"lws-controller-manager-65dd5d6b6d-4nd7m\" (UID: \"7845b25b-66dc-4a20-b417-778775a23f61\") " pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.471124 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.470878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh77l\" (UniqueName: \"kubernetes.io/projected/7845b25b-66dc-4a20-b417-778775a23f61-kube-api-access-hh77l\") pod \"lws-controller-manager-65dd5d6b6d-4nd7m\" (UID: \"7845b25b-66dc-4a20-b417-778775a23f61\") " pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.471124 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.470942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7845b25b-66dc-4a20-b417-778775a23f61-metrics-cert\") pod \"lws-controller-manager-65dd5d6b6d-4nd7m\" (UID: \"7845b25b-66dc-4a20-b417-778775a23f61\") " pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.471692 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.471667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7845b25b-66dc-4a20-b417-778775a23f61-manager-config\") pod \"lws-controller-manager-65dd5d6b6d-4nd7m\" (UID: \"7845b25b-66dc-4a20-b417-778775a23f61\") " pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.473576 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.473556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7845b25b-66dc-4a20-b417-778775a23f61-metrics-cert\") pod \"lws-controller-manager-65dd5d6b6d-4nd7m\" (UID: \"7845b25b-66dc-4a20-b417-778775a23f61\") " pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.474060 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.474013    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7845b25b-66dc-4a20-b417-778775a23f61-cert\") pod \"lws-controller-manager-65dd5d6b6d-4nd7m\" (UID: \"7845b25b-66dc-4a20-b417-778775a23f61\") " pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.483249 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.483226    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh77l\" (UniqueName: \"kubernetes.io/projected/7845b25b-66dc-4a20-b417-778775a23f61-kube-api-access-hh77l\") pod \"lws-controller-manager-65dd5d6b6d-4nd7m\" (UID: \"7845b25b-66dc-4a20-b417-778775a23f61\") " pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.569456 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.569366    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:52.741776 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.741748    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"]
Jul 22 16:27:52.743506 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:27:52.743482    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7845b25b_66dc_4a20_b417_778775a23f61.slice/crio-eb12b2f962a869b9c701d114c2a117cbad8b22a36bec4bcd8ebd2467a536f846 WatchSource:0}: Error finding container eb12b2f962a869b9c701d114c2a117cbad8b22a36bec4bcd8ebd2467a536f846: Status 404 returned error can't find the container with id eb12b2f962a869b9c701d114c2a117cbad8b22a36bec4bcd8ebd2467a536f846
Jul 22 16:27:52.745563 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.745544    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 16:27:52.830436 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:52.830352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m" event={"ID":"7845b25b-66dc-4a20-b417-778775a23f61","Type":"ContainerStarted","Data":"eb12b2f962a869b9c701d114c2a117cbad8b22a36bec4bcd8ebd2467a536f846"}
Jul 22 16:27:53.511140 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.511104    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"]
Jul 22 16:27:53.518620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.518590    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.522731 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.522670    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 16:27:53.522872 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.522747    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 16:27:53.522975 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.522956    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pf667\""
Jul 22 16:27:53.523124 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.522994    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 16:27:53.523198 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.523042    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 16:27:53.530583 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.530558    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"]
Jul 22 16:27:53.579591 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.579554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b42vf\" (UniqueName: \"kubernetes.io/projected/7a7d805f-9c16-4862-afe5-e18aef50e568-kube-api-access-b42vf\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.579753 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.579609    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a7d805f-9c16-4862-afe5-e18aef50e568-manifests\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.579753 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.579702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a7d805f-9c16-4862-afe5-e18aef50e568-tmp\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.579867 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.579761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a7d805f-9c16-4862-afe5-e18aef50e568-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.579867 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.579799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a7d805f-9c16-4862-afe5-e18aef50e568-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.681316 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.681259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a7d805f-9c16-4862-afe5-e18aef50e568-tmp\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.681494 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.681335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a7d805f-9c16-4862-afe5-e18aef50e568-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.681494 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.681373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a7d805f-9c16-4862-afe5-e18aef50e568-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.681494 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.681424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b42vf\" (UniqueName: \"kubernetes.io/projected/7a7d805f-9c16-4862-afe5-e18aef50e568-kube-api-access-b42vf\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.681494 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.681461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a7d805f-9c16-4862-afe5-e18aef50e568-manifests\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.681883 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.681837    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a7d805f-9c16-4862-afe5-e18aef50e568-manifests\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.684554 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.684520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a7d805f-9c16-4862-afe5-e18aef50e568-tmp\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.685204 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.685181    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a7d805f-9c16-4862-afe5-e18aef50e568-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.685401 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.685380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a7d805f-9c16-4862-afe5-e18aef50e568-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.691416 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.691394    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b42vf\" (UniqueName: \"kubernetes.io/projected/7a7d805f-9c16-4862-afe5-e18aef50e568-kube-api-access-b42vf\") pod \"opendatahub-operator-controller-manager-9b566c8c6-hqfwj\" (UID: \"7a7d805f-9c16-4862-afe5-e18aef50e568\") " pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:53.834515 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:53.834438    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:54.030727 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:54.030689    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"]
Jul 22 16:27:54.036249 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:27:54.036198    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7d805f_9c16_4862_afe5_e18aef50e568.slice/crio-323c2cfe7cce2e270a9d171636512584d19986a287a2c3bb19234ec78429ed0a WatchSource:0}: Error finding container 323c2cfe7cce2e270a9d171636512584d19986a287a2c3bb19234ec78429ed0a: Status 404 returned error can't find the container with id 323c2cfe7cce2e270a9d171636512584d19986a287a2c3bb19234ec78429ed0a
Jul 22 16:27:54.842479 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:54.842446    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj" event={"ID":"7a7d805f-9c16-4862-afe5-e18aef50e568","Type":"ContainerStarted","Data":"323c2cfe7cce2e270a9d171636512584d19986a287a2c3bb19234ec78429ed0a"}
Jul 22 16:27:55.850863 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:55.850827    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m" event={"ID":"7845b25b-66dc-4a20-b417-778775a23f61","Type":"ContainerStarted","Data":"98b720fb0c11bf2621bf919ed6368016fb2bd73179109a35f7e6f6f92fad71e0"}
Jul 22 16:27:55.851307 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:55.850975    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:27:55.870750 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:55.869228    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m" podStartSLOduration=1.422739203 podStartE2EDuration="3.869208346s" totalImagesPullingTime="2.446469143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:27:55.868720327 +0000 UTC m=+305.220996348" watchObservedRunningTime="2026-07-22 16:27:55.869208346 +0000 UTC m=+305.221484368"
Jul 22 16:27:57.861967 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:57.861876    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj" event={"ID":"7a7d805f-9c16-4862-afe5-e18aef50e568","Type":"ContainerStarted","Data":"affa1d320e6bbb11469ff89210755408485f72325ebe9738a96c8349dc098f67"}
Jul 22 16:27:58.867714 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:58.867682    2580 generic.go:356] "Generic (PLEG): container finished" podID="7a7d805f-9c16-4862-afe5-e18aef50e568" containerID="affa1d320e6bbb11469ff89210755408485f72325ebe9738a96c8349dc098f67" exitCode=0
Jul 22 16:27:58.868146 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:58.867776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj" event={"ID":"7a7d805f-9c16-4862-afe5-e18aef50e568","Type":"ContainerDied","Data":"affa1d320e6bbb11469ff89210755408485f72325ebe9738a96c8349dc098f67"}
Jul 22 16:27:59.874167 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:59.874134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj" event={"ID":"7a7d805f-9c16-4862-afe5-e18aef50e568","Type":"ContainerStarted","Data":"4cc38957fa4bde682aea78cc9c9b12af95d1e6f98c2d8ff6e7ceda6657c15e1e"}
Jul 22 16:27:59.874554 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:59.874238    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:27:59.899002 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:27:59.898956    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj" podStartSLOduration=1.9663398490000001 podStartE2EDuration="6.898941262s" totalImagesPullingTime="3.851348602s" totalInitContainerRuntime="1.081252811s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:27:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:27:59.897489838 +0000 UTC m=+309.249765858" watchObservedRunningTime="2026-07-22 16:27:59.898941262 +0000 UTC m=+309.251217281"
Jul 22 16:28:06.858153 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:06.858123    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65dd5d6b6d-4nd7m"
Jul 22 16:28:10.880522 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:10.880487    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9b566c8c6-hqfwj"
Jul 22 16:28:13.194410 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.194375    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"]
Jul 22 16:28:13.196797 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.196776    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"
Jul 22 16:28:13.200664 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.200642    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 16:28:13.201594 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.201574    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 16:28:13.201594 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.201581    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 16:28:13.201900 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.201769    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 16:28:13.201900 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.201853    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4hpl6\""
Jul 22 16:28:13.226447 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.226417    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"]
Jul 22 16:28:13.257661 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.257628    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfg64\" (UniqueName: \"kubernetes.io/projected/def25e33-b1a7-469f-a8e3-bd40d61249f9-kube-api-access-pfg64\") pod \"kube-auth-proxy-6d7df686d9-w2w9t\" (UID: \"def25e33-b1a7-469f-a8e3-bd40d61249f9\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"
Jul 22 16:28:13.257661 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.257662    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/def25e33-b1a7-469f-a8e3-bd40d61249f9-tls-certs\") pod \"kube-auth-proxy-6d7df686d9-w2w9t\" (UID: \"def25e33-b1a7-469f-a8e3-bd40d61249f9\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"
Jul 22 16:28:13.257865 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.257688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/def25e33-b1a7-469f-a8e3-bd40d61249f9-tmp\") pod \"kube-auth-proxy-6d7df686d9-w2w9t\" (UID: \"def25e33-b1a7-469f-a8e3-bd40d61249f9\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"
Jul 22 16:28:13.358642 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.358608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfg64\" (UniqueName: \"kubernetes.io/projected/def25e33-b1a7-469f-a8e3-bd40d61249f9-kube-api-access-pfg64\") pod \"kube-auth-proxy-6d7df686d9-w2w9t\" (UID: \"def25e33-b1a7-469f-a8e3-bd40d61249f9\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"
Jul 22 16:28:13.358642 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.358645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/def25e33-b1a7-469f-a8e3-bd40d61249f9-tls-certs\") pod \"kube-auth-proxy-6d7df686d9-w2w9t\" (UID: \"def25e33-b1a7-469f-a8e3-bd40d61249f9\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"
Jul 22 16:28:13.358865 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.358680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/def25e33-b1a7-469f-a8e3-bd40d61249f9-tmp\") pod \"kube-auth-proxy-6d7df686d9-w2w9t\" (UID: \"def25e33-b1a7-469f-a8e3-bd40d61249f9\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"
Jul 22 16:28:13.361107 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.361074    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/def25e33-b1a7-469f-a8e3-bd40d61249f9-tmp\") pod \"kube-auth-proxy-6d7df686d9-w2w9t\" (UID: \"def25e33-b1a7-469f-a8e3-bd40d61249f9\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"
Jul 22 16:28:13.361304 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.361286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/def25e33-b1a7-469f-a8e3-bd40d61249f9-tls-certs\") pod \"kube-auth-proxy-6d7df686d9-w2w9t\" (UID: \"def25e33-b1a7-469f-a8e3-bd40d61249f9\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"
Jul 22 16:28:13.378052 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.377119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfg64\" (UniqueName: \"kubernetes.io/projected/def25e33-b1a7-469f-a8e3-bd40d61249f9-kube-api-access-pfg64\") pod \"kube-auth-proxy-6d7df686d9-w2w9t\" (UID: \"def25e33-b1a7-469f-a8e3-bd40d61249f9\") " pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"
Jul 22 16:28:13.505945 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.505863    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"
Jul 22 16:28:13.657068 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.656987    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t"]
Jul 22 16:28:13.659110 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:28:13.659081    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef25e33_b1a7_469f_a8e3_bd40d61249f9.slice/crio-019bdcfe25d6aaa8ad764d22e3b680b78cba88f44ce2c9022604d8f4665d53b7 WatchSource:0}: Error finding container 019bdcfe25d6aaa8ad764d22e3b680b78cba88f44ce2c9022604d8f4665d53b7: Status 404 returned error can't find the container with id 019bdcfe25d6aaa8ad764d22e3b680b78cba88f44ce2c9022604d8f4665d53b7
Jul 22 16:28:13.939257 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:13.939222    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t" event={"ID":"def25e33-b1a7-469f-a8e3-bd40d61249f9","Type":"ContainerStarted","Data":"019bdcfe25d6aaa8ad764d22e3b680b78cba88f44ce2c9022604d8f4665d53b7"}
Jul 22 16:28:15.949741 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:15.949704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t" event={"ID":"def25e33-b1a7-469f-a8e3-bd40d61249f9","Type":"ContainerStarted","Data":"09a7c25e905caac7adf1398e7dabfe5413e4017b24718bfa7a1fa869acbc02c8"}
Jul 22 16:28:15.971257 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:28:15.971203    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d7df686d9-w2w9t" podStartSLOduration=0.906677969 podStartE2EDuration="2.971185891s" totalImagesPullingTime="2.064507922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:28:15.97053093 +0000 UTC m=+325.322806952" watchObservedRunningTime="2026-07-22 16:28:15.971185891 +0000 UTC m=+325.323461910"
Jul 22 16:30:04.421258 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.421226    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"]
Jul 22 16:30:04.428712 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.428685    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:04.432765 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.432743    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-stkvr\""
Jul 22 16:30:04.432889 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.432746    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 16:30:04.433228 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.433215    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 16:30:04.443406 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.443383    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"]
Jul 22 16:30:04.496836 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.496802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wlhr\" (UniqueName: \"kubernetes.io/projected/60334feb-c986-4787-bb86-0ade2b7623ab-kube-api-access-9wlhr\") pod \"kuadrant-operator-controller-manager-86878c769f-nxdm8\" (UID: \"60334feb-c986-4787-bb86-0ade2b7623ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:04.496995 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.496875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60334feb-c986-4787-bb86-0ade2b7623ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nxdm8\" (UID: \"60334feb-c986-4787-bb86-0ade2b7623ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:04.598154 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.598109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60334feb-c986-4787-bb86-0ade2b7623ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nxdm8\" (UID: \"60334feb-c986-4787-bb86-0ade2b7623ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:04.598342 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.598196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wlhr\" (UniqueName: \"kubernetes.io/projected/60334feb-c986-4787-bb86-0ade2b7623ab-kube-api-access-9wlhr\") pod \"kuadrant-operator-controller-manager-86878c769f-nxdm8\" (UID: \"60334feb-c986-4787-bb86-0ade2b7623ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:04.598514 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.598494    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60334feb-c986-4787-bb86-0ade2b7623ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nxdm8\" (UID: \"60334feb-c986-4787-bb86-0ade2b7623ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:04.610851 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.610816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wlhr\" (UniqueName: \"kubernetes.io/projected/60334feb-c986-4787-bb86-0ade2b7623ab-kube-api-access-9wlhr\") pod \"kuadrant-operator-controller-manager-86878c769f-nxdm8\" (UID: \"60334feb-c986-4787-bb86-0ade2b7623ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:04.739905 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.739805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:04.870764 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:04.870739    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"]
Jul 22 16:30:04.873053 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:30:04.873009    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60334feb_c986_4787_bb86_0ade2b7623ab.slice/crio-9d961e58909bd080646ae18b789a5c45fb40a4abd3ff70275a4a9a5b65a8ea37 WatchSource:0}: Error finding container 9d961e58909bd080646ae18b789a5c45fb40a4abd3ff70275a4a9a5b65a8ea37: Status 404 returned error can't find the container with id 9d961e58909bd080646ae18b789a5c45fb40a4abd3ff70275a4a9a5b65a8ea37
Jul 22 16:30:05.445100 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:05.445063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8" event={"ID":"60334feb-c986-4787-bb86-0ade2b7623ab","Type":"ContainerStarted","Data":"9d961e58909bd080646ae18b789a5c45fb40a4abd3ff70275a4a9a5b65a8ea37"}
Jul 22 16:30:09.465620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:09.465585    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8" event={"ID":"60334feb-c986-4787-bb86-0ade2b7623ab","Type":"ContainerStarted","Data":"f5dc0361ed66bc92c2a0f38613ba23804cb36e62bb15f408944a401c53dbcbc9"}
Jul 22 16:30:09.466099 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:09.465697    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:09.495992 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:09.495948    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8" podStartSLOduration=1.036570656 podStartE2EDuration="5.495931944s" totalImagesPullingTime="4.459361288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:30:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:30:09.492856757 +0000 UTC m=+438.845132768" watchObservedRunningTime="2026-07-22 16:30:09.495931944 +0000 UTC m=+438.848207963"
Jul 22 16:30:11.705601 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.705560    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"]
Jul 22 16:30:11.706048 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.705743    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8" podUID="60334feb-c986-4787-bb86-0ade2b7623ab" containerName="manager" containerID="cri-o://f5dc0361ed66bc92c2a0f38613ba23804cb36e62bb15f408944a401c53dbcbc9" gracePeriod=2
Jul 22 16:30:11.714920 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:30:11.714866    2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"60334feb-c986-4787-bb86-0ade2b7623ab\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-86878c769f-nxdm8\": pods \"kuadrant-operator-controller-manager-86878c769f-nxdm8\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:11.715623 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.715512    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"]
Jul 22 16:30:11.755604 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.755574    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8gxc"]
Jul 22 16:30:11.755957 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.755944    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60334feb-c986-4787-bb86-0ade2b7623ab" containerName="manager"
Jul 22 16:30:11.756000 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.755959    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="60334feb-c986-4787-bb86-0ade2b7623ab" containerName="manager"
Jul 22 16:30:11.756069 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.756059    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="60334feb-c986-4787-bb86-0ade2b7623ab" containerName="manager"
Jul 22 16:30:11.758484 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.758468    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8gxc"
Jul 22 16:30:11.761316 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.761290    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qg58g\""
Jul 22 16:30:11.769192 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.769164    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8gxc"]
Jul 22 16:30:11.794895 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:30:11.794862    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-nxdm8\" is forbidden: User \"system:node:ip-10-0-142-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-32.ec2.internal' and this object" podUID="60334feb-c986-4787-bb86-0ade2b7623ab" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:11.864804 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.864763    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qbk7\" (UniqueName: \"kubernetes.io/projected/e87d06d2-1c93-4c2e-a473-18eca2c46d9d-kube-api-access-7qbk7\") pod \"limitador-operator-controller-manager-859d7b78bd-b8gxc\" (UID: \"e87d06d2-1c93-4c2e-a473-18eca2c46d9d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8gxc"
Jul 22 16:30:11.946347 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.946325    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:11.948812 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:30:11.948788    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-nxdm8\" is forbidden: User \"system:node:ip-10-0-142-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-32.ec2.internal' and this object" podUID="60334feb-c986-4787-bb86-0ade2b7623ab" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:11.966290 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.966233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qbk7\" (UniqueName: \"kubernetes.io/projected/e87d06d2-1c93-4c2e-a473-18eca2c46d9d-kube-api-access-7qbk7\") pod \"limitador-operator-controller-manager-859d7b78bd-b8gxc\" (UID: \"e87d06d2-1c93-4c2e-a473-18eca2c46d9d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8gxc"
Jul 22 16:30:11.976778 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:11.976756    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qbk7\" (UniqueName: \"kubernetes.io/projected/e87d06d2-1c93-4c2e-a473-18eca2c46d9d-kube-api-access-7qbk7\") pod \"limitador-operator-controller-manager-859d7b78bd-b8gxc\" (UID: \"e87d06d2-1c93-4c2e-a473-18eca2c46d9d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8gxc"
Jul 22 16:30:12.067481 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.067451    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wlhr\" (UniqueName: \"kubernetes.io/projected/60334feb-c986-4787-bb86-0ade2b7623ab-kube-api-access-9wlhr\") pod \"60334feb-c986-4787-bb86-0ade2b7623ab\" (UID: \"60334feb-c986-4787-bb86-0ade2b7623ab\") "
Jul 22 16:30:12.067618 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.067515    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60334feb-c986-4787-bb86-0ade2b7623ab-extensions-socket-volume\") pod \"60334feb-c986-4787-bb86-0ade2b7623ab\" (UID: \"60334feb-c986-4787-bb86-0ade2b7623ab\") "
Jul 22 16:30:12.068037 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.068000    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60334feb-c986-4787-bb86-0ade2b7623ab-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "60334feb-c986-4787-bb86-0ade2b7623ab" (UID: "60334feb-c986-4787-bb86-0ade2b7623ab"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:30:12.069559 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.069539    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60334feb-c986-4787-bb86-0ade2b7623ab-kube-api-access-9wlhr" (OuterVolumeSpecName: "kube-api-access-9wlhr") pod "60334feb-c986-4787-bb86-0ade2b7623ab" (UID: "60334feb-c986-4787-bb86-0ade2b7623ab"). InnerVolumeSpecName "kube-api-access-9wlhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:30:12.084706 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.084682    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8gxc"
Jul 22 16:30:12.168607 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.168575    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60334feb-c986-4787-bb86-0ade2b7623ab-extensions-socket-volume\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:30:12.168607 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.168603    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wlhr\" (UniqueName: \"kubernetes.io/projected/60334feb-c986-4787-bb86-0ade2b7623ab-kube-api-access-9wlhr\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:30:12.219787 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:30:12.219755    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode87d06d2_1c93_4c2e_a473_18eca2c46d9d.slice/crio-dfdb385139d86252dc50360a3a1c38cafd517628b0d053585ea5b7e2c311e03f WatchSource:0}: Error finding container dfdb385139d86252dc50360a3a1c38cafd517628b0d053585ea5b7e2c311e03f: Status 404 returned error can't find the container with id dfdb385139d86252dc50360a3a1c38cafd517628b0d053585ea5b7e2c311e03f
Jul 22 16:30:12.224554 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.224527    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8gxc"]
Jul 22 16:30:12.480326 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.480241    2580 generic.go:356] "Generic (PLEG): container finished" podID="60334feb-c986-4787-bb86-0ade2b7623ab" containerID="f5dc0361ed66bc92c2a0f38613ba23804cb36e62bb15f408944a401c53dbcbc9" exitCode=0
Jul 22 16:30:12.480326 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.480305    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:12.480573 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.480342    2580 scope.go:117] "RemoveContainer" containerID="f5dc0361ed66bc92c2a0f38613ba23804cb36e62bb15f408944a401c53dbcbc9"
Jul 22 16:30:12.481846 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.481811    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8gxc" event={"ID":"e87d06d2-1c93-4c2e-a473-18eca2c46d9d","Type":"ContainerStarted","Data":"dfdb385139d86252dc50360a3a1c38cafd517628b0d053585ea5b7e2c311e03f"}
Jul 22 16:30:12.483035 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:30:12.482997    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-nxdm8\" is forbidden: User \"system:node:ip-10-0-142-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-32.ec2.internal' and this object" podUID="60334feb-c986-4787-bb86-0ade2b7623ab" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:12.490065 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.490044    2580 scope.go:117] "RemoveContainer" containerID="f5dc0361ed66bc92c2a0f38613ba23804cb36e62bb15f408944a401c53dbcbc9"
Jul 22 16:30:12.490377 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:30:12.490353    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5dc0361ed66bc92c2a0f38613ba23804cb36e62bb15f408944a401c53dbcbc9\": container with ID starting with f5dc0361ed66bc92c2a0f38613ba23804cb36e62bb15f408944a401c53dbcbc9 not found: ID does not exist" containerID="f5dc0361ed66bc92c2a0f38613ba23804cb36e62bb15f408944a401c53dbcbc9"
Jul 22 16:30:12.490458 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:12.490391    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5dc0361ed66bc92c2a0f38613ba23804cb36e62bb15f408944a401c53dbcbc9"} err="failed to get container status \"f5dc0361ed66bc92c2a0f38613ba23804cb36e62bb15f408944a401c53dbcbc9\": rpc error: code = NotFound desc = could not find container \"f5dc0361ed66bc92c2a0f38613ba23804cb36e62bb15f408944a401c53dbcbc9\": container with ID starting with f5dc0361ed66bc92c2a0f38613ba23804cb36e62bb15f408944a401c53dbcbc9 not found: ID does not exist"
Jul 22 16:30:12.493011 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:30:12.492988    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-nxdm8\" is forbidden: User \"system:node:ip-10-0-142-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-32.ec2.internal' and this object" podUID="60334feb-c986-4787-bb86-0ade2b7623ab" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxdm8"
Jul 22 16:30:13.373867 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:13.373828    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60334feb-c986-4787-bb86-0ade2b7623ab" path="/var/lib/kubelet/pods/60334feb-c986-4787-bb86-0ade2b7623ab/volumes"
Jul 22 16:30:14.495358 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:14.495320    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8gxc" event={"ID":"e87d06d2-1c93-4c2e-a473-18eca2c46d9d","Type":"ContainerStarted","Data":"428253de80c1071d29ea78ca2fa0a0a9c51d2dce8b3a20dfc19dbc1a514394e0"}
Jul 22 16:30:14.495799 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:14.495428    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8gxc"
Jul 22 16:30:14.512491 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:14.512436    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8gxc" podStartSLOduration=2.261544202 podStartE2EDuration="3.512419584s" totalImagesPullingTime="1.250875382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:30:14.512072338 +0000 UTC m=+443.864348361" watchObservedRunningTime="2026-07-22 16:30:14.512419584 +0000 UTC m=+443.864695604"
Jul 22 16:30:25.501518 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:25.501482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8gxc"
Jul 22 16:30:52.131378 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:52.131339    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-x9j7p"]
Jul 22 16:30:52.134942 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:52.134922    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x9j7p"
Jul 22 16:30:52.137395 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:52.137376    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dmhxd\""
Jul 22 16:30:52.142869 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:52.142845    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x9j7p"]
Jul 22 16:30:52.231799 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:52.231766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk8qt\" (UniqueName: \"kubernetes.io/projected/2f840fcc-0b8f-464a-8edd-1a68440153de-kube-api-access-bk8qt\") pod \"authorino-75d556bd77-x9j7p\" (UID: \"2f840fcc-0b8f-464a-8edd-1a68440153de\") " pod="kuadrant-system/authorino-75d556bd77-x9j7p"
Jul 22 16:30:52.332405 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:52.332373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk8qt\" (UniqueName: \"kubernetes.io/projected/2f840fcc-0b8f-464a-8edd-1a68440153de-kube-api-access-bk8qt\") pod \"authorino-75d556bd77-x9j7p\" (UID: \"2f840fcc-0b8f-464a-8edd-1a68440153de\") " pod="kuadrant-system/authorino-75d556bd77-x9j7p"
Jul 22 16:30:52.340444 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:52.340417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk8qt\" (UniqueName: \"kubernetes.io/projected/2f840fcc-0b8f-464a-8edd-1a68440153de-kube-api-access-bk8qt\") pod \"authorino-75d556bd77-x9j7p\" (UID: \"2f840fcc-0b8f-464a-8edd-1a68440153de\") " pod="kuadrant-system/authorino-75d556bd77-x9j7p"
Jul 22 16:30:52.444153 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:52.444121    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x9j7p"
Jul 22 16:30:52.575133 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:52.575106    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x9j7p"]
Jul 22 16:30:52.576920 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:30:52.576895    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f840fcc_0b8f_464a_8edd_1a68440153de.slice/crio-6d88953018864cdf235f114a3274bfa3907b566fdcf9352b875f15f28efa9acc WatchSource:0}: Error finding container 6d88953018864cdf235f114a3274bfa3907b566fdcf9352b875f15f28efa9acc: Status 404 returned error can't find the container with id 6d88953018864cdf235f114a3274bfa3907b566fdcf9352b875f15f28efa9acc
Jul 22 16:30:52.677995 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:52.677962    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x9j7p" event={"ID":"2f840fcc-0b8f-464a-8edd-1a68440153de","Type":"ContainerStarted","Data":"6d88953018864cdf235f114a3274bfa3907b566fdcf9352b875f15f28efa9acc"}
Jul 22 16:30:55.701462 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:55.701425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x9j7p" event={"ID":"2f840fcc-0b8f-464a-8edd-1a68440153de","Type":"ContainerStarted","Data":"a83fde1a2326c62f2cb400438b02124c4040b1020d3adee8a0f551abedda30ca"}
Jul 22 16:30:55.716491 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:30:55.716435    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-x9j7p" podStartSLOduration=0.92896764 podStartE2EDuration="3.716416406s" totalImagesPullingTime="2.787448766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:30:55.7160305 +0000 UTC m=+485.068306513" watchObservedRunningTime="2026-07-22 16:30:55.716416406 +0000 UTC m=+485.068692438"
Jul 22 16:31:22.434350 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.434311    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x9j7p"]
Jul 22 16:31:22.435169 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.434529    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-x9j7p" podUID="2f840fcc-0b8f-464a-8edd-1a68440153de" containerName="authorino" containerID="cri-o://a83fde1a2326c62f2cb400438b02124c4040b1020d3adee8a0f551abedda30ca" gracePeriod=30
Jul 22 16:31:22.682342 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.682319    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x9j7p"
Jul 22 16:31:22.704317 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.704246    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk8qt\" (UniqueName: \"kubernetes.io/projected/2f840fcc-0b8f-464a-8edd-1a68440153de-kube-api-access-bk8qt\") pod \"2f840fcc-0b8f-464a-8edd-1a68440153de\" (UID: \"2f840fcc-0b8f-464a-8edd-1a68440153de\") "
Jul 22 16:31:22.706213 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.706185    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f840fcc-0b8f-464a-8edd-1a68440153de-kube-api-access-bk8qt" (OuterVolumeSpecName: "kube-api-access-bk8qt") pod "2f840fcc-0b8f-464a-8edd-1a68440153de" (UID: "2f840fcc-0b8f-464a-8edd-1a68440153de"). InnerVolumeSpecName "kube-api-access-bk8qt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:31:22.805375 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.805343    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk8qt\" (UniqueName: \"kubernetes.io/projected/2f840fcc-0b8f-464a-8edd-1a68440153de-kube-api-access-bk8qt\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:31:22.826781 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.826750    2580 generic.go:356] "Generic (PLEG): container finished" podID="2f840fcc-0b8f-464a-8edd-1a68440153de" containerID="a83fde1a2326c62f2cb400438b02124c4040b1020d3adee8a0f551abedda30ca" exitCode=0
Jul 22 16:31:22.826908 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.826785    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x9j7p"
Jul 22 16:31:22.826908 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.826824    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x9j7p" event={"ID":"2f840fcc-0b8f-464a-8edd-1a68440153de","Type":"ContainerDied","Data":"a83fde1a2326c62f2cb400438b02124c4040b1020d3adee8a0f551abedda30ca"}
Jul 22 16:31:22.826908 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.826860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x9j7p" event={"ID":"2f840fcc-0b8f-464a-8edd-1a68440153de","Type":"ContainerDied","Data":"6d88953018864cdf235f114a3274bfa3907b566fdcf9352b875f15f28efa9acc"}
Jul 22 16:31:22.826908 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.826876    2580 scope.go:117] "RemoveContainer" containerID="a83fde1a2326c62f2cb400438b02124c4040b1020d3adee8a0f551abedda30ca"
Jul 22 16:31:22.835881 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.835863    2580 scope.go:117] "RemoveContainer" containerID="a83fde1a2326c62f2cb400438b02124c4040b1020d3adee8a0f551abedda30ca"
Jul 22 16:31:22.836144 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:31:22.836126    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a83fde1a2326c62f2cb400438b02124c4040b1020d3adee8a0f551abedda30ca\": container with ID starting with a83fde1a2326c62f2cb400438b02124c4040b1020d3adee8a0f551abedda30ca not found: ID does not exist" containerID="a83fde1a2326c62f2cb400438b02124c4040b1020d3adee8a0f551abedda30ca"
Jul 22 16:31:22.836187 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.836152    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a83fde1a2326c62f2cb400438b02124c4040b1020d3adee8a0f551abedda30ca"} err="failed to get container status \"a83fde1a2326c62f2cb400438b02124c4040b1020d3adee8a0f551abedda30ca\": rpc error: code = NotFound desc = could not find container \"a83fde1a2326c62f2cb400438b02124c4040b1020d3adee8a0f551abedda30ca\": container with ID starting with a83fde1a2326c62f2cb400438b02124c4040b1020d3adee8a0f551abedda30ca not found: ID does not exist"
Jul 22 16:31:22.847042 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.847006    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x9j7p"]
Jul 22 16:31:22.850273 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:22.850249    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x9j7p"]
Jul 22 16:31:23.372483 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:23.372448    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f840fcc-0b8f-464a-8edd-1a68440153de" path="/var/lib/kubelet/pods/2f840fcc-0b8f-464a-8edd-1a68440153de/volumes"
Jul 22 16:31:27.397627 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.397589    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d779b9754-65jjr"]
Jul 22 16:31:27.398157 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.398141    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f840fcc-0b8f-464a-8edd-1a68440153de" containerName="authorino"
Jul 22 16:31:27.398230 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.398162    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f840fcc-0b8f-464a-8edd-1a68440153de" containerName="authorino"
Jul 22 16:31:27.398283 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.398266    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f840fcc-0b8f-464a-8edd-1a68440153de" containerName="authorino"
Jul 22 16:31:27.402733 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.402711    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d779b9754-65jjr"
Jul 22 16:31:27.406243 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.406223    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 16:31:27.406243 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.406234    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 16:31:27.406407 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.406238    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w2s7k\""
Jul 22 16:31:27.412002 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.411978    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d779b9754-65jjr"]
Jul 22 16:31:27.449205 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.449175    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54ed7b07-dc23-4fb8-bed0-a02b04948f21-webhook-cert\") pod \"maas-controller-7d779b9754-65jjr\" (UID: \"54ed7b07-dc23-4fb8-bed0-a02b04948f21\") " pod="opendatahub/maas-controller-7d779b9754-65jjr"
Jul 22 16:31:27.449345 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.449296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq5hx\" (UniqueName: \"kubernetes.io/projected/54ed7b07-dc23-4fb8-bed0-a02b04948f21-kube-api-access-nq5hx\") pod \"maas-controller-7d779b9754-65jjr\" (UID: \"54ed7b07-dc23-4fb8-bed0-a02b04948f21\") " pod="opendatahub/maas-controller-7d779b9754-65jjr"
Jul 22 16:31:27.550390 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.550357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54ed7b07-dc23-4fb8-bed0-a02b04948f21-webhook-cert\") pod \"maas-controller-7d779b9754-65jjr\" (UID: \"54ed7b07-dc23-4fb8-bed0-a02b04948f21\") " pod="opendatahub/maas-controller-7d779b9754-65jjr"
Jul 22 16:31:27.550553 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.550408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq5hx\" (UniqueName: \"kubernetes.io/projected/54ed7b07-dc23-4fb8-bed0-a02b04948f21-kube-api-access-nq5hx\") pod \"maas-controller-7d779b9754-65jjr\" (UID: \"54ed7b07-dc23-4fb8-bed0-a02b04948f21\") " pod="opendatahub/maas-controller-7d779b9754-65jjr"
Jul 22 16:31:27.552900 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.552877    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54ed7b07-dc23-4fb8-bed0-a02b04948f21-webhook-cert\") pod \"maas-controller-7d779b9754-65jjr\" (UID: \"54ed7b07-dc23-4fb8-bed0-a02b04948f21\") " pod="opendatahub/maas-controller-7d779b9754-65jjr"
Jul 22 16:31:27.559063 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.559014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq5hx\" (UniqueName: \"kubernetes.io/projected/54ed7b07-dc23-4fb8-bed0-a02b04948f21-kube-api-access-nq5hx\") pod \"maas-controller-7d779b9754-65jjr\" (UID: \"54ed7b07-dc23-4fb8-bed0-a02b04948f21\") " pod="opendatahub/maas-controller-7d779b9754-65jjr"
Jul 22 16:31:27.713375 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.713300    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d779b9754-65jjr"
Jul 22 16:31:27.854304 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:27.851578    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d779b9754-65jjr"]
Jul 22 16:31:27.858856 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:31:27.858826    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ed7b07_dc23_4fb8_bed0_a02b04948f21.slice/crio-fdea01b2ad0e7ab5945f8b297875ff8c9599afcf14830a2d028ab392f9beeeb5 WatchSource:0}: Error finding container fdea01b2ad0e7ab5945f8b297875ff8c9599afcf14830a2d028ab392f9beeeb5: Status 404 returned error can't find the container with id fdea01b2ad0e7ab5945f8b297875ff8c9599afcf14830a2d028ab392f9beeeb5
Jul 22 16:31:28.865214 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:28.865167    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d779b9754-65jjr" event={"ID":"54ed7b07-dc23-4fb8-bed0-a02b04948f21","Type":"ContainerStarted","Data":"fdea01b2ad0e7ab5945f8b297875ff8c9599afcf14830a2d028ab392f9beeeb5"}
Jul 22 16:31:30.878289 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:30.878205    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d779b9754-65jjr" event={"ID":"54ed7b07-dc23-4fb8-bed0-a02b04948f21","Type":"ContainerStarted","Data":"387b3ac8f798d600e3f8b45fad5a3aa3db7c239dfbda5a5b2588101ced795486"}
Jul 22 16:31:30.878629 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:30.878290    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d779b9754-65jjr"
Jul 22 16:31:30.896279 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:30.896234    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d779b9754-65jjr" podStartSLOduration=1.562687371 podStartE2EDuration="3.896220903s" totalImagesPullingTime="2.333533532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:31:30.895095152 +0000 UTC m=+520.247371173" watchObservedRunningTime="2026-07-22 16:31:30.896220903 +0000 UTC m=+520.248496924"
Jul 22 16:31:41.885218 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:31:41.885187    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d779b9754-65jjr"
Jul 22 16:32:03.759521 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.759485    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"]
Jul 22 16:32:03.764634 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.764604    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"
Jul 22 16:32:03.767209 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.767187    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 16:32:03.767209 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.767199    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 16:32:03.768201 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.768184    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 22 16:32:03.773760 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.773737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwrdz\" (UniqueName: \"kubernetes.io/projected/64020149-f5e3-4e7c-bafa-46b5c363fdbb-kube-api-access-rwrdz\") pod \"maas-api-86764bbb8-pbrsc\" (UID: \"64020149-f5e3-4e7c-bafa-46b5c363fdbb\") " pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"
Jul 22 16:32:03.773889 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.773826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64020149-f5e3-4e7c-bafa-46b5c363fdbb-openshift-service-ca\") pod \"maas-api-86764bbb8-pbrsc\" (UID: \"64020149-f5e3-4e7c-bafa-46b5c363fdbb\") " pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"
Jul 22 16:32:03.773986 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.773965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64020149-f5e3-4e7c-bafa-46b5c363fdbb-maas-api-tls\") pod \"maas-api-86764bbb8-pbrsc\" (UID: \"64020149-f5e3-4e7c-bafa-46b5c363fdbb\") " pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"
Jul 22 16:32:03.775415 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.775391    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"]
Jul 22 16:32:03.874658 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.874623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64020149-f5e3-4e7c-bafa-46b5c363fdbb-openshift-service-ca\") pod \"maas-api-86764bbb8-pbrsc\" (UID: \"64020149-f5e3-4e7c-bafa-46b5c363fdbb\") " pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"
Jul 22 16:32:03.874803 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.874687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64020149-f5e3-4e7c-bafa-46b5c363fdbb-maas-api-tls\") pod \"maas-api-86764bbb8-pbrsc\" (UID: \"64020149-f5e3-4e7c-bafa-46b5c363fdbb\") " pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"
Jul 22 16:32:03.874803 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.874717    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwrdz\" (UniqueName: \"kubernetes.io/projected/64020149-f5e3-4e7c-bafa-46b5c363fdbb-kube-api-access-rwrdz\") pod \"maas-api-86764bbb8-pbrsc\" (UID: \"64020149-f5e3-4e7c-bafa-46b5c363fdbb\") " pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"
Jul 22 16:32:03.875430 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.875400    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64020149-f5e3-4e7c-bafa-46b5c363fdbb-openshift-service-ca\") pod \"maas-api-86764bbb8-pbrsc\" (UID: \"64020149-f5e3-4e7c-bafa-46b5c363fdbb\") " pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"
Jul 22 16:32:03.877254 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.877228    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64020149-f5e3-4e7c-bafa-46b5c363fdbb-maas-api-tls\") pod \"maas-api-86764bbb8-pbrsc\" (UID: \"64020149-f5e3-4e7c-bafa-46b5c363fdbb\") " pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"
Jul 22 16:32:03.882272 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:03.882244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwrdz\" (UniqueName: \"kubernetes.io/projected/64020149-f5e3-4e7c-bafa-46b5c363fdbb-kube-api-access-rwrdz\") pod \"maas-api-86764bbb8-pbrsc\" (UID: \"64020149-f5e3-4e7c-bafa-46b5c363fdbb\") " pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"
Jul 22 16:32:04.076028 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.075929    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"
Jul 22 16:32:04.218274 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.218242    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"]
Jul 22 16:32:04.221335 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:32:04.221280    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64020149_f5e3_4e7c_bafa_46b5c363fdbb.slice/crio-8860898e1045ce22f248eea3cd2c4f1aaf07f2b29330da99715d68276c65759f WatchSource:0}: Error finding container 8860898e1045ce22f248eea3cd2c4f1aaf07f2b29330da99715d68276c65759f: Status 404 returned error can't find the container with id 8860898e1045ce22f248eea3cd2c4f1aaf07f2b29330da99715d68276c65759f
Jul 22 16:32:04.375607 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.375536    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jn648"]
Jul 22 16:32:04.378676 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.378655    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-jn648"
Jul 22 16:32:04.381425 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.381400    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 16:32:04.381539 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.381400    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g4tpb\""
Jul 22 16:32:04.388342 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.388321    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jn648"]
Jul 22 16:32:04.479999 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.479946    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl86x\" (UniqueName: \"kubernetes.io/projected/b11c5d18-4916-42d6-8154-9c8ed61df8f8-kube-api-access-kl86x\") pod \"payload-pre-processing-7677b774bb-jn648\" (UID: \"b11c5d18-4916-42d6-8154-9c8ed61df8f8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jn648"
Jul 22 16:32:04.480212 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.480173    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11c5d18-4916-42d6-8154-9c8ed61df8f8-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jn648\" (UID: \"b11c5d18-4916-42d6-8154-9c8ed61df8f8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jn648"
Jul 22 16:32:04.581466 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.581431    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11c5d18-4916-42d6-8154-9c8ed61df8f8-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jn648\" (UID: \"b11c5d18-4916-42d6-8154-9c8ed61df8f8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jn648"
Jul 22 16:32:04.581671 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.581490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl86x\" (UniqueName: \"kubernetes.io/projected/b11c5d18-4916-42d6-8154-9c8ed61df8f8-kube-api-access-kl86x\") pod \"payload-pre-processing-7677b774bb-jn648\" (UID: \"b11c5d18-4916-42d6-8154-9c8ed61df8f8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jn648"
Jul 22 16:32:04.582216 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.582194    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11c5d18-4916-42d6-8154-9c8ed61df8f8-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jn648\" (UID: \"b11c5d18-4916-42d6-8154-9c8ed61df8f8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jn648"
Jul 22 16:32:04.589820 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.589795    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl86x\" (UniqueName: \"kubernetes.io/projected/b11c5d18-4916-42d6-8154-9c8ed61df8f8-kube-api-access-kl86x\") pod \"payload-pre-processing-7677b774bb-jn648\" (UID: \"b11c5d18-4916-42d6-8154-9c8ed61df8f8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jn648"
Jul 22 16:32:04.689841 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.689811    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-jn648"
Jul 22 16:32:04.820281 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:04.820258    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jn648"]
Jul 22 16:32:04.822131 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:32:04.822102    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11c5d18_4916_42d6_8154_9c8ed61df8f8.slice/crio-15669554f25d9987dedfaada0ef96114907f922e13cfe8609f04c8f578018326 WatchSource:0}: Error finding container 15669554f25d9987dedfaada0ef96114907f922e13cfe8609f04c8f578018326: Status 404 returned error can't find the container with id 15669554f25d9987dedfaada0ef96114907f922e13cfe8609f04c8f578018326
Jul 22 16:32:05.050144 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:05.050057    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-jn648" event={"ID":"b11c5d18-4916-42d6-8154-9c8ed61df8f8","Type":"ContainerStarted","Data":"15669554f25d9987dedfaada0ef96114907f922e13cfe8609f04c8f578018326"}
Jul 22 16:32:05.051632 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:05.051601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc" event={"ID":"64020149-f5e3-4e7c-bafa-46b5c363fdbb","Type":"ContainerStarted","Data":"8860898e1045ce22f248eea3cd2c4f1aaf07f2b29330da99715d68276c65759f"}
Jul 22 16:32:07.066192 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:07.066155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-jn648" event={"ID":"b11c5d18-4916-42d6-8154-9c8ed61df8f8","Type":"ContainerStarted","Data":"1c5958affd0258258bccb7f33a8e1bf0fa80dc0e3683cd4289853f1753963d19"}
Jul 22 16:32:07.066661 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:07.066220    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-jn648"
Jul 22 16:32:07.067663 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:07.067635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc" event={"ID":"64020149-f5e3-4e7c-bafa-46b5c363fdbb","Type":"ContainerStarted","Data":"4fccb9982e9596a975fd1f92be2da3566aa3503126c0aa12612e058bf63b25cb"}
Jul 22 16:32:07.067795 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:07.067752    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"
Jul 22 16:32:07.081561 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:07.081516    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-jn648" podStartSLOduration=1.559817844 podStartE2EDuration="3.081501822s" totalImagesPullingTime="1.521683978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:32:07.080684997 +0000 UTC m=+556.432961020" watchObservedRunningTime="2026-07-22 16:32:07.081501822 +0000 UTC m=+556.433777841"
Jul 22 16:32:07.096963 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:07.096921    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc" podStartSLOduration=1.999208165 podStartE2EDuration="4.096907759s" totalImagesPullingTime="2.097699594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:32:07.095483095 +0000 UTC m=+556.447759117" watchObservedRunningTime="2026-07-22 16:32:07.096907759 +0000 UTC m=+556.449183778"
Jul 22 16:32:13.078306 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:13.078272    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-86764bbb8-pbrsc"
Jul 22 16:32:18.075211 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:18.075175    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-jn648"
Jul 22 16:32:40.095627 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.095594    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"]
Jul 22 16:32:40.100336 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.100315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.104600 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.104569    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 16:32:40.104600 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.104586    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 22 16:32:40.104785 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.104617    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 16:32:40.104785 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.104681    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wr8qt\""
Jul 22 16:32:40.109360 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.109340    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"]
Jul 22 16:32:40.205884 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.205852    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxr92\" (UniqueName: \"kubernetes.io/projected/adbd5968-ae2a-4c38-b06a-4927125a2100-kube-api-access-vxr92\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.205884 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.205886    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adbd5968-ae2a-4c38-b06a-4927125a2100-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.206136 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.205940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adbd5968-ae2a-4c38-b06a-4927125a2100-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.206136 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.205970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adbd5968-ae2a-4c38-b06a-4927125a2100-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.206136 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.205990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adbd5968-ae2a-4c38-b06a-4927125a2100-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.206136 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.206108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adbd5968-ae2a-4c38-b06a-4927125a2100-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.306782 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.306744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxr92\" (UniqueName: \"kubernetes.io/projected/adbd5968-ae2a-4c38-b06a-4927125a2100-kube-api-access-vxr92\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.306782 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.306783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adbd5968-ae2a-4c38-b06a-4927125a2100-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.306995 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.306826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adbd5968-ae2a-4c38-b06a-4927125a2100-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.306995 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.306856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adbd5968-ae2a-4c38-b06a-4927125a2100-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.306995 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.306875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adbd5968-ae2a-4c38-b06a-4927125a2100-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.306995 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.306903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adbd5968-ae2a-4c38-b06a-4927125a2100-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.307307 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.307274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adbd5968-ae2a-4c38-b06a-4927125a2100-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.307420 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.307329    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adbd5968-ae2a-4c38-b06a-4927125a2100-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.307420 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.307382    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adbd5968-ae2a-4c38-b06a-4927125a2100-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.309183 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.309166    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adbd5968-ae2a-4c38-b06a-4927125a2100-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.309454 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.309435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adbd5968-ae2a-4c38-b06a-4927125a2100-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.314288 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.314266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxr92\" (UniqueName: \"kubernetes.io/projected/adbd5968-ae2a-4c38-b06a-4927125a2100-kube-api-access-vxr92\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mb8sw\" (UID: \"adbd5968-ae2a-4c38-b06a-4927125a2100\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.411753 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.411724    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:40.542952 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:40.542923    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"]
Jul 22 16:32:40.544884 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:32:40.544853    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadbd5968_ae2a_4c38_b06a_4927125a2100.slice/crio-2056c97b6b98ba7dd24a828761ced101a6ae36d0b7d44a119034f619d33a95d4 WatchSource:0}: Error finding container 2056c97b6b98ba7dd24a828761ced101a6ae36d0b7d44a119034f619d33a95d4: Status 404 returned error can't find the container with id 2056c97b6b98ba7dd24a828761ced101a6ae36d0b7d44a119034f619d33a95d4
Jul 22 16:32:41.240406 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:41.240369    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw" event={"ID":"adbd5968-ae2a-4c38-b06a-4927125a2100","Type":"ContainerStarted","Data":"2056c97b6b98ba7dd24a828761ced101a6ae36d0b7d44a119034f619d33a95d4"}
Jul 22 16:32:42.246325 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:42.246290    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw" event={"ID":"adbd5968-ae2a-4c38-b06a-4927125a2100","Type":"ContainerStarted","Data":"7b5807d30d8d7b62080f3259fe6870cdac6ba7599c84918c3688af3d38216ea2"}
Jul 22 16:32:42.264425 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:42.264381    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw" podStartSLOduration=1.197327898 podStartE2EDuration="2.264363928s" totalImagesPullingTime="1.06703603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:32:42.262906268 +0000 UTC m=+591.615182304" watchObservedRunningTime="2026-07-22 16:32:42.264363928 +0000 UTC m=+591.616639948"
Jul 22 16:32:50.412093 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:50.412054    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:50.412586 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:50.412115    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:50.424370 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:50.424342    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:51.193485 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.193449    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"]
Jul 22 16:32:51.197014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.196990    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.199822 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.199803    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 22 16:32:51.207092 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.207071    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"]
Jul 22 16:32:51.305680 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.305643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqjcg\" (UniqueName: \"kubernetes.io/projected/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-kube-api-access-dqjcg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.305856 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.305717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.305856 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.305738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.305856 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.305800    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.305856 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.305842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.306123 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.305890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.306284 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.306261    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mb8sw"
Jul 22 16:32:51.407131 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.407097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqjcg\" (UniqueName: \"kubernetes.io/projected/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-kube-api-access-dqjcg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.407304 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.407167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.407304 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.407187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.407447 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.407420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.407503 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.407476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.407571 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.407555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.407668 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.407647    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.407799 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.407776    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.407875 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.407861    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.409514 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.409497    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.412299 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.412277    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 22 16:32:51.418384 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.418364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqjcg\" (UniqueName: \"kubernetes.io/projected/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-kube-api-access-dqjcg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.420106 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.420087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2fad8cf-9dc2-45b3-9240-4bde2ec49362-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4\" (UID: \"c2fad8cf-9dc2-45b3-9240-4bde2ec49362\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.507879 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.507803    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:32:51.642546 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:51.642521    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"]
Jul 22 16:32:51.644882 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:32:51.644856    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2fad8cf_9dc2_45b3_9240_4bde2ec49362.slice/crio-bb2b6629a5bb5cdae1369ec1315e39219dc97af8787cc7f8de50382f9f181931 WatchSource:0}: Error finding container bb2b6629a5bb5cdae1369ec1315e39219dc97af8787cc7f8de50382f9f181931: Status 404 returned error can't find the container with id bb2b6629a5bb5cdae1369ec1315e39219dc97af8787cc7f8de50382f9f181931
Jul 22 16:32:52.297387 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:52.297282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4" event={"ID":"c2fad8cf-9dc2-45b3-9240-4bde2ec49362","Type":"ContainerStarted","Data":"bf3ef3178216bef265c493ef0bd922ff73bad16f6fd0c12ff24641ed5ecf1b05"}
Jul 22 16:32:52.297387 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:52.297341    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4" event={"ID":"c2fad8cf-9dc2-45b3-9240-4bde2ec49362","Type":"ContainerStarted","Data":"bb2b6629a5bb5cdae1369ec1315e39219dc97af8787cc7f8de50382f9f181931"}
Jul 22 16:32:52.314830 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:32:52.314785    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4" podStartSLOduration=1.11533072 podStartE2EDuration="1.314770295s" totalImagesPullingTime="199.439575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:32:52.313916224 +0000 UTC m=+601.666192245" watchObservedRunningTime="2026-07-22 16:32:52.314770295 +0000 UTC m=+601.667046314"
Jul 22 16:33:01.508445 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:01.508410    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:33:01.508882 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:01.508466    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:33:01.521224 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:01.521199    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:33:02.357120 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:02.357087    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4"
Jul 22 16:33:18.794982 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:18.794890    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"]
Jul 22 16:33:18.798621 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:18.798602    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:18.801248 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:18.801223    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 22 16:33:18.807765 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:18.807738    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"]
Jul 22 16:33:18.959206 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:18.959171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3592305-7c2a-4fe0-8788-46c5f89f0984-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:18.959378 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:18.959229    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x98ng\" (UniqueName: \"kubernetes.io/projected/b3592305-7c2a-4fe0-8788-46c5f89f0984-kube-api-access-x98ng\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:18.959378 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:18.959263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3592305-7c2a-4fe0-8788-46c5f89f0984-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:18.959378 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:18.959310    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3592305-7c2a-4fe0-8788-46c5f89f0984-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:18.959378 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:18.959338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3592305-7c2a-4fe0-8788-46c5f89f0984-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:18.959527 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:18.959380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3592305-7c2a-4fe0-8788-46c5f89f0984-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.060538 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.060449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x98ng\" (UniqueName: \"kubernetes.io/projected/b3592305-7c2a-4fe0-8788-46c5f89f0984-kube-api-access-x98ng\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.060538 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.060505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3592305-7c2a-4fe0-8788-46c5f89f0984-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.060746 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.060553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3592305-7c2a-4fe0-8788-46c5f89f0984-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.060746 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.060597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3592305-7c2a-4fe0-8788-46c5f89f0984-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.060746 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.060628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3592305-7c2a-4fe0-8788-46c5f89f0984-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.060746 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.060712    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3592305-7c2a-4fe0-8788-46c5f89f0984-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.061126 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.061099    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3592305-7c2a-4fe0-8788-46c5f89f0984-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.061222 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.061145    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3592305-7c2a-4fe0-8788-46c5f89f0984-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.061222 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.061142    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3592305-7c2a-4fe0-8788-46c5f89f0984-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.062931 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.062906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3592305-7c2a-4fe0-8788-46c5f89f0984-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.063158 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.063139    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3592305-7c2a-4fe0-8788-46c5f89f0984-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.067997 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.067972    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x98ng\" (UniqueName: \"kubernetes.io/projected/b3592305-7c2a-4fe0-8788-46c5f89f0984-kube-api-access-x98ng\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8l98m\" (UID: \"b3592305-7c2a-4fe0-8788-46c5f89f0984\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.110134 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.110106    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:19.244433 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.244410    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"]
Jul 22 16:33:19.246714 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:33:19.246688    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3592305_7c2a_4fe0_8788_46c5f89f0984.slice/crio-6ab8be1263586f21620b88906511d440a01bc8f709da6d7b8138294c66eb5013 WatchSource:0}: Error finding container 6ab8be1263586f21620b88906511d440a01bc8f709da6d7b8138294c66eb5013: Status 404 returned error can't find the container with id 6ab8be1263586f21620b88906511d440a01bc8f709da6d7b8138294c66eb5013
Jul 22 16:33:19.248014 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.247995    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 16:33:19.425629 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:19.425598    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m" event={"ID":"b3592305-7c2a-4fe0-8788-46c5f89f0984","Type":"ContainerStarted","Data":"6ab8be1263586f21620b88906511d440a01bc8f709da6d7b8138294c66eb5013"}
Jul 22 16:33:20.432333 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:20.432298    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m" event={"ID":"b3592305-7c2a-4fe0-8788-46c5f89f0984","Type":"ContainerStarted","Data":"51d7d3ede8b3e36af33fbb683c55799ba5d06429691928d81b00d2ded6524609"}
Jul 22 16:33:20.448743 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:20.448702    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m" podStartSLOduration=2.252741279 podStartE2EDuration="2.448687787s" totalImagesPullingTime="195.946508ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:33:20.447435131 +0000 UTC m=+629.799711151" watchObservedRunningTime="2026-07-22 16:33:20.448687787 +0000 UTC m=+629.800963801"
Jul 22 16:33:29.110464 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:29.110421    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:29.110922 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:29.110482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:29.123253 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:29.123221    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:33:29.489238 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:33:29.489205    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8l98m"
Jul 22 16:35:08.736120 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:08.736086    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d779b9754-65jjr"]
Jul 22 16:35:08.736631 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:08.736281    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7d779b9754-65jjr" podUID="54ed7b07-dc23-4fb8-bed0-a02b04948f21" containerName="manager" containerID="cri-o://387b3ac8f798d600e3f8b45fad5a3aa3db7c239dfbda5a5b2588101ced795486" gracePeriod=30
Jul 22 16:35:08.977037 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:08.976980    2580 generic.go:356] "Generic (PLEG): container finished" podID="54ed7b07-dc23-4fb8-bed0-a02b04948f21" containerID="387b3ac8f798d600e3f8b45fad5a3aa3db7c239dfbda5a5b2588101ced795486" exitCode=0
Jul 22 16:35:08.977165 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:08.977048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d779b9754-65jjr" event={"ID":"54ed7b07-dc23-4fb8-bed0-a02b04948f21","Type":"ContainerDied","Data":"387b3ac8f798d600e3f8b45fad5a3aa3db7c239dfbda5a5b2588101ced795486"}
Jul 22 16:35:08.977165 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:08.977102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d779b9754-65jjr" event={"ID":"54ed7b07-dc23-4fb8-bed0-a02b04948f21","Type":"ContainerDied","Data":"fdea01b2ad0e7ab5945f8b297875ff8c9599afcf14830a2d028ab392f9beeeb5"}
Jul 22 16:35:08.977165 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:08.977125    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdea01b2ad0e7ab5945f8b297875ff8c9599afcf14830a2d028ab392f9beeeb5"
Jul 22 16:35:08.981693 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:08.981674    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d779b9754-65jjr"
Jul 22 16:35:09.087079 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:09.086993    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54ed7b07-dc23-4fb8-bed0-a02b04948f21-webhook-cert\") pod \"54ed7b07-dc23-4fb8-bed0-a02b04948f21\" (UID: \"54ed7b07-dc23-4fb8-bed0-a02b04948f21\") "
Jul 22 16:35:09.087079 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:09.087065    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq5hx\" (UniqueName: \"kubernetes.io/projected/54ed7b07-dc23-4fb8-bed0-a02b04948f21-kube-api-access-nq5hx\") pod \"54ed7b07-dc23-4fb8-bed0-a02b04948f21\" (UID: \"54ed7b07-dc23-4fb8-bed0-a02b04948f21\") "
Jul 22 16:35:09.089315 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:09.089286    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ed7b07-dc23-4fb8-bed0-a02b04948f21-kube-api-access-nq5hx" (OuterVolumeSpecName: "kube-api-access-nq5hx") pod "54ed7b07-dc23-4fb8-bed0-a02b04948f21" (UID: "54ed7b07-dc23-4fb8-bed0-a02b04948f21"). InnerVolumeSpecName "kube-api-access-nq5hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:35:09.089428 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:09.089358    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ed7b07-dc23-4fb8-bed0-a02b04948f21-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "54ed7b07-dc23-4fb8-bed0-a02b04948f21" (UID: "54ed7b07-dc23-4fb8-bed0-a02b04948f21"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:35:09.188164 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:09.188127    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54ed7b07-dc23-4fb8-bed0-a02b04948f21-webhook-cert\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:35:09.188164 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:09.188157    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq5hx\" (UniqueName: \"kubernetes.io/projected/54ed7b07-dc23-4fb8-bed0-a02b04948f21-kube-api-access-nq5hx\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:35:09.982462 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:09.982429    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d779b9754-65jjr"
Jul 22 16:35:09.998899 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:09.998863    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d779b9754-65jjr"]
Jul 22 16:35:10.002749 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:10.002723    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d779b9754-65jjr"]
Jul 22 16:35:11.373773 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:35:11.373737    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54ed7b07-dc23-4fb8-bed0-a02b04948f21" path="/var/lib/kubelet/pods/54ed7b07-dc23-4fb8-bed0-a02b04948f21/volumes"
Jul 22 16:36:10.819396 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:10.819355    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d779b9754-fdh6p"]
Jul 22 16:36:10.819911 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:10.819757    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ed7b07-dc23-4fb8-bed0-a02b04948f21" containerName="manager"
Jul 22 16:36:10.819911 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:10.819768    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ed7b07-dc23-4fb8-bed0-a02b04948f21" containerName="manager"
Jul 22 16:36:10.819911 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:10.819831    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ed7b07-dc23-4fb8-bed0-a02b04948f21" containerName="manager"
Jul 22 16:36:10.822990 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:10.822972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d779b9754-fdh6p"
Jul 22 16:36:10.825445 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:10.825421    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 16:36:10.826665 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:10.826650    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w2s7k\""
Jul 22 16:36:10.826750 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:10.826654    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 16:36:10.829817 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:10.829789    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d779b9754-fdh6p"]
Jul 22 16:36:10.963881 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:10.963844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw9v6\" (UniqueName: \"kubernetes.io/projected/e30af8b0-84ac-4e04-baf3-81253cd013a2-kube-api-access-pw9v6\") pod \"maas-controller-7d779b9754-fdh6p\" (UID: \"e30af8b0-84ac-4e04-baf3-81253cd013a2\") " pod="opendatahub/maas-controller-7d779b9754-fdh6p"
Jul 22 16:36:10.963881 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:10.963887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e30af8b0-84ac-4e04-baf3-81253cd013a2-webhook-cert\") pod \"maas-controller-7d779b9754-fdh6p\" (UID: \"e30af8b0-84ac-4e04-baf3-81253cd013a2\") " pod="opendatahub/maas-controller-7d779b9754-fdh6p"
Jul 22 16:36:11.064805 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:11.064771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw9v6\" (UniqueName: \"kubernetes.io/projected/e30af8b0-84ac-4e04-baf3-81253cd013a2-kube-api-access-pw9v6\") pod \"maas-controller-7d779b9754-fdh6p\" (UID: \"e30af8b0-84ac-4e04-baf3-81253cd013a2\") " pod="opendatahub/maas-controller-7d779b9754-fdh6p"
Jul 22 16:36:11.064805 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:11.064808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e30af8b0-84ac-4e04-baf3-81253cd013a2-webhook-cert\") pod \"maas-controller-7d779b9754-fdh6p\" (UID: \"e30af8b0-84ac-4e04-baf3-81253cd013a2\") " pod="opendatahub/maas-controller-7d779b9754-fdh6p"
Jul 22 16:36:11.067217 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:11.067198    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e30af8b0-84ac-4e04-baf3-81253cd013a2-webhook-cert\") pod \"maas-controller-7d779b9754-fdh6p\" (UID: \"e30af8b0-84ac-4e04-baf3-81253cd013a2\") " pod="opendatahub/maas-controller-7d779b9754-fdh6p"
Jul 22 16:36:11.072159 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:11.072106    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw9v6\" (UniqueName: \"kubernetes.io/projected/e30af8b0-84ac-4e04-baf3-81253cd013a2-kube-api-access-pw9v6\") pod \"maas-controller-7d779b9754-fdh6p\" (UID: \"e30af8b0-84ac-4e04-baf3-81253cd013a2\") " pod="opendatahub/maas-controller-7d779b9754-fdh6p"
Jul 22 16:36:11.133993 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:11.133963    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d779b9754-fdh6p"
Jul 22 16:36:11.266938 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:11.266905    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d779b9754-fdh6p"]
Jul 22 16:36:11.268176 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:36:11.268142    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30af8b0_84ac_4e04_baf3_81253cd013a2.slice/crio-905fc3a5d24570b6c1fdb667b12097f5e22fe8c5346bdc535c75caa71a1672a4 WatchSource:0}: Error finding container 905fc3a5d24570b6c1fdb667b12097f5e22fe8c5346bdc535c75caa71a1672a4: Status 404 returned error can't find the container with id 905fc3a5d24570b6c1fdb667b12097f5e22fe8c5346bdc535c75caa71a1672a4
Jul 22 16:36:11.287897 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:11.287867    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d779b9754-fdh6p" event={"ID":"e30af8b0-84ac-4e04-baf3-81253cd013a2","Type":"ContainerStarted","Data":"905fc3a5d24570b6c1fdb667b12097f5e22fe8c5346bdc535c75caa71a1672a4"}
Jul 22 16:36:12.294274 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:12.294237    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d779b9754-fdh6p" event={"ID":"e30af8b0-84ac-4e04-baf3-81253cd013a2","Type":"ContainerStarted","Data":"79b84565b91fe26c894397ae609cfc78e0c5f789a5f48d9dcfb3a5ddefb59370"}
Jul 22 16:36:12.294738 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:12.294308    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d779b9754-fdh6p"
Jul 22 16:36:12.311541 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:12.311481    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d779b9754-fdh6p" podStartSLOduration=1.749843439 podStartE2EDuration="2.311465323s" totalImagesPullingTime="561.621884ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:36:12.31106428 +0000 UTC m=+801.663340300" watchObservedRunningTime="2026-07-22 16:36:12.311465323 +0000 UTC m=+801.663741344"
Jul 22 16:36:23.301888 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:23.301856    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d779b9754-fdh6p"
Jul 22 16:36:27.946276 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:27.946235    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d779b9754-fdh6p"]
Jul 22 16:36:27.946713 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:27.946442    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7d779b9754-fdh6p" podUID="e30af8b0-84ac-4e04-baf3-81253cd013a2" containerName="manager" containerID="cri-o://79b84565b91fe26c894397ae609cfc78e0c5f789a5f48d9dcfb3a5ddefb59370" gracePeriod=30
Jul 22 16:36:28.293960 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.293935    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d779b9754-fdh6p"
Jul 22 16:36:28.372114 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.372082    2580 generic.go:356] "Generic (PLEG): container finished" podID="e30af8b0-84ac-4e04-baf3-81253cd013a2" containerID="79b84565b91fe26c894397ae609cfc78e0c5f789a5f48d9dcfb3a5ddefb59370" exitCode=0
Jul 22 16:36:28.372250 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.372126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d779b9754-fdh6p" event={"ID":"e30af8b0-84ac-4e04-baf3-81253cd013a2","Type":"ContainerDied","Data":"79b84565b91fe26c894397ae609cfc78e0c5f789a5f48d9dcfb3a5ddefb59370"}
Jul 22 16:36:28.372250 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.372160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d779b9754-fdh6p" event={"ID":"e30af8b0-84ac-4e04-baf3-81253cd013a2","Type":"ContainerDied","Data":"905fc3a5d24570b6c1fdb667b12097f5e22fe8c5346bdc535c75caa71a1672a4"}
Jul 22 16:36:28.372250 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.372182    2580 scope.go:117] "RemoveContainer" containerID="79b84565b91fe26c894397ae609cfc78e0c5f789a5f48d9dcfb3a5ddefb59370"
Jul 22 16:36:28.372250 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.372127    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d779b9754-fdh6p"
Jul 22 16:36:28.380557 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.380539    2580 scope.go:117] "RemoveContainer" containerID="79b84565b91fe26c894397ae609cfc78e0c5f789a5f48d9dcfb3a5ddefb59370"
Jul 22 16:36:28.380836 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:36:28.380813    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79b84565b91fe26c894397ae609cfc78e0c5f789a5f48d9dcfb3a5ddefb59370\": container with ID starting with 79b84565b91fe26c894397ae609cfc78e0c5f789a5f48d9dcfb3a5ddefb59370 not found: ID does not exist" containerID="79b84565b91fe26c894397ae609cfc78e0c5f789a5f48d9dcfb3a5ddefb59370"
Jul 22 16:36:28.380881 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.380844    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b84565b91fe26c894397ae609cfc78e0c5f789a5f48d9dcfb3a5ddefb59370"} err="failed to get container status \"79b84565b91fe26c894397ae609cfc78e0c5f789a5f48d9dcfb3a5ddefb59370\": rpc error: code = NotFound desc = could not find container \"79b84565b91fe26c894397ae609cfc78e0c5f789a5f48d9dcfb3a5ddefb59370\": container with ID starting with 79b84565b91fe26c894397ae609cfc78e0c5f789a5f48d9dcfb3a5ddefb59370 not found: ID does not exist"
Jul 22 16:36:28.423710 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.423671    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e30af8b0-84ac-4e04-baf3-81253cd013a2-webhook-cert\") pod \"e30af8b0-84ac-4e04-baf3-81253cd013a2\" (UID: \"e30af8b0-84ac-4e04-baf3-81253cd013a2\") "
Jul 22 16:36:28.423864 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.423810    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw9v6\" (UniqueName: \"kubernetes.io/projected/e30af8b0-84ac-4e04-baf3-81253cd013a2-kube-api-access-pw9v6\") pod \"e30af8b0-84ac-4e04-baf3-81253cd013a2\" (UID: \"e30af8b0-84ac-4e04-baf3-81253cd013a2\") "
Jul 22 16:36:28.425810 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.425781    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e30af8b0-84ac-4e04-baf3-81253cd013a2-kube-api-access-pw9v6" (OuterVolumeSpecName: "kube-api-access-pw9v6") pod "e30af8b0-84ac-4e04-baf3-81253cd013a2" (UID: "e30af8b0-84ac-4e04-baf3-81253cd013a2"). InnerVolumeSpecName "kube-api-access-pw9v6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:36:28.425926 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.425806    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e30af8b0-84ac-4e04-baf3-81253cd013a2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e30af8b0-84ac-4e04-baf3-81253cd013a2" (UID: "e30af8b0-84ac-4e04-baf3-81253cd013a2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:36:28.525174 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.525092    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw9v6\" (UniqueName: \"kubernetes.io/projected/e30af8b0-84ac-4e04-baf3-81253cd013a2-kube-api-access-pw9v6\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:36:28.525174 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.525124    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e30af8b0-84ac-4e04-baf3-81253cd013a2-webhook-cert\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:36:28.693698 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.693667    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d779b9754-fdh6p"]
Jul 22 16:36:28.697332 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:28.697306    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d779b9754-fdh6p"]
Jul 22 16:36:29.374114 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.374074    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e30af8b0-84ac-4e04-baf3-81253cd013a2" path="/var/lib/kubelet/pods/e30af8b0-84ac-4e04-baf3-81253cd013a2/volumes"
Jul 22 16:36:29.503540 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.503506    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d779b9754-w5pdb"]
Jul 22 16:36:29.503987 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.503967    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30af8b0-84ac-4e04-baf3-81253cd013a2" containerName="manager"
Jul 22 16:36:29.504095 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.503988    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30af8b0-84ac-4e04-baf3-81253cd013a2" containerName="manager"
Jul 22 16:36:29.504178 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.504163    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e30af8b0-84ac-4e04-baf3-81253cd013a2" containerName="manager"
Jul 22 16:36:29.508812 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.508794    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d779b9754-w5pdb"
Jul 22 16:36:29.512454 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.512430    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w2s7k\""
Jul 22 16:36:29.512586 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.512457    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 16:36:29.512586 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.512431    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 16:36:29.516972 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.516952    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d779b9754-w5pdb"]
Jul 22 16:36:29.634612 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.634537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/690f674d-2a9f-4c35-8df3-3a80a2911d3e-webhook-cert\") pod \"maas-controller-7d779b9754-w5pdb\" (UID: \"690f674d-2a9f-4c35-8df3-3a80a2911d3e\") " pod="opendatahub/maas-controller-7d779b9754-w5pdb"
Jul 22 16:36:29.634612 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.634585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdzhl\" (UniqueName: \"kubernetes.io/projected/690f674d-2a9f-4c35-8df3-3a80a2911d3e-kube-api-access-hdzhl\") pod \"maas-controller-7d779b9754-w5pdb\" (UID: \"690f674d-2a9f-4c35-8df3-3a80a2911d3e\") " pod="opendatahub/maas-controller-7d779b9754-w5pdb"
Jul 22 16:36:29.735299 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.735262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/690f674d-2a9f-4c35-8df3-3a80a2911d3e-webhook-cert\") pod \"maas-controller-7d779b9754-w5pdb\" (UID: \"690f674d-2a9f-4c35-8df3-3a80a2911d3e\") " pod="opendatahub/maas-controller-7d779b9754-w5pdb"
Jul 22 16:36:29.735462 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.735307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdzhl\" (UniqueName: \"kubernetes.io/projected/690f674d-2a9f-4c35-8df3-3a80a2911d3e-kube-api-access-hdzhl\") pod \"maas-controller-7d779b9754-w5pdb\" (UID: \"690f674d-2a9f-4c35-8df3-3a80a2911d3e\") " pod="opendatahub/maas-controller-7d779b9754-w5pdb"
Jul 22 16:36:29.737678 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.737649    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/690f674d-2a9f-4c35-8df3-3a80a2911d3e-webhook-cert\") pod \"maas-controller-7d779b9754-w5pdb\" (UID: \"690f674d-2a9f-4c35-8df3-3a80a2911d3e\") " pod="opendatahub/maas-controller-7d779b9754-w5pdb"
Jul 22 16:36:29.743762 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.743743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdzhl\" (UniqueName: \"kubernetes.io/projected/690f674d-2a9f-4c35-8df3-3a80a2911d3e-kube-api-access-hdzhl\") pod \"maas-controller-7d779b9754-w5pdb\" (UID: \"690f674d-2a9f-4c35-8df3-3a80a2911d3e\") " pod="opendatahub/maas-controller-7d779b9754-w5pdb"
Jul 22 16:36:29.820914 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.820872    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d779b9754-w5pdb"
Jul 22 16:36:29.952600 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:29.952578    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d779b9754-w5pdb"]
Jul 22 16:36:29.954368 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:36:29.954340    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690f674d_2a9f_4c35_8df3_3a80a2911d3e.slice/crio-96f21a1698f60d55548b394caed0416f25d8d0138d65ce867945ee12f8f95fba WatchSource:0}: Error finding container 96f21a1698f60d55548b394caed0416f25d8d0138d65ce867945ee12f8f95fba: Status 404 returned error can't find the container with id 96f21a1698f60d55548b394caed0416f25d8d0138d65ce867945ee12f8f95fba
Jul 22 16:36:30.389573 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:30.389545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d779b9754-w5pdb" event={"ID":"690f674d-2a9f-4c35-8df3-3a80a2911d3e","Type":"ContainerStarted","Data":"96f21a1698f60d55548b394caed0416f25d8d0138d65ce867945ee12f8f95fba"}
Jul 22 16:36:31.395632 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:31.395600    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d779b9754-w5pdb" event={"ID":"690f674d-2a9f-4c35-8df3-3a80a2911d3e","Type":"ContainerStarted","Data":"0920efb2cade7b52c702fa2e891d7902e10bd48f6578249593b00851a78509ed"}
Jul 22 16:36:31.396033 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:31.395724    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d779b9754-w5pdb"
Jul 22 16:36:31.412722 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:31.412677    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d779b9754-w5pdb" podStartSLOduration=2.026718754 podStartE2EDuration="2.412664596s" totalImagesPullingTime="385.945842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:36:31.41143664 +0000 UTC m=+820.763712661" watchObservedRunningTime="2026-07-22 16:36:31.412664596 +0000 UTC m=+820.764940615"
Jul 22 16:36:42.402720 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:36:42.402690    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d779b9754-w5pdb"
Jul 22 16:37:51.356887 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:37:51.356854    2580 scope.go:117] "RemoveContainer" containerID="387b3ac8f798d600e3f8b45fad5a3aa3db7c239dfbda5a5b2588101ced795486"
Jul 22 16:49:29.270531 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:29.270498    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"]
Jul 22 16:49:29.274167 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:29.274146    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:49:29.277076 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:29.277056    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nzvb6\""
Jul 22 16:49:29.277182 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:29.277059    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-60e975a1-serving-cert\""
Jul 22 16:49:29.285481 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:29.285457    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"]
Jul 22 16:49:29.441726 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:29.441699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-maas-api-tls\") pod \"maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp\" (UID: \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:49:29.441896 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:29.441825    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-openshift-service-ca\") pod \"maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp\" (UID: \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:49:29.441896 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:29.441859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrdmm\" (UniqueName: \"kubernetes.io/projected/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-kube-api-access-mrdmm\") pod \"maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp\" (UID: \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:49:29.543283 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:29.543200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-maas-api-tls\") pod \"maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp\" (UID: \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:49:29.543442 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:29.543307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-openshift-service-ca\") pod \"maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp\" (UID: \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:49:29.543442 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:29.543329    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrdmm\" (UniqueName: \"kubernetes.io/projected/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-kube-api-access-mrdmm\") pod \"maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp\" (UID: \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:49:29.543442 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:49:29.543345    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-serving-cert: secret "maas-api-e2e-ait-60e975a1-serving-cert" not found
Jul 22 16:49:29.543442 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:49:29.543405    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-maas-api-tls podName:33f460ee-3f0c-4569-b914-d4e59fe6f8d3 nodeName:}" failed. No retries permitted until 2026-07-22 16:49:30.043389556 +0000 UTC m=+1599.395665555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-maas-api-tls") pod "maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp" (UID: "33f460ee-3f0c-4569-b914-d4e59fe6f8d3") : secret "maas-api-e2e-ait-60e975a1-serving-cert" not found
Jul 22 16:49:29.543979 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:29.543957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-openshift-service-ca\") pod \"maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp\" (UID: \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:49:29.562288 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:29.562265    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrdmm\" (UniqueName: \"kubernetes.io/projected/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-kube-api-access-mrdmm\") pod \"maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp\" (UID: \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:49:30.047929 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:30.047895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-maas-api-tls\") pod \"maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp\" (UID: \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:49:30.050441 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:30.050412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-maas-api-tls\") pod \"maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp\" (UID: \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:49:30.185669 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:30.185634    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:49:30.329311 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:30.329276    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"]
Jul 22 16:49:30.330823 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:49:30.330791    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f460ee_3f0c_4569_b914_d4e59fe6f8d3.slice/crio-f5e73333535411b755ed3385a9f062af2baca08bb6a2e561aab5c9ea44c63b35 WatchSource:0}: Error finding container f5e73333535411b755ed3385a9f062af2baca08bb6a2e561aab5c9ea44c63b35: Status 404 returned error can't find the container with id f5e73333535411b755ed3385a9f062af2baca08bb6a2e561aab5c9ea44c63b35
Jul 22 16:49:30.332568 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:30.332544    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 16:49:31.273413 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:31.273374    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp" event={"ID":"33f460ee-3f0c-4569-b914-d4e59fe6f8d3","Type":"ContainerStarted","Data":"59ac9cf6f78ed0177ba779a0a42309305cb925afebe030c3a8b906c2ad55cb9e"}
Jul 22 16:49:31.273599 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:31.273439    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp" event={"ID":"33f460ee-3f0c-4569-b914-d4e59fe6f8d3","Type":"ContainerStarted","Data":"f5e73333535411b755ed3385a9f062af2baca08bb6a2e561aab5c9ea44c63b35"}
Jul 22 16:49:31.273599 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:31.273469    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:49:31.291139 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:31.291082    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp" podStartSLOduration=1.7803766429999999 podStartE2EDuration="2.291065s" totalImagesPullingTime="510.688357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:49:31.288991555 +0000 UTC m=+1600.641267575" watchObservedRunningTime="2026-07-22 16:49:31.291065 +0000 UTC m=+1600.643341047"
Jul 22 16:49:37.283713 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:49:37.283688    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:50:05.109088 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.108992    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"]
Jul 22 16:50:05.109632 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.109219    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp" podUID="33f460ee-3f0c-4569-b914-d4e59fe6f8d3" containerName="maas-api" containerID="cri-o://59ac9cf6f78ed0177ba779a0a42309305cb925afebe030c3a8b906c2ad55cb9e" gracePeriod=30
Jul 22 16:50:05.358133 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.358110    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:50:05.441338 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.441307    2580 generic.go:356] "Generic (PLEG): container finished" podID="33f460ee-3f0c-4569-b914-d4e59fe6f8d3" containerID="59ac9cf6f78ed0177ba779a0a42309305cb925afebe030c3a8b906c2ad55cb9e" exitCode=0
Jul 22 16:50:05.441500 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.441356    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"
Jul 22 16:50:05.441500 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.441392    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp" event={"ID":"33f460ee-3f0c-4569-b914-d4e59fe6f8d3","Type":"ContainerDied","Data":"59ac9cf6f78ed0177ba779a0a42309305cb925afebe030c3a8b906c2ad55cb9e"}
Jul 22 16:50:05.441500 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.441448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp" event={"ID":"33f460ee-3f0c-4569-b914-d4e59fe6f8d3","Type":"ContainerDied","Data":"f5e73333535411b755ed3385a9f062af2baca08bb6a2e561aab5c9ea44c63b35"}
Jul 22 16:50:05.441500 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.441471    2580 scope.go:117] "RemoveContainer" containerID="59ac9cf6f78ed0177ba779a0a42309305cb925afebe030c3a8b906c2ad55cb9e"
Jul 22 16:50:05.450199 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.450184    2580 scope.go:117] "RemoveContainer" containerID="59ac9cf6f78ed0177ba779a0a42309305cb925afebe030c3a8b906c2ad55cb9e"
Jul 22 16:50:05.450466 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:50:05.450448    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59ac9cf6f78ed0177ba779a0a42309305cb925afebe030c3a8b906c2ad55cb9e\": container with ID starting with 59ac9cf6f78ed0177ba779a0a42309305cb925afebe030c3a8b906c2ad55cb9e not found: ID does not exist" containerID="59ac9cf6f78ed0177ba779a0a42309305cb925afebe030c3a8b906c2ad55cb9e"
Jul 22 16:50:05.450537 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.450479    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59ac9cf6f78ed0177ba779a0a42309305cb925afebe030c3a8b906c2ad55cb9e"} err="failed to get container status \"59ac9cf6f78ed0177ba779a0a42309305cb925afebe030c3a8b906c2ad55cb9e\": rpc error: code = NotFound desc = could not find container \"59ac9cf6f78ed0177ba779a0a42309305cb925afebe030c3a8b906c2ad55cb9e\": container with ID starting with 59ac9cf6f78ed0177ba779a0a42309305cb925afebe030c3a8b906c2ad55cb9e not found: ID does not exist"
Jul 22 16:50:05.481377 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.481354    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-maas-api-tls\") pod \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\" (UID: \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\") "
Jul 22 16:50:05.481479 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.481423    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrdmm\" (UniqueName: \"kubernetes.io/projected/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-kube-api-access-mrdmm\") pod \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\" (UID: \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\") "
Jul 22 16:50:05.481479 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.481467    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-openshift-service-ca\") pod \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\" (UID: \"33f460ee-3f0c-4569-b914-d4e59fe6f8d3\") "
Jul 22 16:50:05.481833 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.481811    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "33f460ee-3f0c-4569-b914-d4e59fe6f8d3" (UID: "33f460ee-3f0c-4569-b914-d4e59fe6f8d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:50:05.483493 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.483473    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "33f460ee-3f0c-4569-b914-d4e59fe6f8d3" (UID: "33f460ee-3f0c-4569-b914-d4e59fe6f8d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:50:05.483628 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.483613    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-kube-api-access-mrdmm" (OuterVolumeSpecName: "kube-api-access-mrdmm") pod "33f460ee-3f0c-4569-b914-d4e59fe6f8d3" (UID: "33f460ee-3f0c-4569-b914-d4e59fe6f8d3"). InnerVolumeSpecName "kube-api-access-mrdmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:50:05.582861 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.582827    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-maas-api-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:50:05.582861 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.582859    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrdmm\" (UniqueName: \"kubernetes.io/projected/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-kube-api-access-mrdmm\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:50:05.582861 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.582869    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f460ee-3f0c-4569-b914-d4e59fe6f8d3-openshift-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:50:05.763334 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.763293    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"]
Jul 22 16:50:05.769285 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:05.769255    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60e975a1-7d56746b5c-c67hp"]
Jul 22 16:50:07.373109 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:07.373074    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33f460ee-3f0c-4569-b914-d4e59fe6f8d3" path="/var/lib/kubelet/pods/33f460ee-3f0c-4569-b914-d4e59fe6f8d3/volumes"
Jul 22 16:50:13.419815 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.416615    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"]
Jul 22 16:50:13.419815 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.417710    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f460ee-3f0c-4569-b914-d4e59fe6f8d3" containerName="maas-api"
Jul 22 16:50:13.419815 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.417730    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f460ee-3f0c-4569-b914-d4e59fe6f8d3" containerName="maas-api"
Jul 22 16:50:13.419815 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.417898    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="33f460ee-3f0c-4569-b914-d4e59fe6f8d3" containerName="maas-api"
Jul 22 16:50:13.422149 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.421977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:13.425342 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.425314    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nzvb6\""
Jul 22 16:50:13.425481 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.425325    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c45d36b4-serving-cert\""
Jul 22 16:50:13.429295 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.429272    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"]
Jul 22 16:50:13.564983 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.564950    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ed7dfe-9ae7-4e63-9082-f4c544624957-openshift-service-ca\") pod \"maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg\" (UID: \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:13.565162 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.564986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfbg2\" (UniqueName: \"kubernetes.io/projected/c7ed7dfe-9ae7-4e63-9082-f4c544624957-kube-api-access-zfbg2\") pod \"maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg\" (UID: \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:13.565162 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.565077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7ed7dfe-9ae7-4e63-9082-f4c544624957-maas-api-tls\") pod \"maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg\" (UID: \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:13.666634 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.666600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ed7dfe-9ae7-4e63-9082-f4c544624957-openshift-service-ca\") pod \"maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg\" (UID: \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:13.666829 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.666642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfbg2\" (UniqueName: \"kubernetes.io/projected/c7ed7dfe-9ae7-4e63-9082-f4c544624957-kube-api-access-zfbg2\") pod \"maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg\" (UID: \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:13.666829 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.666717    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7ed7dfe-9ae7-4e63-9082-f4c544624957-maas-api-tls\") pod \"maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg\" (UID: \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:13.667388 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.667365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ed7dfe-9ae7-4e63-9082-f4c544624957-openshift-service-ca\") pod \"maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg\" (UID: \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:13.669006 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.668983    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7ed7dfe-9ae7-4e63-9082-f4c544624957-maas-api-tls\") pod \"maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg\" (UID: \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:13.674751 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.674702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfbg2\" (UniqueName: \"kubernetes.io/projected/c7ed7dfe-9ae7-4e63-9082-f4c544624957-kube-api-access-zfbg2\") pod \"maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg\" (UID: \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:13.737044 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.736985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:13.877885 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:13.877858    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"]
Jul 22 16:50:13.880407 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:50:13.880376    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ed7dfe_9ae7_4e63_9082_f4c544624957.slice/crio-50c8dec6e1fcd78d096597d5daae6d8db6d423c20f54b5e4cd5e273af2bdb6b3 WatchSource:0}: Error finding container 50c8dec6e1fcd78d096597d5daae6d8db6d423c20f54b5e4cd5e273af2bdb6b3: Status 404 returned error can't find the container with id 50c8dec6e1fcd78d096597d5daae6d8db6d423c20f54b5e4cd5e273af2bdb6b3
Jul 22 16:50:14.489654 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:14.489569    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg" event={"ID":"c7ed7dfe-9ae7-4e63-9082-f4c544624957","Type":"ContainerStarted","Data":"a1099d4c2882413015d2ab512a443560bdef03b470ce76954d419bd03a4f3b01"}
Jul 22 16:50:14.489654 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:14.489629    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg" event={"ID":"c7ed7dfe-9ae7-4e63-9082-f4c544624957","Type":"ContainerStarted","Data":"50c8dec6e1fcd78d096597d5daae6d8db6d423c20f54b5e4cd5e273af2bdb6b3"}
Jul 22 16:50:14.490143 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:14.489801    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:14.506084 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:14.506036    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg" podStartSLOduration=1.213126475 podStartE2EDuration="1.506006346s" totalImagesPullingTime="292.879871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:50:14.504066735 +0000 UTC m=+1643.856342755" watchObservedRunningTime="2026-07-22 16:50:14.506006346 +0000 UTC m=+1643.858282365"
Jul 22 16:50:20.501438 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:20.501411    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:48.755227 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:48.755191    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"]
Jul 22 16:50:48.755760 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:48.755483    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg" podUID="c7ed7dfe-9ae7-4e63-9082-f4c544624957" containerName="maas-api" containerID="cri-o://a1099d4c2882413015d2ab512a443560bdef03b470ce76954d419bd03a4f3b01" gracePeriod=30
Jul 22 16:50:49.011715 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.011659    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:49.113695 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.113662    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7ed7dfe-9ae7-4e63-9082-f4c544624957-maas-api-tls\") pod \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\" (UID: \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\") "
Jul 22 16:50:49.113859 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.113746    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ed7dfe-9ae7-4e63-9082-f4c544624957-openshift-service-ca\") pod \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\" (UID: \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\") "
Jul 22 16:50:49.113859 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.113805    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfbg2\" (UniqueName: \"kubernetes.io/projected/c7ed7dfe-9ae7-4e63-9082-f4c544624957-kube-api-access-zfbg2\") pod \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\" (UID: \"c7ed7dfe-9ae7-4e63-9082-f4c544624957\") "
Jul 22 16:50:49.114183 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.114150    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ed7dfe-9ae7-4e63-9082-f4c544624957-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c7ed7dfe-9ae7-4e63-9082-f4c544624957" (UID: "c7ed7dfe-9ae7-4e63-9082-f4c544624957"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:50:49.115832 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.115798    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ed7dfe-9ae7-4e63-9082-f4c544624957-kube-api-access-zfbg2" (OuterVolumeSpecName: "kube-api-access-zfbg2") pod "c7ed7dfe-9ae7-4e63-9082-f4c544624957" (UID: "c7ed7dfe-9ae7-4e63-9082-f4c544624957"). InnerVolumeSpecName "kube-api-access-zfbg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:50:49.115832 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.115817    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7ed7dfe-9ae7-4e63-9082-f4c544624957-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c7ed7dfe-9ae7-4e63-9082-f4c544624957" (UID: "c7ed7dfe-9ae7-4e63-9082-f4c544624957"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:50:49.215329 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.215296    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ed7dfe-9ae7-4e63-9082-f4c544624957-openshift-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:50:49.215329 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.215324    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfbg2\" (UniqueName: \"kubernetes.io/projected/c7ed7dfe-9ae7-4e63-9082-f4c544624957-kube-api-access-zfbg2\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:50:49.215329 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.215335    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7ed7dfe-9ae7-4e63-9082-f4c544624957-maas-api-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:50:49.664658 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.664626    2580 generic.go:356] "Generic (PLEG): container finished" podID="c7ed7dfe-9ae7-4e63-9082-f4c544624957" containerID="a1099d4c2882413015d2ab512a443560bdef03b470ce76954d419bd03a4f3b01" exitCode=0
Jul 22 16:50:49.664817 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.664668    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"
Jul 22 16:50:49.664817 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.664706    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg" event={"ID":"c7ed7dfe-9ae7-4e63-9082-f4c544624957","Type":"ContainerDied","Data":"a1099d4c2882413015d2ab512a443560bdef03b470ce76954d419bd03a4f3b01"}
Jul 22 16:50:49.664817 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.664758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg" event={"ID":"c7ed7dfe-9ae7-4e63-9082-f4c544624957","Type":"ContainerDied","Data":"50c8dec6e1fcd78d096597d5daae6d8db6d423c20f54b5e4cd5e273af2bdb6b3"}
Jul 22 16:50:49.664817 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.664780    2580 scope.go:117] "RemoveContainer" containerID="a1099d4c2882413015d2ab512a443560bdef03b470ce76954d419bd03a4f3b01"
Jul 22 16:50:49.673766 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.673750    2580 scope.go:117] "RemoveContainer" containerID="a1099d4c2882413015d2ab512a443560bdef03b470ce76954d419bd03a4f3b01"
Jul 22 16:50:49.674004 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:50:49.673985    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1099d4c2882413015d2ab512a443560bdef03b470ce76954d419bd03a4f3b01\": container with ID starting with a1099d4c2882413015d2ab512a443560bdef03b470ce76954d419bd03a4f3b01 not found: ID does not exist" containerID="a1099d4c2882413015d2ab512a443560bdef03b470ce76954d419bd03a4f3b01"
Jul 22 16:50:49.674083 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.674012    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1099d4c2882413015d2ab512a443560bdef03b470ce76954d419bd03a4f3b01"} err="failed to get container status \"a1099d4c2882413015d2ab512a443560bdef03b470ce76954d419bd03a4f3b01\": rpc error: code = NotFound desc = could not find container \"a1099d4c2882413015d2ab512a443560bdef03b470ce76954d419bd03a4f3b01\": container with ID starting with a1099d4c2882413015d2ab512a443560bdef03b470ce76954d419bd03a4f3b01 not found: ID does not exist"
Jul 22 16:50:49.681545 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.681524    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"]
Jul 22 16:50:49.684333 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:49.684305    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c45d36b4-7f5d9669f9-ntcwg"]
Jul 22 16:50:51.374558 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:51.374521    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7ed7dfe-9ae7-4e63-9082-f4c544624957" path="/var/lib/kubelet/pods/c7ed7dfe-9ae7-4e63-9082-f4c544624957/volumes"
Jul 22 16:50:56.540105 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.540070    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"]
Jul 22 16:50:56.540779 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.540750    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ed7dfe-9ae7-4e63-9082-f4c544624957" containerName="maas-api"
Jul 22 16:50:56.540779 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.540779    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ed7dfe-9ae7-4e63-9082-f4c544624957" containerName="maas-api"
Jul 22 16:50:56.540960 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.540883    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7ed7dfe-9ae7-4e63-9082-f4c544624957" containerName="maas-api"
Jul 22 16:50:56.544011 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.543993    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:50:56.546661 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.546633    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nzvb6\""
Jul 22 16:50:56.546785 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.546705    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3000a004-serving-cert\""
Jul 22 16:50:56.554425 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.554400    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"]
Jul 22 16:50:56.584998 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.584974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g99s\" (UniqueName: \"kubernetes.io/projected/7f35dfce-0b3a-44c9-b65d-de4410f86e14-kube-api-access-2g99s\") pod \"maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9\" (UID: \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:50:56.585148 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.585044    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f35dfce-0b3a-44c9-b65d-de4410f86e14-maas-api-tls\") pod \"maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9\" (UID: \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:50:56.585148 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.585107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f35dfce-0b3a-44c9-b65d-de4410f86e14-openshift-service-ca\") pod \"maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9\" (UID: \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:50:56.686359 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.686314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g99s\" (UniqueName: \"kubernetes.io/projected/7f35dfce-0b3a-44c9-b65d-de4410f86e14-kube-api-access-2g99s\") pod \"maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9\" (UID: \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:50:56.686557 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.686368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f35dfce-0b3a-44c9-b65d-de4410f86e14-maas-api-tls\") pod \"maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9\" (UID: \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:50:56.686557 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.686398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f35dfce-0b3a-44c9-b65d-de4410f86e14-openshift-service-ca\") pod \"maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9\" (UID: \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:50:56.687255 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.687234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f35dfce-0b3a-44c9-b65d-de4410f86e14-openshift-service-ca\") pod \"maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9\" (UID: \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:50:56.688951 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.688928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f35dfce-0b3a-44c9-b65d-de4410f86e14-maas-api-tls\") pod \"maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9\" (UID: \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:50:56.697062 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.697038    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g99s\" (UniqueName: \"kubernetes.io/projected/7f35dfce-0b3a-44c9-b65d-de4410f86e14-kube-api-access-2g99s\") pod \"maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9\" (UID: \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:50:56.855810 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.855688    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:50:56.996442 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:56.996409    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"]
Jul 22 16:50:56.997782 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:50:56.997756    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f35dfce_0b3a_44c9_b65d_de4410f86e14.slice/crio-0ba931640f24f4c25ad26d5f4b2efed7e37c44fdef4595bcacbe75052e8721ef WatchSource:0}: Error finding container 0ba931640f24f4c25ad26d5f4b2efed7e37c44fdef4595bcacbe75052e8721ef: Status 404 returned error can't find the container with id 0ba931640f24f4c25ad26d5f4b2efed7e37c44fdef4595bcacbe75052e8721ef
Jul 22 16:50:57.707620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:57.707538    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9" event={"ID":"7f35dfce-0b3a-44c9-b65d-de4410f86e14","Type":"ContainerStarted","Data":"7f8aa922bf3d0650e03a359f854acbd5f5c6c8675e998811f554fb3af7b18cc6"}
Jul 22 16:50:57.707620 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:57.707589    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9" event={"ID":"7f35dfce-0b3a-44c9-b65d-de4410f86e14","Type":"ContainerStarted","Data":"0ba931640f24f4c25ad26d5f4b2efed7e37c44fdef4595bcacbe75052e8721ef"}
Jul 22 16:50:57.708051 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:57.707665    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:50:57.725248 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:50:57.725202    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9" podStartSLOduration=1.28316912 podStartE2EDuration="1.725186128s" totalImagesPullingTime="442.017008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:50:57.723888473 +0000 UTC m=+1687.076164493" watchObservedRunningTime="2026-07-22 16:50:57.725186128 +0000 UTC m=+1687.077462148"
Jul 22 16:51:03.718404 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:03.718371    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:51:32.882845 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:32.882754    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"]
Jul 22 16:51:32.883437 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:32.883004    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9" podUID="7f35dfce-0b3a-44c9-b65d-de4410f86e14" containerName="maas-api" containerID="cri-o://7f8aa922bf3d0650e03a359f854acbd5f5c6c8675e998811f554fb3af7b18cc6" gracePeriod=30
Jul 22 16:51:33.135891 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.135823    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:51:33.136421 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.136400    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f35dfce-0b3a-44c9-b65d-de4410f86e14-openshift-service-ca\") pod \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\" (UID: \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\") "
Jul 22 16:51:33.136523 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.136451    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f35dfce-0b3a-44c9-b65d-de4410f86e14-maas-api-tls\") pod \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\" (UID: \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\") "
Jul 22 16:51:33.136523 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.136480    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2g99s\" (UniqueName: \"kubernetes.io/projected/7f35dfce-0b3a-44c9-b65d-de4410f86e14-kube-api-access-2g99s\") pod \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\" (UID: \"7f35dfce-0b3a-44c9-b65d-de4410f86e14\") "
Jul 22 16:51:33.136807 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.136774    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f35dfce-0b3a-44c9-b65d-de4410f86e14-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7f35dfce-0b3a-44c9-b65d-de4410f86e14" (UID: "7f35dfce-0b3a-44c9-b65d-de4410f86e14"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:51:33.138602 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.138583    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f35dfce-0b3a-44c9-b65d-de4410f86e14-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7f35dfce-0b3a-44c9-b65d-de4410f86e14" (UID: "7f35dfce-0b3a-44c9-b65d-de4410f86e14"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:51:33.138685 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.138596    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f35dfce-0b3a-44c9-b65d-de4410f86e14-kube-api-access-2g99s" (OuterVolumeSpecName: "kube-api-access-2g99s") pod "7f35dfce-0b3a-44c9-b65d-de4410f86e14" (UID: "7f35dfce-0b3a-44c9-b65d-de4410f86e14"). InnerVolumeSpecName "kube-api-access-2g99s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:51:33.237627 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.237597    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f35dfce-0b3a-44c9-b65d-de4410f86e14-openshift-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:51:33.237627 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.237624    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f35dfce-0b3a-44c9-b65d-de4410f86e14-maas-api-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:51:33.237627 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.237633    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2g99s\" (UniqueName: \"kubernetes.io/projected/7f35dfce-0b3a-44c9-b65d-de4410f86e14-kube-api-access-2g99s\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:51:33.889938 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.889904    2580 generic.go:356] "Generic (PLEG): container finished" podID="7f35dfce-0b3a-44c9-b65d-de4410f86e14" containerID="7f8aa922bf3d0650e03a359f854acbd5f5c6c8675e998811f554fb3af7b18cc6" exitCode=0
Jul 22 16:51:33.889938 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.889942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9" event={"ID":"7f35dfce-0b3a-44c9-b65d-de4410f86e14","Type":"ContainerDied","Data":"7f8aa922bf3d0650e03a359f854acbd5f5c6c8675e998811f554fb3af7b18cc6"}
Jul 22 16:51:33.890443 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.889954    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"
Jul 22 16:51:33.890443 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.889983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9" event={"ID":"7f35dfce-0b3a-44c9-b65d-de4410f86e14","Type":"ContainerDied","Data":"0ba931640f24f4c25ad26d5f4b2efed7e37c44fdef4595bcacbe75052e8721ef"}
Jul 22 16:51:33.890443 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.890004    2580 scope.go:117] "RemoveContainer" containerID="7f8aa922bf3d0650e03a359f854acbd5f5c6c8675e998811f554fb3af7b18cc6"
Jul 22 16:51:33.898777 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.898755    2580 scope.go:117] "RemoveContainer" containerID="7f8aa922bf3d0650e03a359f854acbd5f5c6c8675e998811f554fb3af7b18cc6"
Jul 22 16:51:33.899054 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:51:33.899032    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f8aa922bf3d0650e03a359f854acbd5f5c6c8675e998811f554fb3af7b18cc6\": container with ID starting with 7f8aa922bf3d0650e03a359f854acbd5f5c6c8675e998811f554fb3af7b18cc6 not found: ID does not exist" containerID="7f8aa922bf3d0650e03a359f854acbd5f5c6c8675e998811f554fb3af7b18cc6"
Jul 22 16:51:33.899115 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.899061    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8aa922bf3d0650e03a359f854acbd5f5c6c8675e998811f554fb3af7b18cc6"} err="failed to get container status \"7f8aa922bf3d0650e03a359f854acbd5f5c6c8675e998811f554fb3af7b18cc6\": rpc error: code = NotFound desc = could not find container \"7f8aa922bf3d0650e03a359f854acbd5f5c6c8675e998811f554fb3af7b18cc6\": container with ID starting with 7f8aa922bf3d0650e03a359f854acbd5f5c6c8675e998811f554fb3af7b18cc6 not found: ID does not exist"
Jul 22 16:51:33.905531 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.905503    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"]
Jul 22 16:51:33.911390 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:33.911362    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3000a004-f8c5456f7-hwpv9"]
Jul 22 16:51:35.373142 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:35.373113    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f35dfce-0b3a-44c9-b65d-de4410f86e14" path="/var/lib/kubelet/pods/7f35dfce-0b3a-44c9-b65d-de4410f86e14/volumes"
Jul 22 16:51:41.732468 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.732431    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"]
Jul 22 16:51:41.733067 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.733050    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f35dfce-0b3a-44c9-b65d-de4410f86e14" containerName="maas-api"
Jul 22 16:51:41.733119 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.733070    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f35dfce-0b3a-44c9-b65d-de4410f86e14" containerName="maas-api"
Jul 22 16:51:41.733208 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.733197    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f35dfce-0b3a-44c9-b65d-de4410f86e14" containerName="maas-api"
Jul 22 16:51:41.737902 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.737877    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:51:41.740914 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.740893    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-57182c73-serving-cert\""
Jul 22 16:51:41.741085 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.740957    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nzvb6\""
Jul 22 16:51:41.745165 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.745143    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"]
Jul 22 16:51:41.811493 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.811459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e30e2c7c-40e8-4e36-8031-47547d47e8a5-openshift-service-ca\") pod \"maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d\" (UID: \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:51:41.811668 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.811498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wtpp\" (UniqueName: \"kubernetes.io/projected/e30e2c7c-40e8-4e36-8031-47547d47e8a5-kube-api-access-4wtpp\") pod \"maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d\" (UID: \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:51:41.811668 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.811528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e30e2c7c-40e8-4e36-8031-47547d47e8a5-maas-api-tls\") pod \"maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d\" (UID: \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:51:41.912570 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.912523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e30e2c7c-40e8-4e36-8031-47547d47e8a5-openshift-service-ca\") pod \"maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d\" (UID: \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:51:41.912762 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.912588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wtpp\" (UniqueName: \"kubernetes.io/projected/e30e2c7c-40e8-4e36-8031-47547d47e8a5-kube-api-access-4wtpp\") pod \"maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d\" (UID: \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:51:41.912762 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.912646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e30e2c7c-40e8-4e36-8031-47547d47e8a5-maas-api-tls\") pod \"maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d\" (UID: \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:51:41.912864 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:51:41.912795    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-serving-cert: secret "maas-api-e2e-derive-57182c73-serving-cert" not found
Jul 22 16:51:41.912903 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:51:41.912870    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e30e2c7c-40e8-4e36-8031-47547d47e8a5-maas-api-tls podName:e30e2c7c-40e8-4e36-8031-47547d47e8a5 nodeName:}" failed. No retries permitted until 2026-07-22 16:51:42.412847408 +0000 UTC m=+1731.765123408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e30e2c7c-40e8-4e36-8031-47547d47e8a5-maas-api-tls") pod "maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d" (UID: "e30e2c7c-40e8-4e36-8031-47547d47e8a5") : secret "maas-api-e2e-derive-57182c73-serving-cert" not found
Jul 22 16:51:41.913279 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.913259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e30e2c7c-40e8-4e36-8031-47547d47e8a5-openshift-service-ca\") pod \"maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d\" (UID: \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:51:41.922000 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:41.921970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wtpp\" (UniqueName: \"kubernetes.io/projected/e30e2c7c-40e8-4e36-8031-47547d47e8a5-kube-api-access-4wtpp\") pod \"maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d\" (UID: \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:51:42.416639 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:42.416603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e30e2c7c-40e8-4e36-8031-47547d47e8a5-maas-api-tls\") pod \"maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d\" (UID: \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:51:42.419110 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:42.419081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e30e2c7c-40e8-4e36-8031-47547d47e8a5-maas-api-tls\") pod \"maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d\" (UID: \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:51:42.651756 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:42.651716    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:51:42.801287 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:51:42.801251    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30e2c7c_40e8_4e36_8031_47547d47e8a5.slice/crio-1b8f722a65505a01144d03fcd843118faef2f6c2e43a1d0d036694417af50e7e WatchSource:0}: Error finding container 1b8f722a65505a01144d03fcd843118faef2f6c2e43a1d0d036694417af50e7e: Status 404 returned error can't find the container with id 1b8f722a65505a01144d03fcd843118faef2f6c2e43a1d0d036694417af50e7e
Jul 22 16:51:42.803456 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:42.803432    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"]
Jul 22 16:51:42.937800 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:42.937763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d" event={"ID":"e30e2c7c-40e8-4e36-8031-47547d47e8a5","Type":"ContainerStarted","Data":"1b8f722a65505a01144d03fcd843118faef2f6c2e43a1d0d036694417af50e7e"}
Jul 22 16:51:43.944646 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:43.944608    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d" event={"ID":"e30e2c7c-40e8-4e36-8031-47547d47e8a5","Type":"ContainerStarted","Data":"ee5e57acedcee1e799eb2ef6ca0e5811916884c6094c0e085de09f5408a2632b"}
Jul 22 16:51:43.945144 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:43.944679    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:51:43.963004 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:43.962955    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d" podStartSLOduration=2.404036965 podStartE2EDuration="2.962937529s" totalImagesPullingTime="558.900564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:51:43.961061435 +0000 UTC m=+1733.313337456" watchObservedRunningTime="2026-07-22 16:51:43.962937529 +0000 UTC m=+1733.315213550"
Jul 22 16:51:49.956864 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:51:49.956834    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:52:17.189600 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:17.189566    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"]
Jul 22 16:52:17.190147 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:17.189819    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d" podUID="e30e2c7c-40e8-4e36-8031-47547d47e8a5" containerName="maas-api" containerID="cri-o://ee5e57acedcee1e799eb2ef6ca0e5811916884c6094c0e085de09f5408a2632b" gracePeriod=30
Jul 22 16:52:17.441281 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:17.441220    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:52:17.455337 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:17.455312    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wtpp\" (UniqueName: \"kubernetes.io/projected/e30e2c7c-40e8-4e36-8031-47547d47e8a5-kube-api-access-4wtpp\") pod \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\" (UID: \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\") "
Jul 22 16:52:17.455475 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:17.455383    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e30e2c7c-40e8-4e36-8031-47547d47e8a5-maas-api-tls\") pod \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\" (UID: \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\") "
Jul 22 16:52:17.455475 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:17.455429    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e30e2c7c-40e8-4e36-8031-47547d47e8a5-openshift-service-ca\") pod \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\" (UID: \"e30e2c7c-40e8-4e36-8031-47547d47e8a5\") "
Jul 22 16:52:17.455838 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:17.455804    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e30e2c7c-40e8-4e36-8031-47547d47e8a5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e30e2c7c-40e8-4e36-8031-47547d47e8a5" (UID: "e30e2c7c-40e8-4e36-8031-47547d47e8a5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:52:17.457348 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:17.457325    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e30e2c7c-40e8-4e36-8031-47547d47e8a5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e30e2c7c-40e8-4e36-8031-47547d47e8a5" (UID: "e30e2c7c-40e8-4e36-8031-47547d47e8a5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:52:17.457458 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:17.457441    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e30e2c7c-40e8-4e36-8031-47547d47e8a5-kube-api-access-4wtpp" (OuterVolumeSpecName: "kube-api-access-4wtpp") pod "e30e2c7c-40e8-4e36-8031-47547d47e8a5" (UID: "e30e2c7c-40e8-4e36-8031-47547d47e8a5"). InnerVolumeSpecName "kube-api-access-4wtpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:52:17.556638 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:17.556595    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e30e2c7c-40e8-4e36-8031-47547d47e8a5-maas-api-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:52:17.556638 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:17.556623    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e30e2c7c-40e8-4e36-8031-47547d47e8a5-openshift-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:52:17.556638 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:17.556632    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wtpp\" (UniqueName: \"kubernetes.io/projected/e30e2c7c-40e8-4e36-8031-47547d47e8a5-kube-api-access-4wtpp\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:52:18.121600 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:18.121568    2580 generic.go:356] "Generic (PLEG): container finished" podID="e30e2c7c-40e8-4e36-8031-47547d47e8a5" containerID="ee5e57acedcee1e799eb2ef6ca0e5811916884c6094c0e085de09f5408a2632b" exitCode=0
Jul 22 16:52:18.121776 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:18.121611    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"
Jul 22 16:52:18.121776 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:18.121637    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d" event={"ID":"e30e2c7c-40e8-4e36-8031-47547d47e8a5","Type":"ContainerDied","Data":"ee5e57acedcee1e799eb2ef6ca0e5811916884c6094c0e085de09f5408a2632b"}
Jul 22 16:52:18.121776 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:18.121687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d" event={"ID":"e30e2c7c-40e8-4e36-8031-47547d47e8a5","Type":"ContainerDied","Data":"1b8f722a65505a01144d03fcd843118faef2f6c2e43a1d0d036694417af50e7e"}
Jul 22 16:52:18.121776 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:18.121710    2580 scope.go:117] "RemoveContainer" containerID="ee5e57acedcee1e799eb2ef6ca0e5811916884c6094c0e085de09f5408a2632b"
Jul 22 16:52:18.130961 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:18.130937    2580 scope.go:117] "RemoveContainer" containerID="ee5e57acedcee1e799eb2ef6ca0e5811916884c6094c0e085de09f5408a2632b"
Jul 22 16:52:18.131264 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:52:18.131246    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee5e57acedcee1e799eb2ef6ca0e5811916884c6094c0e085de09f5408a2632b\": container with ID starting with ee5e57acedcee1e799eb2ef6ca0e5811916884c6094c0e085de09f5408a2632b not found: ID does not exist" containerID="ee5e57acedcee1e799eb2ef6ca0e5811916884c6094c0e085de09f5408a2632b"
Jul 22 16:52:18.131338 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:18.131272    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee5e57acedcee1e799eb2ef6ca0e5811916884c6094c0e085de09f5408a2632b"} err="failed to get container status \"ee5e57acedcee1e799eb2ef6ca0e5811916884c6094c0e085de09f5408a2632b\": rpc error: code = NotFound desc = could not find container \"ee5e57acedcee1e799eb2ef6ca0e5811916884c6094c0e085de09f5408a2632b\": container with ID starting with ee5e57acedcee1e799eb2ef6ca0e5811916884c6094c0e085de09f5408a2632b not found: ID does not exist"
Jul 22 16:52:18.141115 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:18.141088    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"]
Jul 22 16:52:18.144887 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:18.144861    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57182c73-647bdbbc4d-86s2d"]
Jul 22 16:52:19.373169 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:52:19.373134    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e30e2c7c-40e8-4e36-8031-47547d47e8a5" path="/var/lib/kubelet/pods/e30e2c7c-40e8-4e36-8031-47547d47e8a5/volumes"
Jul 22 16:54:09.090613 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.090573    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"]
Jul 22 16:54:09.091546 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.091128    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30e2c7c-40e8-4e36-8031-47547d47e8a5" containerName="maas-api"
Jul 22 16:54:09.091546 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.091146    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30e2c7c-40e8-4e36-8031-47547d47e8a5" containerName="maas-api"
Jul 22 16:54:09.091546 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.091222    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e30e2c7c-40e8-4e36-8031-47547d47e8a5" containerName="maas-api"
Jul 22 16:54:09.094251 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.094231    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:09.097133 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.097108    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-87fbb90e-serving-cert\""
Jul 22 16:54:09.097254 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.097115    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nzvb6\""
Jul 22 16:54:09.103374 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.103334    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"]
Jul 22 16:54:09.120266 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.120240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08677a6-85b3-4c36-a42a-64f969f6fcfe-openshift-service-ca\") pod \"maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52\" (UID: \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:09.120385 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.120312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kft4m\" (UniqueName: \"kubernetes.io/projected/b08677a6-85b3-4c36-a42a-64f969f6fcfe-kube-api-access-kft4m\") pod \"maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52\" (UID: \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:09.120385 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.120348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08677a6-85b3-4c36-a42a-64f969f6fcfe-maas-api-tls\") pod \"maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52\" (UID: \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:09.221273 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.221234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08677a6-85b3-4c36-a42a-64f969f6fcfe-openshift-service-ca\") pod \"maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52\" (UID: \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:09.221482 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.221334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kft4m\" (UniqueName: \"kubernetes.io/projected/b08677a6-85b3-4c36-a42a-64f969f6fcfe-kube-api-access-kft4m\") pod \"maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52\" (UID: \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:09.221482 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.221377    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08677a6-85b3-4c36-a42a-64f969f6fcfe-maas-api-tls\") pod \"maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52\" (UID: \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:09.221612 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:54:09.221535    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-serving-cert: secret "maas-api-e2e-mt-87fbb90e-serving-cert" not found
Jul 22 16:54:09.221612 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:54:09.221604    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b08677a6-85b3-4c36-a42a-64f969f6fcfe-maas-api-tls podName:b08677a6-85b3-4c36-a42a-64f969f6fcfe nodeName:}" failed. No retries permitted until 2026-07-22 16:54:09.721583145 +0000 UTC m=+1879.073859157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b08677a6-85b3-4c36-a42a-64f969f6fcfe-maas-api-tls") pod "maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52" (UID: "b08677a6-85b3-4c36-a42a-64f969f6fcfe") : secret "maas-api-e2e-mt-87fbb90e-serving-cert" not found
Jul 22 16:54:09.221965 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.221944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08677a6-85b3-4c36-a42a-64f969f6fcfe-openshift-service-ca\") pod \"maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52\" (UID: \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:09.234545 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.234524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kft4m\" (UniqueName: \"kubernetes.io/projected/b08677a6-85b3-4c36-a42a-64f969f6fcfe-kube-api-access-kft4m\") pod \"maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52\" (UID: \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:09.725440 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.725409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08677a6-85b3-4c36-a42a-64f969f6fcfe-maas-api-tls\") pod \"maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52\" (UID: \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:09.727759 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:09.727738    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08677a6-85b3-4c36-a42a-64f969f6fcfe-maas-api-tls\") pod \"maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52\" (UID: \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:10.006275 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:10.006192    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:10.142031 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:10.141993    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"]
Jul 22 16:54:10.144399 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:54:10.144371    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08677a6_85b3_4c36_a42a_64f969f6fcfe.slice/crio-3bbdd02edcd342c4690987857250fd9ba135b4f89ba19d103040478af4066e0b WatchSource:0}: Error finding container 3bbdd02edcd342c4690987857250fd9ba135b4f89ba19d103040478af4066e0b: Status 404 returned error can't find the container with id 3bbdd02edcd342c4690987857250fd9ba135b4f89ba19d103040478af4066e0b
Jul 22 16:54:10.677586 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:10.677555    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52" event={"ID":"b08677a6-85b3-4c36-a42a-64f969f6fcfe","Type":"ContainerStarted","Data":"3bbdd02edcd342c4690987857250fd9ba135b4f89ba19d103040478af4066e0b"}
Jul 22 16:54:11.683674 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:11.683634    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52" event={"ID":"b08677a6-85b3-4c36-a42a-64f969f6fcfe","Type":"ContainerStarted","Data":"b360f4e7e7f7efed8cdda5730d52075afdd27f7aa37874563d01f7419cc7938d"}
Jul 22 16:54:11.684374 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:11.683730    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:11.700455 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:11.700400    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52" podStartSLOduration=2.217419951 podStartE2EDuration="2.700383093s" totalImagesPullingTime="482.963142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:54:11.699297339 +0000 UTC m=+1881.051573372" watchObservedRunningTime="2026-07-22 16:54:11.700383093 +0000 UTC m=+1881.052659112"
Jul 22 16:54:17.694238 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:17.694210    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:31.354622 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.354589    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"]
Jul 22 16:54:31.355174 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.354886    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52" podUID="b08677a6-85b3-4c36-a42a-64f969f6fcfe" containerName="maas-api" containerID="cri-o://b360f4e7e7f7efed8cdda5730d52075afdd27f7aa37874563d01f7419cc7938d" gracePeriod=30
Jul 22 16:54:31.610282 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.610213    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:31.738703 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.738673    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kft4m\" (UniqueName: \"kubernetes.io/projected/b08677a6-85b3-4c36-a42a-64f969f6fcfe-kube-api-access-kft4m\") pod \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\" (UID: \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\") "
Jul 22 16:54:31.738916 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.738722    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08677a6-85b3-4c36-a42a-64f969f6fcfe-openshift-service-ca\") pod \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\" (UID: \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\") "
Jul 22 16:54:31.738916 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.738750    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08677a6-85b3-4c36-a42a-64f969f6fcfe-maas-api-tls\") pod \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\" (UID: \"b08677a6-85b3-4c36-a42a-64f969f6fcfe\") "
Jul 22 16:54:31.739159 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.739132    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b08677a6-85b3-4c36-a42a-64f969f6fcfe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b08677a6-85b3-4c36-a42a-64f969f6fcfe" (UID: "b08677a6-85b3-4c36-a42a-64f969f6fcfe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:54:31.740850 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.740815    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b08677a6-85b3-4c36-a42a-64f969f6fcfe-kube-api-access-kft4m" (OuterVolumeSpecName: "kube-api-access-kft4m") pod "b08677a6-85b3-4c36-a42a-64f969f6fcfe" (UID: "b08677a6-85b3-4c36-a42a-64f969f6fcfe"). InnerVolumeSpecName "kube-api-access-kft4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:54:31.740941 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.740876    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b08677a6-85b3-4c36-a42a-64f969f6fcfe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b08677a6-85b3-4c36-a42a-64f969f6fcfe" (UID: "b08677a6-85b3-4c36-a42a-64f969f6fcfe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:54:31.783330 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.783297    2580 generic.go:356] "Generic (PLEG): container finished" podID="b08677a6-85b3-4c36-a42a-64f969f6fcfe" containerID="b360f4e7e7f7efed8cdda5730d52075afdd27f7aa37874563d01f7419cc7938d" exitCode=0
Jul 22 16:54:31.783478 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.783341    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"
Jul 22 16:54:31.783478 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.783351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52" event={"ID":"b08677a6-85b3-4c36-a42a-64f969f6fcfe","Type":"ContainerDied","Data":"b360f4e7e7f7efed8cdda5730d52075afdd27f7aa37874563d01f7419cc7938d"}
Jul 22 16:54:31.783478 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.783392    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52" event={"ID":"b08677a6-85b3-4c36-a42a-64f969f6fcfe","Type":"ContainerDied","Data":"3bbdd02edcd342c4690987857250fd9ba135b4f89ba19d103040478af4066e0b"}
Jul 22 16:54:31.783478 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.783413    2580 scope.go:117] "RemoveContainer" containerID="b360f4e7e7f7efed8cdda5730d52075afdd27f7aa37874563d01f7419cc7938d"
Jul 22 16:54:31.792488 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.792471    2580 scope.go:117] "RemoveContainer" containerID="b360f4e7e7f7efed8cdda5730d52075afdd27f7aa37874563d01f7419cc7938d"
Jul 22 16:54:31.792747 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:54:31.792728    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b360f4e7e7f7efed8cdda5730d52075afdd27f7aa37874563d01f7419cc7938d\": container with ID starting with b360f4e7e7f7efed8cdda5730d52075afdd27f7aa37874563d01f7419cc7938d not found: ID does not exist" containerID="b360f4e7e7f7efed8cdda5730d52075afdd27f7aa37874563d01f7419cc7938d"
Jul 22 16:54:31.792786 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.792756    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b360f4e7e7f7efed8cdda5730d52075afdd27f7aa37874563d01f7419cc7938d"} err="failed to get container status \"b360f4e7e7f7efed8cdda5730d52075afdd27f7aa37874563d01f7419cc7938d\": rpc error: code = NotFound desc = could not find container \"b360f4e7e7f7efed8cdda5730d52075afdd27f7aa37874563d01f7419cc7938d\": container with ID starting with b360f4e7e7f7efed8cdda5730d52075afdd27f7aa37874563d01f7419cc7938d not found: ID does not exist"
Jul 22 16:54:31.804292 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.804269    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"]
Jul 22 16:54:31.809850 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.809829    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-87fbb90e-7bdfd86d5-k5x52"]
Jul 22 16:54:31.839513 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.839491    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kft4m\" (UniqueName: \"kubernetes.io/projected/b08677a6-85b3-4c36-a42a-64f969f6fcfe-kube-api-access-kft4m\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:54:31.839632 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.839515    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08677a6-85b3-4c36-a42a-64f969f6fcfe-openshift-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:54:31.839632 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:31.839530    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08677a6-85b3-4c36-a42a-64f969f6fcfe-maas-api-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:54:33.372989 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:54:33.372955    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b08677a6-85b3-4c36-a42a-64f969f6fcfe" path="/var/lib/kubelet/pods/b08677a6-85b3-4c36-a42a-64f969f6fcfe/volumes"
Jul 22 16:55:10.234889 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.234857    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"]
Jul 22 16:55:10.235330 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.235276    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b08677a6-85b3-4c36-a42a-64f969f6fcfe" containerName="maas-api"
Jul 22 16:55:10.235330 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.235288    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b08677a6-85b3-4c36-a42a-64f969f6fcfe" containerName="maas-api"
Jul 22 16:55:10.235404 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.235369    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b08677a6-85b3-4c36-a42a-64f969f6fcfe" containerName="maas-api"
Jul 22 16:55:10.238308 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.238292    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:55:10.240946 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.240914    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b9fae547-serving-cert\""
Jul 22 16:55:10.241114 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.241038    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nzvb6\""
Jul 22 16:55:10.247932 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.247912    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"]
Jul 22 16:55:10.399912 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.399871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-openshift-service-ca\") pod \"maas-api-e2e-mt-b9fae547-556df5bccc-4vg87\" (UID: \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:55:10.400162 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.400115    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9z45\" (UniqueName: \"kubernetes.io/projected/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-kube-api-access-m9z45\") pod \"maas-api-e2e-mt-b9fae547-556df5bccc-4vg87\" (UID: \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:55:10.400281 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.400256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-maas-api-tls\") pod \"maas-api-e2e-mt-b9fae547-556df5bccc-4vg87\" (UID: \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:55:10.501641 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.501546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-openshift-service-ca\") pod \"maas-api-e2e-mt-b9fae547-556df5bccc-4vg87\" (UID: \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:55:10.501641 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.501604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9z45\" (UniqueName: \"kubernetes.io/projected/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-kube-api-access-m9z45\") pod \"maas-api-e2e-mt-b9fae547-556df5bccc-4vg87\" (UID: \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:55:10.501860 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.501687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-maas-api-tls\") pod \"maas-api-e2e-mt-b9fae547-556df5bccc-4vg87\" (UID: \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:55:10.502214 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.502183    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-openshift-service-ca\") pod \"maas-api-e2e-mt-b9fae547-556df5bccc-4vg87\" (UID: \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:55:10.504013 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.503989    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-maas-api-tls\") pod \"maas-api-e2e-mt-b9fae547-556df5bccc-4vg87\" (UID: \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:55:10.509742 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.509721    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9z45\" (UniqueName: \"kubernetes.io/projected/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-kube-api-access-m9z45\") pod \"maas-api-e2e-mt-b9fae547-556df5bccc-4vg87\" (UID: \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:55:10.549735 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.549708    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:55:10.717927 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.717894    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"]
Jul 22 16:55:10.720938 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:55:10.720911    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2bfb07b_00b1_4c32_9e30_85a9241e9ad6.slice/crio-fe12aac1c395d90c9dbd91001a786183a2694fac15d64bf785ff8fb2facaffe1 WatchSource:0}: Error finding container fe12aac1c395d90c9dbd91001a786183a2694fac15d64bf785ff8fb2facaffe1: Status 404 returned error can't find the container with id fe12aac1c395d90c9dbd91001a786183a2694fac15d64bf785ff8fb2facaffe1
Jul 22 16:55:10.722459 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.722442    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 16:55:10.976543 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:10.976507    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87" event={"ID":"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6","Type":"ContainerStarted","Data":"fe12aac1c395d90c9dbd91001a786183a2694fac15d64bf785ff8fb2facaffe1"}
Jul 22 16:55:11.984037 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:11.983986    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87" event={"ID":"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6","Type":"ContainerStarted","Data":"e517b80abf1c41c6d716f9d1ff18d63706ab97de824def9094f9df8a54e9115b"}
Jul 22 16:55:11.984448 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:11.984167    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:55:12.000737 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:12.000689    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87" podStartSLOduration=1.6119847919999999 podStartE2EDuration="2.000672934s" totalImagesPullingTime="388.688142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:55:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:55:11.999647756 +0000 UTC m=+1941.351923776" watchObservedRunningTime="2026-07-22 16:55:12.000672934 +0000 UTC m=+1941.352948953"
Jul 22 16:55:17.995419 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:17.995389    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:55:27.305896 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.305863    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"]
Jul 22 16:55:27.309389 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.309371    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.312279 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.312256    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b9fae547\"/\"default-dockercfg-qttzt\""
Jul 22 16:55:27.312428 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.312314    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b9fae547\"/\"openshift-service-ca.crt\""
Jul 22 16:55:27.312428 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.312314    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b9fae547\"/\"kube-root-ca.crt\""
Jul 22 16:55:27.313574 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.313262    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b9fae547\"/\"e2e-lifecycle-model-b9fae547-kserve-self-signed-certs\""
Jul 22 16:55:27.318803 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.318778    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"]
Jul 22 16:55:27.356231 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.356207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-dshm\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.356361 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.356249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-tmp-dir\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.356361 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.356342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-model-cache\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.356475 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.356364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410946d0-4532-49aa-8d3e-ddabc34dbd01-tls-certs\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.356475 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.356415    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsdqv\" (UniqueName: \"kubernetes.io/projected/410946d0-4532-49aa-8d3e-ddabc34dbd01-kube-api-access-hsdqv\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.356475 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.356464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-home\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.457309 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.457257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-home\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.457309 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.457314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-dshm\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.457593 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.457352    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-tmp-dir\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.457593 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.457415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-model-cache\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.457593 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.457444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410946d0-4532-49aa-8d3e-ddabc34dbd01-tls-certs\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.457593 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.457482    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsdqv\" (UniqueName: \"kubernetes.io/projected/410946d0-4532-49aa-8d3e-ddabc34dbd01-kube-api-access-hsdqv\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.457796 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.457696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-home\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.457834 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.457790    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-tmp-dir\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.457882 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.457828    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-model-cache\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.459607 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.459583    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-dshm\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.459991 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.459972    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410946d0-4532-49aa-8d3e-ddabc34dbd01-tls-certs\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.465800 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.465778    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsdqv\" (UniqueName: \"kubernetes.io/projected/410946d0-4532-49aa-8d3e-ddabc34dbd01-kube-api-access-hsdqv\") pod \"e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") " pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.621772 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.621687    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:27.758104 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:27.758074    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"]
Jul 22 16:55:27.759594 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:55:27.759568    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod410946d0_4532_49aa_8d3e_ddabc34dbd01.slice/crio-972f6a28ea8012bb264e5f63cfdd60f4f0c791db435ba310eec675edc968ee03 WatchSource:0}: Error finding container 972f6a28ea8012bb264e5f63cfdd60f4f0c791db435ba310eec675edc968ee03: Status 404 returned error can't find the container with id 972f6a28ea8012bb264e5f63cfdd60f4f0c791db435ba310eec675edc968ee03
Jul 22 16:55:28.071204 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:28.071161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7" event={"ID":"410946d0-4532-49aa-8d3e-ddabc34dbd01","Type":"ContainerStarted","Data":"9c1e2924fc138956684346a5cbda3111a2304909c5c2642e18032017f42c0c5b"}
Jul 22 16:55:28.071380 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:28.071215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7" event={"ID":"410946d0-4532-49aa-8d3e-ddabc34dbd01","Type":"ContainerStarted","Data":"972f6a28ea8012bb264e5f63cfdd60f4f0c791db435ba310eec675edc968ee03"}
Jul 22 16:55:28.089157 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:28.089107    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7" podStartSLOduration=1.089089428 podStartE2EDuration="1.089089428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:55:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:55:28.087245469 +0000 UTC m=+1957.439521489" watchObservedRunningTime="2026-07-22 16:55:28.089089428 +0000 UTC m=+1957.441365447"
Jul 22 16:55:37.621871 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:37.621831    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:37.622325 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:37.621893    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:37.634327 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:37.634303    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:55:38.134136 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:55:38.134106    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:56:08.698550 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:08.698518    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"]
Jul 22 16:56:08.699141 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:08.698738    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87" podUID="e2bfb07b-00b1-4c32-9e30-85a9241e9ad6" containerName="maas-api" containerID="cri-o://e517b80abf1c41c6d716f9d1ff18d63706ab97de824def9094f9df8a54e9115b" gracePeriod=30
Jul 22 16:56:08.946658 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:08.946632    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:56:09.061488 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.061404    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-openshift-service-ca\") pod \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\" (UID: \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\") "
Jul 22 16:56:09.061488 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.061443    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-maas-api-tls\") pod \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\" (UID: \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\") "
Jul 22 16:56:09.061681 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.061500    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9z45\" (UniqueName: \"kubernetes.io/projected/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-kube-api-access-m9z45\") pod \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\" (UID: \"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6\") "
Jul 22 16:56:09.061850 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.061828    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e2bfb07b-00b1-4c32-9e30-85a9241e9ad6" (UID: "e2bfb07b-00b1-4c32-9e30-85a9241e9ad6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:56:09.063614 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.063584    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e2bfb07b-00b1-4c32-9e30-85a9241e9ad6" (UID: "e2bfb07b-00b1-4c32-9e30-85a9241e9ad6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:56:09.063748 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.063706    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-kube-api-access-m9z45" (OuterVolumeSpecName: "kube-api-access-m9z45") pod "e2bfb07b-00b1-4c32-9e30-85a9241e9ad6" (UID: "e2bfb07b-00b1-4c32-9e30-85a9241e9ad6"). InnerVolumeSpecName "kube-api-access-m9z45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:56:09.163199 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.163166    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-openshift-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:56:09.163199 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.163193    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-maas-api-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:56:09.163199 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.163202    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9z45\" (UniqueName: \"kubernetes.io/projected/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6-kube-api-access-m9z45\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:56:09.274370 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.274332    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2bfb07b-00b1-4c32-9e30-85a9241e9ad6" containerID="e517b80abf1c41c6d716f9d1ff18d63706ab97de824def9094f9df8a54e9115b" exitCode=0
Jul 22 16:56:09.274529 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.274386    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"
Jul 22 16:56:09.274529 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.274421    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87" event={"ID":"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6","Type":"ContainerDied","Data":"e517b80abf1c41c6d716f9d1ff18d63706ab97de824def9094f9df8a54e9115b"}
Jul 22 16:56:09.274529 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.274495    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87" event={"ID":"e2bfb07b-00b1-4c32-9e30-85a9241e9ad6","Type":"ContainerDied","Data":"fe12aac1c395d90c9dbd91001a786183a2694fac15d64bf785ff8fb2facaffe1"}
Jul 22 16:56:09.274529 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.274520    2580 scope.go:117] "RemoveContainer" containerID="e517b80abf1c41c6d716f9d1ff18d63706ab97de824def9094f9df8a54e9115b"
Jul 22 16:56:09.284007 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.283991    2580 scope.go:117] "RemoveContainer" containerID="e517b80abf1c41c6d716f9d1ff18d63706ab97de824def9094f9df8a54e9115b"
Jul 22 16:56:09.284269 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:56:09.284247    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e517b80abf1c41c6d716f9d1ff18d63706ab97de824def9094f9df8a54e9115b\": container with ID starting with e517b80abf1c41c6d716f9d1ff18d63706ab97de824def9094f9df8a54e9115b not found: ID does not exist" containerID="e517b80abf1c41c6d716f9d1ff18d63706ab97de824def9094f9df8a54e9115b"
Jul 22 16:56:09.284318 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.284276    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e517b80abf1c41c6d716f9d1ff18d63706ab97de824def9094f9df8a54e9115b"} err="failed to get container status \"e517b80abf1c41c6d716f9d1ff18d63706ab97de824def9094f9df8a54e9115b\": rpc error: code = NotFound desc = could not find container \"e517b80abf1c41c6d716f9d1ff18d63706ab97de824def9094f9df8a54e9115b\": container with ID starting with e517b80abf1c41c6d716f9d1ff18d63706ab97de824def9094f9df8a54e9115b not found: ID does not exist"
Jul 22 16:56:09.296288 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.296265    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"]
Jul 22 16:56:09.301292 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.301274    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b9fae547-556df5bccc-4vg87"]
Jul 22 16:56:09.372824 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:09.372764    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2bfb07b-00b1-4c32-9e30-85a9241e9ad6" path="/var/lib/kubelet/pods/e2bfb07b-00b1-4c32-9e30-85a9241e9ad6/volumes"
Jul 22 16:56:20.679543 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:20.679504    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"]
Jul 22 16:56:35.699246 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:35.699188    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7" podUID="410946d0-4532-49aa-8d3e-ddabc34dbd01" containerName="main" containerID="cri-o://9c1e2924fc138956684346a5cbda3111a2304909c5c2642e18032017f42c0c5b" gracePeriod=45
Jul 22 16:56:35.952836 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:35.952783    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:56:36.032236 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.032205    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-dshm\") pod \"410946d0-4532-49aa-8d3e-ddabc34dbd01\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") "
Jul 22 16:56:36.032399 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.032269    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsdqv\" (UniqueName: \"kubernetes.io/projected/410946d0-4532-49aa-8d3e-ddabc34dbd01-kube-api-access-hsdqv\") pod \"410946d0-4532-49aa-8d3e-ddabc34dbd01\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") "
Jul 22 16:56:36.032399 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.032308    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410946d0-4532-49aa-8d3e-ddabc34dbd01-tls-certs\") pod \"410946d0-4532-49aa-8d3e-ddabc34dbd01\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") "
Jul 22 16:56:36.032399 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.032346    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-model-cache\") pod \"410946d0-4532-49aa-8d3e-ddabc34dbd01\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") "
Jul 22 16:56:36.032571 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.032408    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-tmp-dir\") pod \"410946d0-4532-49aa-8d3e-ddabc34dbd01\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") "
Jul 22 16:56:36.032571 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.032433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-home\") pod \"410946d0-4532-49aa-8d3e-ddabc34dbd01\" (UID: \"410946d0-4532-49aa-8d3e-ddabc34dbd01\") "
Jul 22 16:56:36.032744 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.032714    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "410946d0-4532-49aa-8d3e-ddabc34dbd01" (UID: "410946d0-4532-49aa-8d3e-ddabc34dbd01"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:56:36.032814 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.032698    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-model-cache" (OuterVolumeSpecName: "model-cache") pod "410946d0-4532-49aa-8d3e-ddabc34dbd01" (UID: "410946d0-4532-49aa-8d3e-ddabc34dbd01"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:56:36.032814 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.032745    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-home" (OuterVolumeSpecName: "home") pod "410946d0-4532-49aa-8d3e-ddabc34dbd01" (UID: "410946d0-4532-49aa-8d3e-ddabc34dbd01"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:56:36.032908 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.032896    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-tmp-dir\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:56:36.032949 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.032911    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-home\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:56:36.032949 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.032920    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-model-cache\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:56:36.034501 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.034482    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-dshm" (OuterVolumeSpecName: "dshm") pod "410946d0-4532-49aa-8d3e-ddabc34dbd01" (UID: "410946d0-4532-49aa-8d3e-ddabc34dbd01"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:56:36.034798 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.034769    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/410946d0-4532-49aa-8d3e-ddabc34dbd01-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "410946d0-4532-49aa-8d3e-ddabc34dbd01" (UID: "410946d0-4532-49aa-8d3e-ddabc34dbd01"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:56:36.034798 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.034780    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/410946d0-4532-49aa-8d3e-ddabc34dbd01-kube-api-access-hsdqv" (OuterVolumeSpecName: "kube-api-access-hsdqv") pod "410946d0-4532-49aa-8d3e-ddabc34dbd01" (UID: "410946d0-4532-49aa-8d3e-ddabc34dbd01"). InnerVolumeSpecName "kube-api-access-hsdqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:56:36.133441 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.133407    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410946d0-4532-49aa-8d3e-ddabc34dbd01-dshm\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:56:36.133441 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.133437    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsdqv\" (UniqueName: \"kubernetes.io/projected/410946d0-4532-49aa-8d3e-ddabc34dbd01-kube-api-access-hsdqv\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:56:36.133441 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.133448    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410946d0-4532-49aa-8d3e-ddabc34dbd01-tls-certs\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 16:56:36.411965 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.411930    2580 generic.go:356] "Generic (PLEG): container finished" podID="410946d0-4532-49aa-8d3e-ddabc34dbd01" containerID="9c1e2924fc138956684346a5cbda3111a2304909c5c2642e18032017f42c0c5b" exitCode=0
Jul 22 16:56:36.412161 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.411968    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"
Jul 22 16:56:36.412161 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.412004    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7" event={"ID":"410946d0-4532-49aa-8d3e-ddabc34dbd01","Type":"ContainerDied","Data":"9c1e2924fc138956684346a5cbda3111a2304909c5c2642e18032017f42c0c5b"}
Jul 22 16:56:36.412161 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.412056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7" event={"ID":"410946d0-4532-49aa-8d3e-ddabc34dbd01","Type":"ContainerDied","Data":"972f6a28ea8012bb264e5f63cfdd60f4f0c791db435ba310eec675edc968ee03"}
Jul 22 16:56:36.412161 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.412076    2580 scope.go:117] "RemoveContainer" containerID="9c1e2924fc138956684346a5cbda3111a2304909c5c2642e18032017f42c0c5b"
Jul 22 16:56:36.421467 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.421449    2580 scope.go:117] "RemoveContainer" containerID="9c1e2924fc138956684346a5cbda3111a2304909c5c2642e18032017f42c0c5b"
Jul 22 16:56:36.421714 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:56:36.421693    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c1e2924fc138956684346a5cbda3111a2304909c5c2642e18032017f42c0c5b\": container with ID starting with 9c1e2924fc138956684346a5cbda3111a2304909c5c2642e18032017f42c0c5b not found: ID does not exist" containerID="9c1e2924fc138956684346a5cbda3111a2304909c5c2642e18032017f42c0c5b"
Jul 22 16:56:36.421783 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.421726    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c1e2924fc138956684346a5cbda3111a2304909c5c2642e18032017f42c0c5b"} err="failed to get container status \"9c1e2924fc138956684346a5cbda3111a2304909c5c2642e18032017f42c0c5b\": rpc error: code = NotFound desc = could not find container \"9c1e2924fc138956684346a5cbda3111a2304909c5c2642e18032017f42c0c5b\": container with ID starting with 9c1e2924fc138956684346a5cbda3111a2304909c5c2642e18032017f42c0c5b not found: ID does not exist"
Jul 22 16:56:36.435003 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.434977    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"]
Jul 22 16:56:36.438104 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:36.438081    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b9fae547/e2e-lifecycle-model-b9fae547-kserve-68d8585fc9-mqpv7"]
Jul 22 16:56:37.373071 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:56:37.373014    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="410946d0-4532-49aa-8d3e-ddabc34dbd01" path="/var/lib/kubelet/pods/410946d0-4532-49aa-8d3e-ddabc34dbd01/volumes"
Jul 22 16:58:02.069240 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.069205    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"]
Jul 22 16:58:02.069721 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.069608    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="410946d0-4532-49aa-8d3e-ddabc34dbd01" containerName="main"
Jul 22 16:58:02.069721 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.069620    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="410946d0-4532-49aa-8d3e-ddabc34dbd01" containerName="main"
Jul 22 16:58:02.069721 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.069632    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2bfb07b-00b1-4c32-9e30-85a9241e9ad6" containerName="maas-api"
Jul 22 16:58:02.069721 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.069637    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2bfb07b-00b1-4c32-9e30-85a9241e9ad6" containerName="maas-api"
Jul 22 16:58:02.069721 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.069700    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2bfb07b-00b1-4c32-9e30-85a9241e9ad6" containerName="maas-api"
Jul 22 16:58:02.069721 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.069712    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="410946d0-4532-49aa-8d3e-ddabc34dbd01" containerName="main"
Jul 22 16:58:02.072938 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.072918    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:02.075541 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.075521    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nzvb6\""
Jul 22 16:58:02.075659 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.075522    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-b4259e-serving-cert\""
Jul 22 16:58:02.084426 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.084401    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"]
Jul 22 16:58:02.135359 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.135321    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e37d52f6-34f0-41f9-9219-cbdb897707a0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps\" (UID: \"e37d52f6-34f0-41f9-9219-cbdb897707a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:02.135512 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.135455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4cs4\" (UniqueName: \"kubernetes.io/projected/e37d52f6-34f0-41f9-9219-cbdb897707a0-kube-api-access-z4cs4\") pod \"maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps\" (UID: \"e37d52f6-34f0-41f9-9219-cbdb897707a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:02.135583 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.135519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e37d52f6-34f0-41f9-9219-cbdb897707a0-maas-api-tls\") pod \"maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps\" (UID: \"e37d52f6-34f0-41f9-9219-cbdb897707a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:02.236638 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.236601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e37d52f6-34f0-41f9-9219-cbdb897707a0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps\" (UID: \"e37d52f6-34f0-41f9-9219-cbdb897707a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:02.236805 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.236657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4cs4\" (UniqueName: \"kubernetes.io/projected/e37d52f6-34f0-41f9-9219-cbdb897707a0-kube-api-access-z4cs4\") pod \"maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps\" (UID: \"e37d52f6-34f0-41f9-9219-cbdb897707a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:02.236805 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.236683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e37d52f6-34f0-41f9-9219-cbdb897707a0-maas-api-tls\") pod \"maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps\" (UID: \"e37d52f6-34f0-41f9-9219-cbdb897707a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:02.236805 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:58:02.236789    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-serving-cert: secret "maas-api-e2e-inf-a-b4259e-serving-cert" not found
Jul 22 16:58:02.236968 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:58:02.236854    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e37d52f6-34f0-41f9-9219-cbdb897707a0-maas-api-tls podName:e37d52f6-34f0-41f9-9219-cbdb897707a0 nodeName:}" failed. No retries permitted until 2026-07-22 16:58:02.736837215 +0000 UTC m=+2112.089113212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e37d52f6-34f0-41f9-9219-cbdb897707a0-maas-api-tls") pod "maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps" (UID: "e37d52f6-34f0-41f9-9219-cbdb897707a0") : secret "maas-api-e2e-inf-a-b4259e-serving-cert" not found
Jul 22 16:58:02.237286 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.237266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e37d52f6-34f0-41f9-9219-cbdb897707a0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps\" (UID: \"e37d52f6-34f0-41f9-9219-cbdb897707a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:02.250825 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.250800    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4cs4\" (UniqueName: \"kubernetes.io/projected/e37d52f6-34f0-41f9-9219-cbdb897707a0-kube-api-access-z4cs4\") pod \"maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps\" (UID: \"e37d52f6-34f0-41f9-9219-cbdb897707a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:02.741088 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.741059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e37d52f6-34f0-41f9-9219-cbdb897707a0-maas-api-tls\") pod \"maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps\" (UID: \"e37d52f6-34f0-41f9-9219-cbdb897707a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:02.743418 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.743396    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e37d52f6-34f0-41f9-9219-cbdb897707a0-maas-api-tls\") pod \"maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps\" (UID: \"e37d52f6-34f0-41f9-9219-cbdb897707a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:02.983250 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:02.983206    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:03.123419 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:03.123397    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"]
Jul 22 16:58:03.125714 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:58:03.125687    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37d52f6_34f0_41f9_9219_cbdb897707a0.slice/crio-37bdd5d85e24462bcce8a233a7f7da71dc94318943a425213ad510264b50f552 WatchSource:0}: Error finding container 37bdd5d85e24462bcce8a233a7f7da71dc94318943a425213ad510264b50f552: Status 404 returned error can't find the container with id 37bdd5d85e24462bcce8a233a7f7da71dc94318943a425213ad510264b50f552
Jul 22 16:58:03.856939 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:03.856855    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps" event={"ID":"e37d52f6-34f0-41f9-9219-cbdb897707a0","Type":"ContainerStarted","Data":"a070349ed53a9c797dd51e39c2339e79b7f1f18d14537f04fffb3f13935c9cf2"}
Jul 22 16:58:03.856939 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:03.856916    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps" event={"ID":"e37d52f6-34f0-41f9-9219-cbdb897707a0","Type":"ContainerStarted","Data":"37bdd5d85e24462bcce8a233a7f7da71dc94318943a425213ad510264b50f552"}
Jul 22 16:58:03.857171 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:03.856945    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:03.877256 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:03.877204    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps" podStartSLOduration=1.461082783 podStartE2EDuration="1.87718845s" totalImagesPullingTime="416.105667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:58:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:58:03.87481749 +0000 UTC m=+2113.227093510" watchObservedRunningTime="2026-07-22 16:58:03.87718845 +0000 UTC m=+2113.229464470"
Jul 22 16:58:09.867188 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:09.867157    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 16:58:10.033858 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.033820    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"]
Jul 22 16:58:10.037683 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.037662    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:10.040241 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.040220    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6608f1-serving-cert\""
Jul 22 16:58:10.047206 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.047184    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"]
Jul 22 16:58:10.110781 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.110749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32cbf217-0da5-43d8-a81a-5d12f23bec27-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf\" (UID: \"32cbf217-0da5-43d8-a81a-5d12f23bec27\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:10.110935 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.110807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhgmt\" (UniqueName: \"kubernetes.io/projected/32cbf217-0da5-43d8-a81a-5d12f23bec27-kube-api-access-jhgmt\") pod \"maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf\" (UID: \"32cbf217-0da5-43d8-a81a-5d12f23bec27\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:10.110935 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.110911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32cbf217-0da5-43d8-a81a-5d12f23bec27-maas-api-tls\") pod \"maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf\" (UID: \"32cbf217-0da5-43d8-a81a-5d12f23bec27\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:10.211836 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.211803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32cbf217-0da5-43d8-a81a-5d12f23bec27-maas-api-tls\") pod \"maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf\" (UID: \"32cbf217-0da5-43d8-a81a-5d12f23bec27\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:10.212002 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.211869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32cbf217-0da5-43d8-a81a-5d12f23bec27-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf\" (UID: \"32cbf217-0da5-43d8-a81a-5d12f23bec27\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:10.212002 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.211905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhgmt\" (UniqueName: \"kubernetes.io/projected/32cbf217-0da5-43d8-a81a-5d12f23bec27-kube-api-access-jhgmt\") pod \"maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf\" (UID: \"32cbf217-0da5-43d8-a81a-5d12f23bec27\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:10.212002 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:58:10.211946    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-serving-cert: secret "maas-api-e2e-inf-b-6608f1-serving-cert" not found
Jul 22 16:58:10.212002 ip-10-0-142-32 kubenswrapper[2580]: E0722 16:58:10.212002    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32cbf217-0da5-43d8-a81a-5d12f23bec27-maas-api-tls podName:32cbf217-0da5-43d8-a81a-5d12f23bec27 nodeName:}" failed. No retries permitted until 2026-07-22 16:58:10.711984722 +0000 UTC m=+2120.064260723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/32cbf217-0da5-43d8-a81a-5d12f23bec27-maas-api-tls") pod "maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf" (UID: "32cbf217-0da5-43d8-a81a-5d12f23bec27") : secret "maas-api-e2e-inf-b-6608f1-serving-cert" not found
Jul 22 16:58:10.212557 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.212538    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32cbf217-0da5-43d8-a81a-5d12f23bec27-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf\" (UID: \"32cbf217-0da5-43d8-a81a-5d12f23bec27\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:10.220538 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.220511    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhgmt\" (UniqueName: \"kubernetes.io/projected/32cbf217-0da5-43d8-a81a-5d12f23bec27-kube-api-access-jhgmt\") pod \"maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf\" (UID: \"32cbf217-0da5-43d8-a81a-5d12f23bec27\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:10.716404 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.716368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32cbf217-0da5-43d8-a81a-5d12f23bec27-maas-api-tls\") pod \"maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf\" (UID: \"32cbf217-0da5-43d8-a81a-5d12f23bec27\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:10.718572 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.718541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32cbf217-0da5-43d8-a81a-5d12f23bec27-maas-api-tls\") pod \"maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf\" (UID: \"32cbf217-0da5-43d8-a81a-5d12f23bec27\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:10.950292 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:10.950262    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:11.087061 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:11.087014    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"]
Jul 22 16:58:11.088286 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:58:11.088260    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32cbf217_0da5_43d8_a81a_5d12f23bec27.slice/crio-ee6b005e91646b681778841bbeaf52738b2d3d2e2f44ce79f4723105601e1918 WatchSource:0}: Error finding container ee6b005e91646b681778841bbeaf52738b2d3d2e2f44ce79f4723105601e1918: Status 404 returned error can't find the container with id ee6b005e91646b681778841bbeaf52738b2d3d2e2f44ce79f4723105601e1918
Jul 22 16:58:11.903042 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:11.902986    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf" event={"ID":"32cbf217-0da5-43d8-a81a-5d12f23bec27","Type":"ContainerStarted","Data":"88d286843a46ce096cfa2d8407476cf8169a363221ad5a1f6628b4118c348407"}
Jul 22 16:58:11.903199 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:11.903060    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf" event={"ID":"32cbf217-0da5-43d8-a81a-5d12f23bec27","Type":"ContainerStarted","Data":"ee6b005e91646b681778841bbeaf52738b2d3d2e2f44ce79f4723105601e1918"}
Jul 22 16:58:11.903199 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:11.903107    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:11.919542 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:11.919500    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf" podStartSLOduration=1.482344149 podStartE2EDuration="1.919484045s" totalImagesPullingTime="437.139896ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:58:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:58:11.918153634 +0000 UTC m=+2121.270429656" watchObservedRunningTime="2026-07-22 16:58:11.919484045 +0000 UTC m=+2121.271760066"
Jul 22 16:58:17.913748 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:17.913718    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 16:58:23.293061 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.293009    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"]
Jul 22 16:58:23.297065 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.297041    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.300928 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.300905    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b4259e\"/\"kube-root-ca.crt\""
Jul 22 16:58:23.301132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.301114    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b4259e\"/\"test-model-b4259e-kserve-self-signed-certs\""
Jul 22 16:58:23.301220 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.301164    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b4259e\"/\"default-dockercfg-fxsnr\""
Jul 22 16:58:23.301278 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.301262    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b4259e\"/\"openshift-service-ca.crt\""
Jul 22 16:58:23.306936 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.306901    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"]
Jul 22 16:58:23.343212 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.343182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pt5f\" (UniqueName: \"kubernetes.io/projected/f4ba8622-0a98-4a11-acd2-877021e75452-kube-api-access-5pt5f\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.343364 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.343236    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-model-cache\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.343364 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.343300    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-home\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.343364 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.343340    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ba8622-0a98-4a11-acd2-877021e75452-tls-certs\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.343479 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.343365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-tmp-dir\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.343479 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.343441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-dshm\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.444956 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.444926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-model-cache\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.445184 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.444981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-home\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.445184 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.445030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ba8622-0a98-4a11-acd2-877021e75452-tls-certs\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.445184 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.445066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-tmp-dir\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.445184 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.445176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-dshm\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.445434 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.445226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pt5f\" (UniqueName: \"kubernetes.io/projected/f4ba8622-0a98-4a11-acd2-877021e75452-kube-api-access-5pt5f\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.445434 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.445362    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-model-cache\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.445434 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.445423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-home\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.445629 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.445541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-tmp-dir\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.447575 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.447549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-dshm\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.447575 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.447573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ba8622-0a98-4a11-acd2-877021e75452-tls-certs\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.453290 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.453270    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pt5f\" (UniqueName: \"kubernetes.io/projected/f4ba8622-0a98-4a11-acd2-877021e75452-kube-api-access-5pt5f\") pod \"test-model-b4259e-kserve-56c98d4795-88z4c\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") " pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.607959 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.607873    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:23.748121 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.748089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"]
Jul 22 16:58:23.750091 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:58:23.750064    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4ba8622_0a98_4a11_acd2_877021e75452.slice/crio-4cb1ae5d6241980fc725ab87652621efd744c96c3cd65549994787003abfe44d WatchSource:0}: Error finding container 4cb1ae5d6241980fc725ab87652621efd744c96c3cd65549994787003abfe44d: Status 404 returned error can't find the container with id 4cb1ae5d6241980fc725ab87652621efd744c96c3cd65549994787003abfe44d
Jul 22 16:58:23.965530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.965490    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c" event={"ID":"f4ba8622-0a98-4a11-acd2-877021e75452","Type":"ContainerStarted","Data":"23479ccb9a66791afcc1bf348160aa8c4d2e41a0a1a7f37e5904e4ba4386c221"}
Jul 22 16:58:23.965530 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.965536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c" event={"ID":"f4ba8622-0a98-4a11-acd2-877021e75452","Type":"ContainerStarted","Data":"4cb1ae5d6241980fc725ab87652621efd744c96c3cd65549994787003abfe44d"}
Jul 22 16:58:23.984513 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:23.984462    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c" podStartSLOduration=0.984439525 podStartE2EDuration="984.439525ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:58:23.983931779 +0000 UTC m=+2133.336207799" watchObservedRunningTime="2026-07-22 16:58:23.984439525 +0000 UTC m=+2133.336715537"
Jul 22 16:58:33.609118 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:33.609071    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:33.609118 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:33.609128    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:33.621366 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:33.621341    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:58:34.027049 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:58:34.027005    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 16:59:14.799661 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:14.799628    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"]
Jul 22 16:59:14.803785 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:14.803767    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:14.807383 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:14.807359    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6608f1\"/\"openshift-service-ca.crt\""
Jul 22 16:59:14.807383 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:14.807371    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6608f1\"/\"default-dockercfg-rh4kz\""
Jul 22 16:59:14.807568 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:14.807424    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6608f1\"/\"test-model-6608f1-kserve-self-signed-certs\""
Jul 22 16:59:14.807568 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:14.807432    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6608f1\"/\"kube-root-ca.crt\""
Jul 22 16:59:14.812475 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:14.812453    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"]
Jul 22 16:59:14.945132 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:14.945096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-model-cache\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:14.945326 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:14.945150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-tmp-dir\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:14.945326 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:14.945171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-dshm\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:14.945326 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:14.945214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d0e7a3-2f50-4eae-9a04-649812272acb-tls-certs\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:14.945326 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:14.945293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqd82\" (UniqueName: \"kubernetes.io/projected/c9d0e7a3-2f50-4eae-9a04-649812272acb-kube-api-access-kqd82\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:14.945536 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:14.945402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-home\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.046469 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.046422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d0e7a3-2f50-4eae-9a04-649812272acb-tls-certs\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.046686 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.046484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqd82\" (UniqueName: \"kubernetes.io/projected/c9d0e7a3-2f50-4eae-9a04-649812272acb-kube-api-access-kqd82\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.046686 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.046560    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-home\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.046686 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.046616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-model-cache\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.046686 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.046668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-tmp-dir\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.046891 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.046694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-dshm\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.047078 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.047051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-home\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.047152 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.047080    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-model-cache\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.047152 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.047125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-tmp-dir\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.048864 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.048842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-dshm\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.049075 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.049057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d0e7a3-2f50-4eae-9a04-649812272acb-tls-certs\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.054328 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.054268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqd82\" (UniqueName: \"kubernetes.io/projected/c9d0e7a3-2f50-4eae-9a04-649812272acb-kube-api-access-kqd82\") pod \"test-model-6608f1-kserve-8876c6f87-v5fvw\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") " pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.114380 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.114344    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:15.250972 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:15.248393    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"]
Jul 22 16:59:15.251603 ip-10-0-142-32 kubenswrapper[2580]: W0722 16:59:15.251571    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9d0e7a3_2f50_4eae_9a04_649812272acb.slice/crio-3998f07a6e9da41ba25091a87195f0388b9458f7a41c66bd762460b7bb849236 WatchSource:0}: Error finding container 3998f07a6e9da41ba25091a87195f0388b9458f7a41c66bd762460b7bb849236: Status 404 returned error can't find the container with id 3998f07a6e9da41ba25091a87195f0388b9458f7a41c66bd762460b7bb849236
Jul 22 16:59:16.229318 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:16.229282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw" event={"ID":"c9d0e7a3-2f50-4eae-9a04-649812272acb","Type":"ContainerStarted","Data":"8d1505659bc8e6563783fcd2836428feb98cb9d2ac8903ad1dbb9929a9913d97"}
Jul 22 16:59:16.229697 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:16.229329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw" event={"ID":"c9d0e7a3-2f50-4eae-9a04-649812272acb","Type":"ContainerStarted","Data":"3998f07a6e9da41ba25091a87195f0388b9458f7a41c66bd762460b7bb849236"}
Jul 22 16:59:16.245974 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:16.245926    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw" podStartSLOduration=2.245910444 podStartE2EDuration="2.245910444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:59:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:59:16.244936638 +0000 UTC m=+2185.597212657" watchObservedRunningTime="2026-07-22 16:59:16.245910444 +0000 UTC m=+2185.598186465"
Jul 22 16:59:25.115325 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:25.115287    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:25.115847 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:25.115425    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:25.127788 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:25.127764    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 16:59:25.286235 ip-10-0-142-32 kubenswrapper[2580]: I0722 16:59:25.286209    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 17:00:15.774428 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:15.774341    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"]
Jul 22 17:00:16.735336 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:16.735299    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"]
Jul 22 17:00:27.347928 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:27.347893    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"]
Jul 22 17:00:27.348484 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:27.348116    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps" podUID="e37d52f6-34f0-41f9-9219-cbdb897707a0" containerName="maas-api" containerID="cri-o://a070349ed53a9c797dd51e39c2339e79b7f1f18d14537f04fffb3f13935c9cf2" gracePeriod=30
Jul 22 17:00:27.796510 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:27.796484    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 17:00:27.875878 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:27.875846    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4cs4\" (UniqueName: \"kubernetes.io/projected/e37d52f6-34f0-41f9-9219-cbdb897707a0-kube-api-access-z4cs4\") pod \"e37d52f6-34f0-41f9-9219-cbdb897707a0\" (UID: \"e37d52f6-34f0-41f9-9219-cbdb897707a0\") "
Jul 22 17:00:27.876077 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:27.875906    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e37d52f6-34f0-41f9-9219-cbdb897707a0-openshift-service-ca\") pod \"e37d52f6-34f0-41f9-9219-cbdb897707a0\" (UID: \"e37d52f6-34f0-41f9-9219-cbdb897707a0\") "
Jul 22 17:00:27.876077 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:27.875937    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e37d52f6-34f0-41f9-9219-cbdb897707a0-maas-api-tls\") pod \"e37d52f6-34f0-41f9-9219-cbdb897707a0\" (UID: \"e37d52f6-34f0-41f9-9219-cbdb897707a0\") "
Jul 22 17:00:27.876308 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:27.876276    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37d52f6-34f0-41f9-9219-cbdb897707a0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e37d52f6-34f0-41f9-9219-cbdb897707a0" (UID: "e37d52f6-34f0-41f9-9219-cbdb897707a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:00:27.878046 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:27.878007    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37d52f6-34f0-41f9-9219-cbdb897707a0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e37d52f6-34f0-41f9-9219-cbdb897707a0" (UID: "e37d52f6-34f0-41f9-9219-cbdb897707a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:00:27.878151 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:27.878056    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37d52f6-34f0-41f9-9219-cbdb897707a0-kube-api-access-z4cs4" (OuterVolumeSpecName: "kube-api-access-z4cs4") pod "e37d52f6-34f0-41f9-9219-cbdb897707a0" (UID: "e37d52f6-34f0-41f9-9219-cbdb897707a0"). InnerVolumeSpecName "kube-api-access-z4cs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:00:27.977765 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:27.977731    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4cs4\" (UniqueName: \"kubernetes.io/projected/e37d52f6-34f0-41f9-9219-cbdb897707a0-kube-api-access-z4cs4\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:27.977765 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:27.977760    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e37d52f6-34f0-41f9-9219-cbdb897707a0-openshift-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:27.977765 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:27.977771    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e37d52f6-34f0-41f9-9219-cbdb897707a0-maas-api-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:28.608009 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:28.607972    2580 generic.go:356] "Generic (PLEG): container finished" podID="e37d52f6-34f0-41f9-9219-cbdb897707a0" containerID="a070349ed53a9c797dd51e39c2339e79b7f1f18d14537f04fffb3f13935c9cf2" exitCode=0
Jul 22 17:00:28.608009 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:28.608014    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"
Jul 22 17:00:28.608549 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:28.608058    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps" event={"ID":"e37d52f6-34f0-41f9-9219-cbdb897707a0","Type":"ContainerDied","Data":"a070349ed53a9c797dd51e39c2339e79b7f1f18d14537f04fffb3f13935c9cf2"}
Jul 22 17:00:28.608549 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:28.608112    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps" event={"ID":"e37d52f6-34f0-41f9-9219-cbdb897707a0","Type":"ContainerDied","Data":"37bdd5d85e24462bcce8a233a7f7da71dc94318943a425213ad510264b50f552"}
Jul 22 17:00:28.608549 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:28.608137    2580 scope.go:117] "RemoveContainer" containerID="a070349ed53a9c797dd51e39c2339e79b7f1f18d14537f04fffb3f13935c9cf2"
Jul 22 17:00:28.617756 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:28.617739    2580 scope.go:117] "RemoveContainer" containerID="a070349ed53a9c797dd51e39c2339e79b7f1f18d14537f04fffb3f13935c9cf2"
Jul 22 17:00:28.617995 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:00:28.617974    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a070349ed53a9c797dd51e39c2339e79b7f1f18d14537f04fffb3f13935c9cf2\": container with ID starting with a070349ed53a9c797dd51e39c2339e79b7f1f18d14537f04fffb3f13935c9cf2 not found: ID does not exist" containerID="a070349ed53a9c797dd51e39c2339e79b7f1f18d14537f04fffb3f13935c9cf2"
Jul 22 17:00:28.618078 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:28.618002    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a070349ed53a9c797dd51e39c2339e79b7f1f18d14537f04fffb3f13935c9cf2"} err="failed to get container status \"a070349ed53a9c797dd51e39c2339e79b7f1f18d14537f04fffb3f13935c9cf2\": rpc error: code = NotFound desc = could not find container \"a070349ed53a9c797dd51e39c2339e79b7f1f18d14537f04fffb3f13935c9cf2\": container with ID starting with a070349ed53a9c797dd51e39c2339e79b7f1f18d14537f04fffb3f13935c9cf2 not found: ID does not exist"
Jul 22 17:00:28.629458 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:28.629438    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"]
Jul 22 17:00:28.632638 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:28.632616    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b4259e-58d757cdff-rlrps"]
Jul 22 17:00:29.373204 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:29.373162    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e37d52f6-34f0-41f9-9219-cbdb897707a0" path="/var/lib/kubelet/pods/e37d52f6-34f0-41f9-9219-cbdb897707a0/volumes"
Jul 22 17:00:30.797362 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:30.797325    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c" podUID="f4ba8622-0a98-4a11-acd2-877021e75452" containerName="main" containerID="cri-o://23479ccb9a66791afcc1bf348160aa8c4d2e41a0a1a7f37e5904e4ba4386c221" gracePeriod=45
Jul 22 17:00:31.050442 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.050383    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 17:00:31.208786 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.208752    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-tmp-dir\") pod \"f4ba8622-0a98-4a11-acd2-877021e75452\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") "
Jul 22 17:00:31.208786 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.208791    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-dshm\") pod \"f4ba8622-0a98-4a11-acd2-877021e75452\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") "
Jul 22 17:00:31.209059 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.208828    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ba8622-0a98-4a11-acd2-877021e75452-tls-certs\") pod \"f4ba8622-0a98-4a11-acd2-877021e75452\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") "
Jul 22 17:00:31.209059 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.208862    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-model-cache\") pod \"f4ba8622-0a98-4a11-acd2-877021e75452\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") "
Jul 22 17:00:31.209059 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.208919    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-home\") pod \"f4ba8622-0a98-4a11-acd2-877021e75452\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") "
Jul 22 17:00:31.209059 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.209008    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pt5f\" (UniqueName: \"kubernetes.io/projected/f4ba8622-0a98-4a11-acd2-877021e75452-kube-api-access-5pt5f\") pod \"f4ba8622-0a98-4a11-acd2-877021e75452\" (UID: \"f4ba8622-0a98-4a11-acd2-877021e75452\") "
Jul 22 17:00:31.209280 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.209071    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f4ba8622-0a98-4a11-acd2-877021e75452" (UID: "f4ba8622-0a98-4a11-acd2-877021e75452"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:31.209280 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.209197    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-model-cache" (OuterVolumeSpecName: "model-cache") pod "f4ba8622-0a98-4a11-acd2-877021e75452" (UID: "f4ba8622-0a98-4a11-acd2-877021e75452"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:31.209280 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.209272    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-home" (OuterVolumeSpecName: "home") pod "f4ba8622-0a98-4a11-acd2-877021e75452" (UID: "f4ba8622-0a98-4a11-acd2-877021e75452"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:31.209421 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.209404    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-model-cache\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:31.209421 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.209420    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-home\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:31.209570 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.209429    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-tmp-dir\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:31.211130 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.211104    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-dshm" (OuterVolumeSpecName: "dshm") pod "f4ba8622-0a98-4a11-acd2-877021e75452" (UID: "f4ba8622-0a98-4a11-acd2-877021e75452"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:31.211228 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.211153    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ba8622-0a98-4a11-acd2-877021e75452-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f4ba8622-0a98-4a11-acd2-877021e75452" (UID: "f4ba8622-0a98-4a11-acd2-877021e75452"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:00:31.211228 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.211181    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ba8622-0a98-4a11-acd2-877021e75452-kube-api-access-5pt5f" (OuterVolumeSpecName: "kube-api-access-5pt5f") pod "f4ba8622-0a98-4a11-acd2-877021e75452" (UID: "f4ba8622-0a98-4a11-acd2-877021e75452"). InnerVolumeSpecName "kube-api-access-5pt5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:00:31.310111 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.310004    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pt5f\" (UniqueName: \"kubernetes.io/projected/f4ba8622-0a98-4a11-acd2-877021e75452-kube-api-access-5pt5f\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:31.310111 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.310058    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4ba8622-0a98-4a11-acd2-877021e75452-dshm\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:31.310111 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.310072    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ba8622-0a98-4a11-acd2-877021e75452-tls-certs\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:31.626649 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.626568    2580 generic.go:356] "Generic (PLEG): container finished" podID="f4ba8622-0a98-4a11-acd2-877021e75452" containerID="23479ccb9a66791afcc1bf348160aa8c4d2e41a0a1a7f37e5904e4ba4386c221" exitCode=0
Jul 22 17:00:31.626649 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.626622    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"
Jul 22 17:00:31.626828 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.626647    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c" event={"ID":"f4ba8622-0a98-4a11-acd2-877021e75452","Type":"ContainerDied","Data":"23479ccb9a66791afcc1bf348160aa8c4d2e41a0a1a7f37e5904e4ba4386c221"}
Jul 22 17:00:31.626828 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.626693    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c" event={"ID":"f4ba8622-0a98-4a11-acd2-877021e75452","Type":"ContainerDied","Data":"4cb1ae5d6241980fc725ab87652621efd744c96c3cd65549994787003abfe44d"}
Jul 22 17:00:31.626828 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.626711    2580 scope.go:117] "RemoveContainer" containerID="23479ccb9a66791afcc1bf348160aa8c4d2e41a0a1a7f37e5904e4ba4386c221"
Jul 22 17:00:31.635479 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.635461    2580 scope.go:117] "RemoveContainer" containerID="23479ccb9a66791afcc1bf348160aa8c4d2e41a0a1a7f37e5904e4ba4386c221"
Jul 22 17:00:31.635767 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:00:31.635745    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23479ccb9a66791afcc1bf348160aa8c4d2e41a0a1a7f37e5904e4ba4386c221\": container with ID starting with 23479ccb9a66791afcc1bf348160aa8c4d2e41a0a1a7f37e5904e4ba4386c221 not found: ID does not exist" containerID="23479ccb9a66791afcc1bf348160aa8c4d2e41a0a1a7f37e5904e4ba4386c221"
Jul 22 17:00:31.635851 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.635777    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23479ccb9a66791afcc1bf348160aa8c4d2e41a0a1a7f37e5904e4ba4386c221"} err="failed to get container status \"23479ccb9a66791afcc1bf348160aa8c4d2e41a0a1a7f37e5904e4ba4386c221\": rpc error: code = NotFound desc = could not find container \"23479ccb9a66791afcc1bf348160aa8c4d2e41a0a1a7f37e5904e4ba4386c221\": container with ID starting with 23479ccb9a66791afcc1bf348160aa8c4d2e41a0a1a7f37e5904e4ba4386c221 not found: ID does not exist"
Jul 22 17:00:31.642916 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.642887    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"]
Jul 22 17:00:31.646781 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.646758    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-b4259e/test-model-b4259e-kserve-56c98d4795-88z4c"]
Jul 22 17:00:31.757971 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:31.757929    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw" podUID="c9d0e7a3-2f50-4eae-9a04-649812272acb" containerName="main" containerID="cri-o://8d1505659bc8e6563783fcd2836428feb98cb9d2ac8903ad1dbb9929a9913d97" gracePeriod=45
Jul 22 17:00:32.016751 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.016726    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 17:00:32.118177 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.118144    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d0e7a3-2f50-4eae-9a04-649812272acb-tls-certs\") pod \"c9d0e7a3-2f50-4eae-9a04-649812272acb\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") "
Jul 22 17:00:32.118343 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.118204    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-model-cache\") pod \"c9d0e7a3-2f50-4eae-9a04-649812272acb\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") "
Jul 22 17:00:32.118343 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.118245    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-dshm\") pod \"c9d0e7a3-2f50-4eae-9a04-649812272acb\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") "
Jul 22 17:00:32.118462 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.118346    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-home\") pod \"c9d0e7a3-2f50-4eae-9a04-649812272acb\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") "
Jul 22 17:00:32.118462 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.118387    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqd82\" (UniqueName: \"kubernetes.io/projected/c9d0e7a3-2f50-4eae-9a04-649812272acb-kube-api-access-kqd82\") pod \"c9d0e7a3-2f50-4eae-9a04-649812272acb\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") "
Jul 22 17:00:32.118462 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.118424    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-tmp-dir\") pod \"c9d0e7a3-2f50-4eae-9a04-649812272acb\" (UID: \"c9d0e7a3-2f50-4eae-9a04-649812272acb\") "
Jul 22 17:00:32.118616 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.118504    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-model-cache" (OuterVolumeSpecName: "model-cache") pod "c9d0e7a3-2f50-4eae-9a04-649812272acb" (UID: "c9d0e7a3-2f50-4eae-9a04-649812272acb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:32.118705 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.118671    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-home" (OuterVolumeSpecName: "home") pod "c9d0e7a3-2f50-4eae-9a04-649812272acb" (UID: "c9d0e7a3-2f50-4eae-9a04-649812272acb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:32.118761 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.118728    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c9d0e7a3-2f50-4eae-9a04-649812272acb" (UID: "c9d0e7a3-2f50-4eae-9a04-649812272acb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:32.118842 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.118824    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-home\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:32.118897 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.118846    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-tmp-dir\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:32.118897 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.118857    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-model-cache\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:32.120528 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.120502    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9d0e7a3-2f50-4eae-9a04-649812272acb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c9d0e7a3-2f50-4eae-9a04-649812272acb" (UID: "c9d0e7a3-2f50-4eae-9a04-649812272acb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:00:32.120659 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.120537    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-dshm" (OuterVolumeSpecName: "dshm") pod "c9d0e7a3-2f50-4eae-9a04-649812272acb" (UID: "c9d0e7a3-2f50-4eae-9a04-649812272acb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:32.120659 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.120554    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9d0e7a3-2f50-4eae-9a04-649812272acb-kube-api-access-kqd82" (OuterVolumeSpecName: "kube-api-access-kqd82") pod "c9d0e7a3-2f50-4eae-9a04-649812272acb" (UID: "c9d0e7a3-2f50-4eae-9a04-649812272acb"). InnerVolumeSpecName "kube-api-access-kqd82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:00:32.220005 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.219930    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqd82\" (UniqueName: \"kubernetes.io/projected/c9d0e7a3-2f50-4eae-9a04-649812272acb-kube-api-access-kqd82\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:32.220005 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.219959    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d0e7a3-2f50-4eae-9a04-649812272acb-tls-certs\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:32.220005 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.219970    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9d0e7a3-2f50-4eae-9a04-649812272acb-dshm\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:32.633158 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.633073    2580 generic.go:356] "Generic (PLEG): container finished" podID="c9d0e7a3-2f50-4eae-9a04-649812272acb" containerID="8d1505659bc8e6563783fcd2836428feb98cb9d2ac8903ad1dbb9929a9913d97" exitCode=0
Jul 22 17:00:32.633158 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.633120    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"
Jul 22 17:00:32.633380 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.633160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw" event={"ID":"c9d0e7a3-2f50-4eae-9a04-649812272acb","Type":"ContainerDied","Data":"8d1505659bc8e6563783fcd2836428feb98cb9d2ac8903ad1dbb9929a9913d97"}
Jul 22 17:00:32.633380 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.633204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw" event={"ID":"c9d0e7a3-2f50-4eae-9a04-649812272acb","Type":"ContainerDied","Data":"3998f07a6e9da41ba25091a87195f0388b9458f7a41c66bd762460b7bb849236"}
Jul 22 17:00:32.633380 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.633228    2580 scope.go:117] "RemoveContainer" containerID="8d1505659bc8e6563783fcd2836428feb98cb9d2ac8903ad1dbb9929a9913d97"
Jul 22 17:00:32.642180 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.642163    2580 scope.go:117] "RemoveContainer" containerID="8d1505659bc8e6563783fcd2836428feb98cb9d2ac8903ad1dbb9929a9913d97"
Jul 22 17:00:32.642455 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:00:32.642433    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d1505659bc8e6563783fcd2836428feb98cb9d2ac8903ad1dbb9929a9913d97\": container with ID starting with 8d1505659bc8e6563783fcd2836428feb98cb9d2ac8903ad1dbb9929a9913d97 not found: ID does not exist" containerID="8d1505659bc8e6563783fcd2836428feb98cb9d2ac8903ad1dbb9929a9913d97"
Jul 22 17:00:32.642522 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.642465    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1505659bc8e6563783fcd2836428feb98cb9d2ac8903ad1dbb9929a9913d97"} err="failed to get container status \"8d1505659bc8e6563783fcd2836428feb98cb9d2ac8903ad1dbb9929a9913d97\": rpc error: code = NotFound desc = could not find container \"8d1505659bc8e6563783fcd2836428feb98cb9d2ac8903ad1dbb9929a9913d97\": container with ID starting with 8d1505659bc8e6563783fcd2836428feb98cb9d2ac8903ad1dbb9929a9913d97 not found: ID does not exist"
Jul 22 17:00:32.653648 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.653626    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"]
Jul 22 17:00:32.659313 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:32.659293    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6608f1/test-model-6608f1-kserve-8876c6f87-v5fvw"]
Jul 22 17:00:33.373224 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:33.373191    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9d0e7a3-2f50-4eae-9a04-649812272acb" path="/var/lib/kubelet/pods/c9d0e7a3-2f50-4eae-9a04-649812272acb/volumes"
Jul 22 17:00:33.373622 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:33.373608    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4ba8622-0a98-4a11-acd2-877021e75452" path="/var/lib/kubelet/pods/f4ba8622-0a98-4a11-acd2-877021e75452/volumes"
Jul 22 17:00:38.675411 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.675368    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v"]
Jul 22 17:00:38.675969 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.675948    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ba8622-0a98-4a11-acd2-877021e75452" containerName="main"
Jul 22 17:00:38.676092 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.675972    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ba8622-0a98-4a11-acd2-877021e75452" containerName="main"
Jul 22 17:00:38.676092 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.676034    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37d52f6-34f0-41f9-9219-cbdb897707a0" containerName="maas-api"
Jul 22 17:00:38.676092 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.676044    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37d52f6-34f0-41f9-9219-cbdb897707a0" containerName="maas-api"
Jul 22 17:00:38.676092 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.676065    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d0e7a3-2f50-4eae-9a04-649812272acb" containerName="main"
Jul 22 17:00:38.676092 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.676073    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d0e7a3-2f50-4eae-9a04-649812272acb" containerName="main"
Jul 22 17:00:38.676333 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.676198    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e37d52f6-34f0-41f9-9219-cbdb897707a0" containerName="maas-api"
Jul 22 17:00:38.676333 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.676212    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9d0e7a3-2f50-4eae-9a04-649812272acb" containerName="main"
Jul 22 17:00:38.676333 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.676223    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ba8622-0a98-4a11-acd2-877021e75452" containerName="main"
Jul 22 17:00:38.680961 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.680935    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v"
Jul 22 17:00:38.683815 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.683788    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sh5d4\""
Jul 22 17:00:38.685571 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.685545    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v"]
Jul 22 17:00:38.780522 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.780483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/145d1c80-8837-4767-b0f8-3ba704038e3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v\" (UID: \"145d1c80-8837-4767-b0f8-3ba704038e3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v"
Jul 22 17:00:38.881107 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.881075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/145d1c80-8837-4767-b0f8-3ba704038e3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v\" (UID: \"145d1c80-8837-4767-b0f8-3ba704038e3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v"
Jul 22 17:00:38.881681 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.881662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/145d1c80-8837-4767-b0f8-3ba704038e3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v\" (UID: \"145d1c80-8837-4767-b0f8-3ba704038e3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v"
Jul 22 17:00:38.992817 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:38.992737    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v"
Jul 22 17:00:39.124800 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:39.124775    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v"]
Jul 22 17:00:39.127654 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:00:39.127625    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod145d1c80_8837_4767_b0f8_3ba704038e3e.slice/crio-1bcba5473be3a123aa2042025e4bb230e4e1225abe1eea1d797966e5d3d1ec5e WatchSource:0}: Error finding container 1bcba5473be3a123aa2042025e4bb230e4e1225abe1eea1d797966e5d3d1ec5e: Status 404 returned error can't find the container with id 1bcba5473be3a123aa2042025e4bb230e4e1225abe1eea1d797966e5d3d1ec5e
Jul 22 17:00:39.129540 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:39.129524    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 17:00:39.672283 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:39.672245    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v" event={"ID":"145d1c80-8837-4767-b0f8-3ba704038e3e","Type":"ContainerStarted","Data":"1bcba5473be3a123aa2042025e4bb230e4e1225abe1eea1d797966e5d3d1ec5e"}
Jul 22 17:00:41.684561 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:41.684516    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v" event={"ID":"145d1c80-8837-4767-b0f8-3ba704038e3e","Type":"ContainerStarted","Data":"0d77c7d7dcf6f4ebfed04dc1da70cc698182c1c5c30d37bfd3a83c938c91a3c5"}
Jul 22 17:00:42.691575 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:42.691539    2580 generic.go:356] "Generic (PLEG): container finished" podID="145d1c80-8837-4767-b0f8-3ba704038e3e" containerID="0d77c7d7dcf6f4ebfed04dc1da70cc698182c1c5c30d37bfd3a83c938c91a3c5" exitCode=0
Jul 22 17:00:42.691975 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:42.691583    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v" event={"ID":"145d1c80-8837-4767-b0f8-3ba704038e3e","Type":"ContainerDied","Data":"0d77c7d7dcf6f4ebfed04dc1da70cc698182c1c5c30d37bfd3a83c938c91a3c5"}
Jul 22 17:00:43.837887 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:43.837856    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v"
Jul 22 17:00:43.931500 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:43.931467    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/145d1c80-8837-4767-b0f8-3ba704038e3e-maas-api-service-ca\") pod \"145d1c80-8837-4767-b0f8-3ba704038e3e\" (UID: \"145d1c80-8837-4767-b0f8-3ba704038e3e\") "
Jul 22 17:00:43.931861 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:43.931835    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/145d1c80-8837-4767-b0f8-3ba704038e3e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "145d1c80-8837-4767-b0f8-3ba704038e3e" (UID: "145d1c80-8837-4767-b0f8-3ba704038e3e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:00:44.032968 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:44.032882    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/145d1c80-8837-4767-b0f8-3ba704038e3e-maas-api-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:44.705406 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:44.705372    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v" event={"ID":"145d1c80-8837-4767-b0f8-3ba704038e3e","Type":"ContainerDied","Data":"1bcba5473be3a123aa2042025e4bb230e4e1225abe1eea1d797966e5d3d1ec5e"}
Jul 22 17:00:44.705406 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:44.705401    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v"
Jul 22 17:00:44.705615 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:44.705418    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bcba5473be3a123aa2042025e4bb230e4e1225abe1eea1d797966e5d3d1ec5e"
Jul 22 17:00:49.176951 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.176921    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"]
Jul 22 17:00:49.177529 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.177181    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf" podUID="32cbf217-0da5-43d8-a81a-5d12f23bec27" containerName="maas-api" containerID="cri-o://88d286843a46ce096cfa2d8407476cf8169a363221ad5a1f6628b4118c348407" gracePeriod=30
Jul 22 17:00:49.421981 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.421957    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 17:00:49.486770 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.486693    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhgmt\" (UniqueName: \"kubernetes.io/projected/32cbf217-0da5-43d8-a81a-5d12f23bec27-kube-api-access-jhgmt\") pod \"32cbf217-0da5-43d8-a81a-5d12f23bec27\" (UID: \"32cbf217-0da5-43d8-a81a-5d12f23bec27\") "
Jul 22 17:00:49.486925 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.486827    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32cbf217-0da5-43d8-a81a-5d12f23bec27-maas-api-tls\") pod \"32cbf217-0da5-43d8-a81a-5d12f23bec27\" (UID: \"32cbf217-0da5-43d8-a81a-5d12f23bec27\") "
Jul 22 17:00:49.486925 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.486865    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32cbf217-0da5-43d8-a81a-5d12f23bec27-openshift-service-ca\") pod \"32cbf217-0da5-43d8-a81a-5d12f23bec27\" (UID: \"32cbf217-0da5-43d8-a81a-5d12f23bec27\") "
Jul 22 17:00:49.487412 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.487300    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32cbf217-0da5-43d8-a81a-5d12f23bec27-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "32cbf217-0da5-43d8-a81a-5d12f23bec27" (UID: "32cbf217-0da5-43d8-a81a-5d12f23bec27"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:00:49.488888 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.488867    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32cbf217-0da5-43d8-a81a-5d12f23bec27-kube-api-access-jhgmt" (OuterVolumeSpecName: "kube-api-access-jhgmt") pod "32cbf217-0da5-43d8-a81a-5d12f23bec27" (UID: "32cbf217-0da5-43d8-a81a-5d12f23bec27"). InnerVolumeSpecName "kube-api-access-jhgmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:00:49.488999 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.488978    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32cbf217-0da5-43d8-a81a-5d12f23bec27-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "32cbf217-0da5-43d8-a81a-5d12f23bec27" (UID: "32cbf217-0da5-43d8-a81a-5d12f23bec27"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:00:49.588148 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.588104    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32cbf217-0da5-43d8-a81a-5d12f23bec27-maas-api-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:49.588148 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.588138    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32cbf217-0da5-43d8-a81a-5d12f23bec27-openshift-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:49.588148 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.588148    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhgmt\" (UniqueName: \"kubernetes.io/projected/32cbf217-0da5-43d8-a81a-5d12f23bec27-kube-api-access-jhgmt\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:00:49.732357 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.732324    2580 generic.go:356] "Generic (PLEG): container finished" podID="32cbf217-0da5-43d8-a81a-5d12f23bec27" containerID="88d286843a46ce096cfa2d8407476cf8169a363221ad5a1f6628b4118c348407" exitCode=0
Jul 22 17:00:49.732534 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.732367    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"
Jul 22 17:00:49.732534 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.732403    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf" event={"ID":"32cbf217-0da5-43d8-a81a-5d12f23bec27","Type":"ContainerDied","Data":"88d286843a46ce096cfa2d8407476cf8169a363221ad5a1f6628b4118c348407"}
Jul 22 17:00:49.732534 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.732456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf" event={"ID":"32cbf217-0da5-43d8-a81a-5d12f23bec27","Type":"ContainerDied","Data":"ee6b005e91646b681778841bbeaf52738b2d3d2e2f44ce79f4723105601e1918"}
Jul 22 17:00:49.732534 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.732485    2580 scope.go:117] "RemoveContainer" containerID="88d286843a46ce096cfa2d8407476cf8169a363221ad5a1f6628b4118c348407"
Jul 22 17:00:49.746926 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.746904    2580 scope.go:117] "RemoveContainer" containerID="88d286843a46ce096cfa2d8407476cf8169a363221ad5a1f6628b4118c348407"
Jul 22 17:00:49.747233 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:00:49.747211    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88d286843a46ce096cfa2d8407476cf8169a363221ad5a1f6628b4118c348407\": container with ID starting with 88d286843a46ce096cfa2d8407476cf8169a363221ad5a1f6628b4118c348407 not found: ID does not exist" containerID="88d286843a46ce096cfa2d8407476cf8169a363221ad5a1f6628b4118c348407"
Jul 22 17:00:49.747287 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.747248    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d286843a46ce096cfa2d8407476cf8169a363221ad5a1f6628b4118c348407"} err="failed to get container status \"88d286843a46ce096cfa2d8407476cf8169a363221ad5a1f6628b4118c348407\": rpc error: code = NotFound desc = could not find container \"88d286843a46ce096cfa2d8407476cf8169a363221ad5a1f6628b4118c348407\": container with ID starting with 88d286843a46ce096cfa2d8407476cf8169a363221ad5a1f6628b4118c348407 not found: ID does not exist"
Jul 22 17:00:49.757032 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.756998    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"]
Jul 22 17:00:49.760905 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:49.760883    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6608f1-864c5d557b-vvwtf"]
Jul 22 17:00:51.373277 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:51.373241    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32cbf217-0da5-43d8-a81a-5d12f23bec27" path="/var/lib/kubelet/pods/32cbf217-0da5-43d8-a81a-5d12f23bec27/volumes"
Jul 22 17:00:53.740781 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:53.740746    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v"]
Jul 22 17:00:53.743619 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:53.743590    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6608f1-6ph2v"]
Jul 22 17:00:55.373239 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:00:55.373208    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="145d1c80-8837-4767-b0f8-3ba704038e3e" path="/var/lib/kubelet/pods/145d1c80-8837-4767-b0f8-3ba704038e3e/volumes"
Jul 22 17:01:04.708236 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.708200    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"]
Jul 22 17:01:04.708730 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.708702    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="145d1c80-8837-4767-b0f8-3ba704038e3e" containerName="revoke-keys"
Jul 22 17:01:04.708730 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.708721    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="145d1c80-8837-4767-b0f8-3ba704038e3e" containerName="revoke-keys"
Jul 22 17:01:04.708844 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.708733    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32cbf217-0da5-43d8-a81a-5d12f23bec27" containerName="maas-api"
Jul 22 17:01:04.708844 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.708743    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="32cbf217-0da5-43d8-a81a-5d12f23bec27" containerName="maas-api"
Jul 22 17:01:04.708941 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.708869    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="32cbf217-0da5-43d8-a81a-5d12f23bec27" containerName="maas-api"
Jul 22 17:01:04.708941 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.708892    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="145d1c80-8837-4767-b0f8-3ba704038e3e" containerName="revoke-keys"
Jul 22 17:01:04.711112 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.711094    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:04.713746 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.713727    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nzvb6\""
Jul 22 17:01:04.713852 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.713742    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-e1e63b-serving-cert\""
Jul 22 17:01:04.724009 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.723960    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"]
Jul 22 17:01:04.835758 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.835725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccec017c-fc07-43d4-b057-eef54f09c6f8-maas-api-tls\") pod \"maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr\" (UID: \"ccec017c-fc07-43d4-b057-eef54f09c6f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:04.835964 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.835777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwhtm\" (UniqueName: \"kubernetes.io/projected/ccec017c-fc07-43d4-b057-eef54f09c6f8-kube-api-access-wwhtm\") pod \"maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr\" (UID: \"ccec017c-fc07-43d4-b057-eef54f09c6f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:04.835964 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.835862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccec017c-fc07-43d4-b057-eef54f09c6f8-openshift-service-ca\") pod \"maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr\" (UID: \"ccec017c-fc07-43d4-b057-eef54f09c6f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:04.936702 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.936671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccec017c-fc07-43d4-b057-eef54f09c6f8-maas-api-tls\") pod \"maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr\" (UID: \"ccec017c-fc07-43d4-b057-eef54f09c6f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:04.936917 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.936724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwhtm\" (UniqueName: \"kubernetes.io/projected/ccec017c-fc07-43d4-b057-eef54f09c6f8-kube-api-access-wwhtm\") pod \"maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr\" (UID: \"ccec017c-fc07-43d4-b057-eef54f09c6f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:04.936917 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.936754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccec017c-fc07-43d4-b057-eef54f09c6f8-openshift-service-ca\") pod \"maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr\" (UID: \"ccec017c-fc07-43d4-b057-eef54f09c6f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:04.937460 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.937439    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccec017c-fc07-43d4-b057-eef54f09c6f8-openshift-service-ca\") pod \"maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr\" (UID: \"ccec017c-fc07-43d4-b057-eef54f09c6f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:04.939150 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.939129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccec017c-fc07-43d4-b057-eef54f09c6f8-maas-api-tls\") pod \"maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr\" (UID: \"ccec017c-fc07-43d4-b057-eef54f09c6f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:04.945440 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:04.945417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwhtm\" (UniqueName: \"kubernetes.io/projected/ccec017c-fc07-43d4-b057-eef54f09c6f8-kube-api-access-wwhtm\") pod \"maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr\" (UID: \"ccec017c-fc07-43d4-b057-eef54f09c6f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:05.023179 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:05.023088    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:05.373647 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:05.373623    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"]
Jul 22 17:01:05.374779 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:01:05.374755    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccec017c_fc07_43d4_b057_eef54f09c6f8.slice/crio-fe4a751b0884d5e1f9dbdf45c45775b78fc73813916a5ceaf8c2691be724100b WatchSource:0}: Error finding container fe4a751b0884d5e1f9dbdf45c45775b78fc73813916a5ceaf8c2691be724100b: Status 404 returned error can't find the container with id fe4a751b0884d5e1f9dbdf45c45775b78fc73813916a5ceaf8c2691be724100b
Jul 22 17:01:05.814159 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:05.814123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr" event={"ID":"ccec017c-fc07-43d4-b057-eef54f09c6f8","Type":"ContainerStarted","Data":"fe4a751b0884d5e1f9dbdf45c45775b78fc73813916a5ceaf8c2691be724100b"}
Jul 22 17:01:06.821726 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:06.821678    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr" event={"ID":"ccec017c-fc07-43d4-b057-eef54f09c6f8","Type":"ContainerStarted","Data":"19c81b07a0a7530199ced40ec2d021bb32da30fcdfe03b8e7eee0e9af0a3d29a"}
Jul 22 17:01:06.822152 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:06.821788    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:06.839033 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:06.838979    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr" podStartSLOduration=1.943966263 podStartE2EDuration="2.838963754s" totalImagesPullingTime="894.997491ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:01:06.837337966 +0000 UTC m=+2296.189613986" watchObservedRunningTime="2026-07-22 17:01:06.838963754 +0000 UTC m=+2296.191239773"
Jul 22 17:01:12.832890 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:12.832857    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:12.997360 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:12.997324    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"]
Jul 22 17:01:13.000768 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.000747    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:13.003210 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.003187    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-828d6a-serving-cert\""
Jul 22 17:01:13.011881 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.011859    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"]
Jul 22 17:01:13.019898 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.019873    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/044e8959-bc60-4dab-a85f-272cc87db7e5-openshift-service-ca\") pod \"maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq\" (UID: \"044e8959-bc60-4dab-a85f-272cc87db7e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:13.020011 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.019978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/044e8959-bc60-4dab-a85f-272cc87db7e5-maas-api-tls\") pod \"maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq\" (UID: \"044e8959-bc60-4dab-a85f-272cc87db7e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:13.020087 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.020030    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vscct\" (UniqueName: \"kubernetes.io/projected/044e8959-bc60-4dab-a85f-272cc87db7e5-kube-api-access-vscct\") pod \"maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq\" (UID: \"044e8959-bc60-4dab-a85f-272cc87db7e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:13.120824 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.120738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/044e8959-bc60-4dab-a85f-272cc87db7e5-openshift-service-ca\") pod \"maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq\" (UID: \"044e8959-bc60-4dab-a85f-272cc87db7e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:13.120824 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.120816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/044e8959-bc60-4dab-a85f-272cc87db7e5-maas-api-tls\") pod \"maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq\" (UID: \"044e8959-bc60-4dab-a85f-272cc87db7e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:13.121012 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.120846    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vscct\" (UniqueName: \"kubernetes.io/projected/044e8959-bc60-4dab-a85f-272cc87db7e5-kube-api-access-vscct\") pod \"maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq\" (UID: \"044e8959-bc60-4dab-a85f-272cc87db7e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:13.121012 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:01:13.120958    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-serving-cert: secret "maas-api-e2e-api-b-828d6a-serving-cert" not found
Jul 22 17:01:13.121113 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:01:13.121057    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044e8959-bc60-4dab-a85f-272cc87db7e5-maas-api-tls podName:044e8959-bc60-4dab-a85f-272cc87db7e5 nodeName:}" failed. No retries permitted until 2026-07-22 17:01:13.621040443 +0000 UTC m=+2302.973316454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/044e8959-bc60-4dab-a85f-272cc87db7e5-maas-api-tls") pod "maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq" (UID: "044e8959-bc60-4dab-a85f-272cc87db7e5") : secret "maas-api-e2e-api-b-828d6a-serving-cert" not found
Jul 22 17:01:13.121442 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.121422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/044e8959-bc60-4dab-a85f-272cc87db7e5-openshift-service-ca\") pod \"maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq\" (UID: \"044e8959-bc60-4dab-a85f-272cc87db7e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:13.132036 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.132000    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vscct\" (UniqueName: \"kubernetes.io/projected/044e8959-bc60-4dab-a85f-272cc87db7e5-kube-api-access-vscct\") pod \"maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq\" (UID: \"044e8959-bc60-4dab-a85f-272cc87db7e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:13.626142 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.626105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/044e8959-bc60-4dab-a85f-272cc87db7e5-maas-api-tls\") pod \"maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq\" (UID: \"044e8959-bc60-4dab-a85f-272cc87db7e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:13.628497 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.628466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/044e8959-bc60-4dab-a85f-272cc87db7e5-maas-api-tls\") pod \"maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq\" (UID: \"044e8959-bc60-4dab-a85f-272cc87db7e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:13.912606 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:13.912566    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:14.064433 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:14.064403    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"]
Jul 22 17:01:14.066315 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:01:14.066281    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044e8959_bc60_4dab_a85f_272cc87db7e5.slice/crio-e81b8c06a91c40ecc1a65e7a2bc43cbe6780d62ec8a7a9546e713998fa484b60 WatchSource:0}: Error finding container e81b8c06a91c40ecc1a65e7a2bc43cbe6780d62ec8a7a9546e713998fa484b60: Status 404 returned error can't find the container with id e81b8c06a91c40ecc1a65e7a2bc43cbe6780d62ec8a7a9546e713998fa484b60
Jul 22 17:01:14.864998 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:14.864960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq" event={"ID":"044e8959-bc60-4dab-a85f-272cc87db7e5","Type":"ContainerStarted","Data":"ea15b475b4ad5ba00fa16730c1b421ca25a65a38a4b054d700ab37bc55fdeeed"}
Jul 22 17:01:14.865175 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:14.865073    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:14.865175 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:14.865096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq" event={"ID":"044e8959-bc60-4dab-a85f-272cc87db7e5","Type":"ContainerStarted","Data":"e81b8c06a91c40ecc1a65e7a2bc43cbe6780d62ec8a7a9546e713998fa484b60"}
Jul 22 17:01:14.882754 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:14.882701    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq" podStartSLOduration=2.294521052 podStartE2EDuration="2.882686206s" totalImagesPullingTime="588.165154ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:01:14.879902171 +0000 UTC m=+2304.232178193" watchObservedRunningTime="2026-07-22 17:01:14.882686206 +0000 UTC m=+2304.234962226"
Jul 22 17:01:20.877094 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:20.877064    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:01:25.405775 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:25.405743    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv"]
Jul 22 17:01:25.409164 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:25.409146    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv"
Jul 22 17:01:25.412226 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:25.412197    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sh5d4\""
Jul 22 17:01:25.420818 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:25.420794    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv"]
Jul 22 17:01:25.540099 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:25.540065    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv\" (UID: \"58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv"
Jul 22 17:01:25.641515 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:25.641472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv\" (UID: \"58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv"
Jul 22 17:01:25.642185 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:25.642162    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv\" (UID: \"58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv"
Jul 22 17:01:25.720047 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:25.719949    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv"
Jul 22 17:01:25.854641 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:25.854595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv"]
Jul 22 17:01:25.856677 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:01:25.856643    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f72109_98a3_4d6f_bd99_4c3c1ea3a6d0.slice/crio-81f910d15ca8535d01d8fdda422c97a7b5fd4238a2139c671c1c68dc8ed778c2 WatchSource:0}: Error finding container 81f910d15ca8535d01d8fdda422c97a7b5fd4238a2139c671c1c68dc8ed778c2: Status 404 returned error can't find the container with id 81f910d15ca8535d01d8fdda422c97a7b5fd4238a2139c671c1c68dc8ed778c2
Jul 22 17:01:25.936962 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:25.936934    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv" event={"ID":"58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0","Type":"ContainerStarted","Data":"81f910d15ca8535d01d8fdda422c97a7b5fd4238a2139c671c1c68dc8ed778c2"}
Jul 22 17:01:26.943702 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:26.943669    2580 generic.go:356] "Generic (PLEG): container finished" podID="58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0" containerID="ebd53263c2dd25cadca9de73f0437ea5e5898651527db7a5b1b415d6e1896ef8" exitCode=0
Jul 22 17:01:26.944105 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:26.943721    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv" event={"ID":"58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0","Type":"ContainerDied","Data":"ebd53263c2dd25cadca9de73f0437ea5e5898651527db7a5b1b415d6e1896ef8"}
Jul 22 17:01:28.078558 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:28.078529    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv"
Jul 22 17:01:28.166268 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:28.166237    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0-maas-api-service-ca\") pod \"58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0\" (UID: \"58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0\") "
Jul 22 17:01:28.166631 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:28.166607    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0" (UID: "58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:01:28.268207 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:28.268127    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0-maas-api-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:01:28.955217 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:28.955189    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv"
Jul 22 17:01:28.955217 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:28.955204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv" event={"ID":"58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0","Type":"ContainerDied","Data":"81f910d15ca8535d01d8fdda422c97a7b5fd4238a2139c671c1c68dc8ed778c2"}
Jul 22 17:01:28.955425 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:28.955247    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81f910d15ca8535d01d8fdda422c97a7b5fd4238a2139c671c1c68dc8ed778c2"
Jul 22 17:01:40.445116 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:40.445081    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"]
Jul 22 17:01:40.445515 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:40.445377    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr" podUID="ccec017c-fc07-43d4-b057-eef54f09c6f8" containerName="maas-api" containerID="cri-o://19c81b07a0a7530199ced40ec2d021bb32da30fcdfe03b8e7eee0e9af0a3d29a" gracePeriod=30
Jul 22 17:01:40.690734 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:40.690711    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:40.789142 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:40.789052    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccec017c-fc07-43d4-b057-eef54f09c6f8-openshift-service-ca\") pod \"ccec017c-fc07-43d4-b057-eef54f09c6f8\" (UID: \"ccec017c-fc07-43d4-b057-eef54f09c6f8\") "
Jul 22 17:01:40.789142 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:40.789134    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccec017c-fc07-43d4-b057-eef54f09c6f8-maas-api-tls\") pod \"ccec017c-fc07-43d4-b057-eef54f09c6f8\" (UID: \"ccec017c-fc07-43d4-b057-eef54f09c6f8\") "
Jul 22 17:01:40.789376 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:40.789161    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwhtm\" (UniqueName: \"kubernetes.io/projected/ccec017c-fc07-43d4-b057-eef54f09c6f8-kube-api-access-wwhtm\") pod \"ccec017c-fc07-43d4-b057-eef54f09c6f8\" (UID: \"ccec017c-fc07-43d4-b057-eef54f09c6f8\") "
Jul 22 17:01:40.789430 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:40.789397    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccec017c-fc07-43d4-b057-eef54f09c6f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ccec017c-fc07-43d4-b057-eef54f09c6f8" (UID: "ccec017c-fc07-43d4-b057-eef54f09c6f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:01:40.789643 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:40.789617    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccec017c-fc07-43d4-b057-eef54f09c6f8-openshift-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:01:40.791236 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:40.791216    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccec017c-fc07-43d4-b057-eef54f09c6f8-kube-api-access-wwhtm" (OuterVolumeSpecName: "kube-api-access-wwhtm") pod "ccec017c-fc07-43d4-b057-eef54f09c6f8" (UID: "ccec017c-fc07-43d4-b057-eef54f09c6f8"). InnerVolumeSpecName "kube-api-access-wwhtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:01:40.791314 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:40.791290    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccec017c-fc07-43d4-b057-eef54f09c6f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ccec017c-fc07-43d4-b057-eef54f09c6f8" (UID: "ccec017c-fc07-43d4-b057-eef54f09c6f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:01:40.891178 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:40.891147    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccec017c-fc07-43d4-b057-eef54f09c6f8-maas-api-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:01:40.891178 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:40.891172    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwhtm\" (UniqueName: \"kubernetes.io/projected/ccec017c-fc07-43d4-b057-eef54f09c6f8-kube-api-access-wwhtm\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:01:41.022696 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:41.022660    2580 generic.go:356] "Generic (PLEG): container finished" podID="ccec017c-fc07-43d4-b057-eef54f09c6f8" containerID="19c81b07a0a7530199ced40ec2d021bb32da30fcdfe03b8e7eee0e9af0a3d29a" exitCode=0
Jul 22 17:01:41.022884 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:41.022705    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"
Jul 22 17:01:41.022884 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:41.022758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr" event={"ID":"ccec017c-fc07-43d4-b057-eef54f09c6f8","Type":"ContainerDied","Data":"19c81b07a0a7530199ced40ec2d021bb32da30fcdfe03b8e7eee0e9af0a3d29a"}
Jul 22 17:01:41.022884 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:41.022810    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr" event={"ID":"ccec017c-fc07-43d4-b057-eef54f09c6f8","Type":"ContainerDied","Data":"fe4a751b0884d5e1f9dbdf45c45775b78fc73813916a5ceaf8c2691be724100b"}
Jul 22 17:01:41.022884 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:41.022832    2580 scope.go:117] "RemoveContainer" containerID="19c81b07a0a7530199ced40ec2d021bb32da30fcdfe03b8e7eee0e9af0a3d29a"
Jul 22 17:01:41.032588 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:41.032571    2580 scope.go:117] "RemoveContainer" containerID="19c81b07a0a7530199ced40ec2d021bb32da30fcdfe03b8e7eee0e9af0a3d29a"
Jul 22 17:01:41.032848 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:01:41.032829    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19c81b07a0a7530199ced40ec2d021bb32da30fcdfe03b8e7eee0e9af0a3d29a\": container with ID starting with 19c81b07a0a7530199ced40ec2d021bb32da30fcdfe03b8e7eee0e9af0a3d29a not found: ID does not exist" containerID="19c81b07a0a7530199ced40ec2d021bb32da30fcdfe03b8e7eee0e9af0a3d29a"
Jul 22 17:01:41.032896 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:41.032857    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c81b07a0a7530199ced40ec2d021bb32da30fcdfe03b8e7eee0e9af0a3d29a"} err="failed to get container status \"19c81b07a0a7530199ced40ec2d021bb32da30fcdfe03b8e7eee0e9af0a3d29a\": rpc error: code = NotFound desc = could not find container \"19c81b07a0a7530199ced40ec2d021bb32da30fcdfe03b8e7eee0e9af0a3d29a\": container with ID starting with 19c81b07a0a7530199ced40ec2d021bb32da30fcdfe03b8e7eee0e9af0a3d29a not found: ID does not exist"
Jul 22 17:01:41.045029 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:41.044961    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"]
Jul 22 17:01:41.050179 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:41.050160    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e1e63b-5c588d7f59-jfwhr"]
Jul 22 17:01:41.372807 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:41.372733    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccec017c-fc07-43d4-b057-eef54f09c6f8" path="/var/lib/kubelet/pods/ccec017c-fc07-43d4-b057-eef54f09c6f8/volumes"
Jul 22 17:01:45.466577 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:45.466483    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv"]
Jul 22 17:01:45.468997 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:45.468968    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e1e63b-qhpqv"]
Jul 22 17:01:47.372774 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:47.372735    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0" path="/var/lib/kubelet/pods/58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0/volumes"
Jul 22 17:01:52.125841 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.125792    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm"]
Jul 22 17:01:52.126343 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.126312    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccec017c-fc07-43d4-b057-eef54f09c6f8" containerName="maas-api"
Jul 22 17:01:52.126343 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.126327    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccec017c-fc07-43d4-b057-eef54f09c6f8" containerName="maas-api"
Jul 22 17:01:52.126343 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.126340    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0" containerName="revoke-keys"
Jul 22 17:01:52.126453 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.126347    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0" containerName="revoke-keys"
Jul 22 17:01:52.126453 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.126414    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccec017c-fc07-43d4-b057-eef54f09c6f8" containerName="maas-api"
Jul 22 17:01:52.126453 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.126423    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="58f72109-98a3-4d6f-bd99-4c3c1ea3a6d0" containerName="revoke-keys"
Jul 22 17:01:52.129685 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.129668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm"
Jul 22 17:01:52.132134 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.132114    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sh5d4\""
Jul 22 17:01:52.136692 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.136652    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm"]
Jul 22 17:01:52.205539 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.205508    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f17637d-bad1-4349-afa6-f5b421f8f1fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-828d6a-64vmm\" (UID: \"7f17637d-bad1-4349-afa6-f5b421f8f1fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm"
Jul 22 17:01:52.305979 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.305944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f17637d-bad1-4349-afa6-f5b421f8f1fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-828d6a-64vmm\" (UID: \"7f17637d-bad1-4349-afa6-f5b421f8f1fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm"
Jul 22 17:01:52.306622 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.306600    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f17637d-bad1-4349-afa6-f5b421f8f1fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-828d6a-64vmm\" (UID: \"7f17637d-bad1-4349-afa6-f5b421f8f1fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm"
Jul 22 17:01:52.440766 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.440739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm"
Jul 22 17:01:52.576911 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:52.576882    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm"]
Jul 22 17:01:52.578380 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:01:52.578351    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f17637d_bad1_4349_afa6_f5b421f8f1fc.slice/crio-3ab62d2f292fe9bbc31e93a964240189873144b891d8d25d41a0f0286ff747ce WatchSource:0}: Error finding container 3ab62d2f292fe9bbc31e93a964240189873144b891d8d25d41a0f0286ff747ce: Status 404 returned error can't find the container with id 3ab62d2f292fe9bbc31e93a964240189873144b891d8d25d41a0f0286ff747ce
Jul 22 17:01:53.087491 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:53.087397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm" event={"ID":"7f17637d-bad1-4349-afa6-f5b421f8f1fc","Type":"ContainerStarted","Data":"812d0c0654550095c4ec6a18630f1f554a12b4561ee23aeef1913ccd4884ba4c"}
Jul 22 17:01:53.087491 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:53.087463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm" event={"ID":"7f17637d-bad1-4349-afa6-f5b421f8f1fc","Type":"ContainerStarted","Data":"3ab62d2f292fe9bbc31e93a964240189873144b891d8d25d41a0f0286ff747ce"}
Jul 22 17:01:53.104611 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:53.104562    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm" podStartSLOduration=1.104548467 podStartE2EDuration="1.104548467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:01:53.102173086 +0000 UTC m=+2342.454449107" watchObservedRunningTime="2026-07-22 17:01:53.104548467 +0000 UTC m=+2342.456824486"
Jul 22 17:01:54.094606 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:54.094569    2580 generic.go:356] "Generic (PLEG): container finished" podID="7f17637d-bad1-4349-afa6-f5b421f8f1fc" containerID="812d0c0654550095c4ec6a18630f1f554a12b4561ee23aeef1913ccd4884ba4c" exitCode=0
Jul 22 17:01:54.095002 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:54.094696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm" event={"ID":"7f17637d-bad1-4349-afa6-f5b421f8f1fc","Type":"ContainerDied","Data":"812d0c0654550095c4ec6a18630f1f554a12b4561ee23aeef1913ccd4884ba4c"}
Jul 22 17:01:55.230214 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:55.230190    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm"
Jul 22 17:01:55.339182 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:55.339154    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f17637d-bad1-4349-afa6-f5b421f8f1fc-maas-api-service-ca\") pod \"7f17637d-bad1-4349-afa6-f5b421f8f1fc\" (UID: \"7f17637d-bad1-4349-afa6-f5b421f8f1fc\") "
Jul 22 17:01:55.339482 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:55.339458    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f17637d-bad1-4349-afa6-f5b421f8f1fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7f17637d-bad1-4349-afa6-f5b421f8f1fc" (UID: "7f17637d-bad1-4349-afa6-f5b421f8f1fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:01:55.440159 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:55.440132    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f17637d-bad1-4349-afa6-f5b421f8f1fc-maas-api-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:01:56.105951 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:56.105913    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm" event={"ID":"7f17637d-bad1-4349-afa6-f5b421f8f1fc","Type":"ContainerDied","Data":"3ab62d2f292fe9bbc31e93a964240189873144b891d8d25d41a0f0286ff747ce"}
Jul 22 17:01:56.105951 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:56.105938    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm"
Jul 22 17:01:56.106184 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:01:56.105964    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ab62d2f292fe9bbc31e93a964240189873144b891d8d25d41a0f0286ff747ce"
Jul 22 17:02:08.378059 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:08.378006    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"]
Jul 22 17:02:08.378545 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:08.378259    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq" podUID="044e8959-bc60-4dab-a85f-272cc87db7e5" containerName="maas-api" containerID="cri-o://ea15b475b4ad5ba00fa16730c1b421ca25a65a38a4b054d700ab37bc55fdeeed" gracePeriod=30
Jul 22 17:02:08.621062 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:08.621031    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:02:08.776181 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:08.776134    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/044e8959-bc60-4dab-a85f-272cc87db7e5-openshift-service-ca\") pod \"044e8959-bc60-4dab-a85f-272cc87db7e5\" (UID: \"044e8959-bc60-4dab-a85f-272cc87db7e5\") "
Jul 22 17:02:08.776398 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:08.776196    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vscct\" (UniqueName: \"kubernetes.io/projected/044e8959-bc60-4dab-a85f-272cc87db7e5-kube-api-access-vscct\") pod \"044e8959-bc60-4dab-a85f-272cc87db7e5\" (UID: \"044e8959-bc60-4dab-a85f-272cc87db7e5\") "
Jul 22 17:02:08.776398 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:08.776262    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/044e8959-bc60-4dab-a85f-272cc87db7e5-maas-api-tls\") pod \"044e8959-bc60-4dab-a85f-272cc87db7e5\" (UID: \"044e8959-bc60-4dab-a85f-272cc87db7e5\") "
Jul 22 17:02:08.776547 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:08.776527    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/044e8959-bc60-4dab-a85f-272cc87db7e5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "044e8959-bc60-4dab-a85f-272cc87db7e5" (UID: "044e8959-bc60-4dab-a85f-272cc87db7e5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:02:08.778309 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:08.778284    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/044e8959-bc60-4dab-a85f-272cc87db7e5-kube-api-access-vscct" (OuterVolumeSpecName: "kube-api-access-vscct") pod "044e8959-bc60-4dab-a85f-272cc87db7e5" (UID: "044e8959-bc60-4dab-a85f-272cc87db7e5"). InnerVolumeSpecName "kube-api-access-vscct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:02:08.778388 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:08.778372    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/044e8959-bc60-4dab-a85f-272cc87db7e5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "044e8959-bc60-4dab-a85f-272cc87db7e5" (UID: "044e8959-bc60-4dab-a85f-272cc87db7e5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:02:08.877346 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:08.877317    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/044e8959-bc60-4dab-a85f-272cc87db7e5-openshift-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:02:08.877346 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:08.877342    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vscct\" (UniqueName: \"kubernetes.io/projected/044e8959-bc60-4dab-a85f-272cc87db7e5-kube-api-access-vscct\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:02:08.877346 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:08.877352    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/044e8959-bc60-4dab-a85f-272cc87db7e5-maas-api-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:02:09.173090 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:09.173058    2580 generic.go:356] "Generic (PLEG): container finished" podID="044e8959-bc60-4dab-a85f-272cc87db7e5" containerID="ea15b475b4ad5ba00fa16730c1b421ca25a65a38a4b054d700ab37bc55fdeeed" exitCode=0
Jul 22 17:02:09.173283 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:09.173104    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"
Jul 22 17:02:09.173283 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:09.173139    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq" event={"ID":"044e8959-bc60-4dab-a85f-272cc87db7e5","Type":"ContainerDied","Data":"ea15b475b4ad5ba00fa16730c1b421ca25a65a38a4b054d700ab37bc55fdeeed"}
Jul 22 17:02:09.173283 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:09.173200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq" event={"ID":"044e8959-bc60-4dab-a85f-272cc87db7e5","Type":"ContainerDied","Data":"e81b8c06a91c40ecc1a65e7a2bc43cbe6780d62ec8a7a9546e713998fa484b60"}
Jul 22 17:02:09.173283 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:09.173230    2580 scope.go:117] "RemoveContainer" containerID="ea15b475b4ad5ba00fa16730c1b421ca25a65a38a4b054d700ab37bc55fdeeed"
Jul 22 17:02:09.183046 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:09.182997    2580 scope.go:117] "RemoveContainer" containerID="ea15b475b4ad5ba00fa16730c1b421ca25a65a38a4b054d700ab37bc55fdeeed"
Jul 22 17:02:09.183356 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:02:09.183338    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea15b475b4ad5ba00fa16730c1b421ca25a65a38a4b054d700ab37bc55fdeeed\": container with ID starting with ea15b475b4ad5ba00fa16730c1b421ca25a65a38a4b054d700ab37bc55fdeeed not found: ID does not exist" containerID="ea15b475b4ad5ba00fa16730c1b421ca25a65a38a4b054d700ab37bc55fdeeed"
Jul 22 17:02:09.183433 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:09.183362    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea15b475b4ad5ba00fa16730c1b421ca25a65a38a4b054d700ab37bc55fdeeed"} err="failed to get container status \"ea15b475b4ad5ba00fa16730c1b421ca25a65a38a4b054d700ab37bc55fdeeed\": rpc error: code = NotFound desc = could not find container \"ea15b475b4ad5ba00fa16730c1b421ca25a65a38a4b054d700ab37bc55fdeeed\": container with ID starting with ea15b475b4ad5ba00fa16730c1b421ca25a65a38a4b054d700ab37bc55fdeeed not found: ID does not exist"
Jul 22 17:02:09.194558 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:09.194534    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"]
Jul 22 17:02:09.200097 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:09.200078    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-828d6a-64c66c757f-zq7hq"]
Jul 22 17:02:09.373227 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:09.373194    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="044e8959-bc60-4dab-a85f-272cc87db7e5" path="/var/lib/kubelet/pods/044e8959-bc60-4dab-a85f-272cc87db7e5/volumes"
Jul 22 17:02:12.208591 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:12.208548    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm"]
Jul 22 17:02:12.210291 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:12.210268    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-828d6a-64vmm"]
Jul 22 17:02:13.373349 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:13.373314    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f17637d-bad1-4349-afa6-f5b421f8f1fc" path="/var/lib/kubelet/pods/7f17637d-bad1-4349-afa6-f5b421f8f1fc/volumes"
Jul 22 17:02:23.066328 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.066284    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"]
Jul 22 17:02:23.067033 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.066995    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="044e8959-bc60-4dab-a85f-272cc87db7e5" containerName="maas-api"
Jul 22 17:02:23.067113 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.067037    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="044e8959-bc60-4dab-a85f-272cc87db7e5" containerName="maas-api"
Jul 22 17:02:23.067113 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.067052    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f17637d-bad1-4349-afa6-f5b421f8f1fc" containerName="revoke-keys"
Jul 22 17:02:23.067113 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.067062    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f17637d-bad1-4349-afa6-f5b421f8f1fc" containerName="revoke-keys"
Jul 22 17:02:23.067279 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.067164    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="044e8959-bc60-4dab-a85f-272cc87db7e5" containerName="maas-api"
Jul 22 17:02:23.067279 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.067182    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f17637d-bad1-4349-afa6-f5b421f8f1fc" containerName="revoke-keys"
Jul 22 17:02:23.070046 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.070012    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:23.072857 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.072835    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-265741-serving-cert\""
Jul 22 17:02:23.073035 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.072843    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nzvb6\""
Jul 22 17:02:23.079445 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.079420    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"]
Jul 22 17:02:23.119389 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.119357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a18a36-1a54-4469-a174-ef336122ccf2-maas-api-tls\") pod \"maas-api-e2e-shared-a-265741-dd9786675-47kx4\" (UID: \"e5a18a36-1a54-4469-a174-ef336122ccf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:23.119539 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.119427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5a18a36-1a54-4469-a174-ef336122ccf2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-265741-dd9786675-47kx4\" (UID: \"e5a18a36-1a54-4469-a174-ef336122ccf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:23.119539 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.119453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvd46\" (UniqueName: \"kubernetes.io/projected/e5a18a36-1a54-4469-a174-ef336122ccf2-kube-api-access-hvd46\") pod \"maas-api-e2e-shared-a-265741-dd9786675-47kx4\" (UID: \"e5a18a36-1a54-4469-a174-ef336122ccf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:23.220190 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.220150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a18a36-1a54-4469-a174-ef336122ccf2-maas-api-tls\") pod \"maas-api-e2e-shared-a-265741-dd9786675-47kx4\" (UID: \"e5a18a36-1a54-4469-a174-ef336122ccf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:23.220377 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.220222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5a18a36-1a54-4469-a174-ef336122ccf2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-265741-dd9786675-47kx4\" (UID: \"e5a18a36-1a54-4469-a174-ef336122ccf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:23.220377 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.220249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvd46\" (UniqueName: \"kubernetes.io/projected/e5a18a36-1a54-4469-a174-ef336122ccf2-kube-api-access-hvd46\") pod \"maas-api-e2e-shared-a-265741-dd9786675-47kx4\" (UID: \"e5a18a36-1a54-4469-a174-ef336122ccf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:23.220377 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:02:23.220303    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-serving-cert: secret "maas-api-e2e-shared-a-265741-serving-cert" not found
Jul 22 17:02:23.220510 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:02:23.220393    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a18a36-1a54-4469-a174-ef336122ccf2-maas-api-tls podName:e5a18a36-1a54-4469-a174-ef336122ccf2 nodeName:}" failed. No retries permitted until 2026-07-22 17:02:23.720374976 +0000 UTC m=+2373.072650977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e5a18a36-1a54-4469-a174-ef336122ccf2-maas-api-tls") pod "maas-api-e2e-shared-a-265741-dd9786675-47kx4" (UID: "e5a18a36-1a54-4469-a174-ef336122ccf2") : secret "maas-api-e2e-shared-a-265741-serving-cert" not found
Jul 22 17:02:23.220869 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.220851    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5a18a36-1a54-4469-a174-ef336122ccf2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-265741-dd9786675-47kx4\" (UID: \"e5a18a36-1a54-4469-a174-ef336122ccf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:23.228559 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.228528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvd46\" (UniqueName: \"kubernetes.io/projected/e5a18a36-1a54-4469-a174-ef336122ccf2-kube-api-access-hvd46\") pod \"maas-api-e2e-shared-a-265741-dd9786675-47kx4\" (UID: \"e5a18a36-1a54-4469-a174-ef336122ccf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:23.725982 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.725943    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a18a36-1a54-4469-a174-ef336122ccf2-maas-api-tls\") pod \"maas-api-e2e-shared-a-265741-dd9786675-47kx4\" (UID: \"e5a18a36-1a54-4469-a174-ef336122ccf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:23.728446 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.728414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a18a36-1a54-4469-a174-ef336122ccf2-maas-api-tls\") pod \"maas-api-e2e-shared-a-265741-dd9786675-47kx4\" (UID: \"e5a18a36-1a54-4469-a174-ef336122ccf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:23.982246 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:23.982142    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:24.118201 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:24.118173    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"]
Jul 22 17:02:24.120289 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:02:24.120251    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a18a36_1a54_4469_a174_ef336122ccf2.slice/crio-d1e2b161f0cdc37e0a8a1b7c8be54dc843ff945252af01a80205a3dc026f1ba6 WatchSource:0}: Error finding container d1e2b161f0cdc37e0a8a1b7c8be54dc843ff945252af01a80205a3dc026f1ba6: Status 404 returned error can't find the container with id d1e2b161f0cdc37e0a8a1b7c8be54dc843ff945252af01a80205a3dc026f1ba6
Jul 22 17:02:24.252480 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:24.252386    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4" event={"ID":"e5a18a36-1a54-4469-a174-ef336122ccf2","Type":"ContainerStarted","Data":"d1e2b161f0cdc37e0a8a1b7c8be54dc843ff945252af01a80205a3dc026f1ba6"}
Jul 22 17:02:25.259527 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:25.259489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4" event={"ID":"e5a18a36-1a54-4469-a174-ef336122ccf2","Type":"ContainerStarted","Data":"fe7c9fd5c53bd67effd51b970cbce37af86d2357d381114014b8c6716e356ea7"}
Jul 22 17:02:25.259919 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:25.259550    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:25.275915 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:25.275863    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4" podStartSLOduration=1.9657045480000002 podStartE2EDuration="2.27584717s" totalImagesPullingTime="310.142622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:02:25.274252101 +0000 UTC m=+2374.626528123" watchObservedRunningTime="2026-07-22 17:02:25.27584717 +0000 UTC m=+2374.628123189"
Jul 22 17:02:31.187205 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.187171    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"]
Jul 22 17:02:31.190243 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.190220    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:31.192929 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.192905    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-13a8c9-serving-cert\""
Jul 22 17:02:31.204138 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.204112    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"]
Jul 22 17:02:31.269363 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.269337    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:02:31.299620 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.299582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2013a23c-77c4-49cf-a989-287d84825ac9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222\" (UID: \"2013a23c-77c4-49cf-a989-287d84825ac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:31.299786 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.299669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2013a23c-77c4-49cf-a989-287d84825ac9-maas-api-tls\") pod \"maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222\" (UID: \"2013a23c-77c4-49cf-a989-287d84825ac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:31.299786 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.299744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6shcm\" (UniqueName: \"kubernetes.io/projected/2013a23c-77c4-49cf-a989-287d84825ac9-kube-api-access-6shcm\") pod \"maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222\" (UID: \"2013a23c-77c4-49cf-a989-287d84825ac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:31.400428 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.400395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6shcm\" (UniqueName: \"kubernetes.io/projected/2013a23c-77c4-49cf-a989-287d84825ac9-kube-api-access-6shcm\") pod \"maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222\" (UID: \"2013a23c-77c4-49cf-a989-287d84825ac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:31.400602 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.400502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2013a23c-77c4-49cf-a989-287d84825ac9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222\" (UID: \"2013a23c-77c4-49cf-a989-287d84825ac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:31.400698 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.400660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2013a23c-77c4-49cf-a989-287d84825ac9-maas-api-tls\") pod \"maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222\" (UID: \"2013a23c-77c4-49cf-a989-287d84825ac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:31.400851 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:02:31.400826    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-serving-cert: secret "maas-api-e2e-shared-b-13a8c9-serving-cert" not found
Jul 22 17:02:31.400988 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:02:31.400904    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2013a23c-77c4-49cf-a989-287d84825ac9-maas-api-tls podName:2013a23c-77c4-49cf-a989-287d84825ac9 nodeName:}" failed. No retries permitted until 2026-07-22 17:02:31.900882165 +0000 UTC m=+2381.253158166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2013a23c-77c4-49cf-a989-287d84825ac9-maas-api-tls") pod "maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222" (UID: "2013a23c-77c4-49cf-a989-287d84825ac9") : secret "maas-api-e2e-shared-b-13a8c9-serving-cert" not found
Jul 22 17:02:31.401170 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.401154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2013a23c-77c4-49cf-a989-287d84825ac9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222\" (UID: \"2013a23c-77c4-49cf-a989-287d84825ac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:31.410960 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.410938    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6shcm\" (UniqueName: \"kubernetes.io/projected/2013a23c-77c4-49cf-a989-287d84825ac9-kube-api-access-6shcm\") pod \"maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222\" (UID: \"2013a23c-77c4-49cf-a989-287d84825ac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:31.905697 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.905661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2013a23c-77c4-49cf-a989-287d84825ac9-maas-api-tls\") pod \"maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222\" (UID: \"2013a23c-77c4-49cf-a989-287d84825ac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:31.908128 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:31.908105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2013a23c-77c4-49cf-a989-287d84825ac9-maas-api-tls\") pod \"maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222\" (UID: \"2013a23c-77c4-49cf-a989-287d84825ac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:32.101579 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:32.101549    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:32.251075 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:32.250978    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"]
Jul 22 17:02:32.254011 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:02:32.253979    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2013a23c_77c4_49cf_a989_287d84825ac9.slice/crio-ca98d66fd0ce098cb78498363eaced6ba61492f5b1ba8c26dcdbed54cfe436ab WatchSource:0}: Error finding container ca98d66fd0ce098cb78498363eaced6ba61492f5b1ba8c26dcdbed54cfe436ab: Status 404 returned error can't find the container with id ca98d66fd0ce098cb78498363eaced6ba61492f5b1ba8c26dcdbed54cfe436ab
Jul 22 17:02:32.295653 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:32.295620    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222" event={"ID":"2013a23c-77c4-49cf-a989-287d84825ac9","Type":"ContainerStarted","Data":"ca98d66fd0ce098cb78498363eaced6ba61492f5b1ba8c26dcdbed54cfe436ab"}
Jul 22 17:02:33.303866 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:33.303823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222" event={"ID":"2013a23c-77c4-49cf-a989-287d84825ac9","Type":"ContainerStarted","Data":"ab60f50dedd3a6ce2bda7a398d43ecd884141c2970291bbe3129f145c3a21a68"}
Jul 22 17:02:33.304288 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:33.303890    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:33.320975 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:33.320928    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222" podStartSLOduration=1.931067149 podStartE2EDuration="2.320912312s" totalImagesPullingTime="389.845163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:02:33.319758265 +0000 UTC m=+2382.672034290" watchObservedRunningTime="2026-07-22 17:02:33.320912312 +0000 UTC m=+2382.673188331"
Jul 22 17:02:39.315164 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:39.315135    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:02:48.293367 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.293332    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"]
Jul 22 17:02:48.296311 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.296295    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.300081 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.300002    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-265741\"/\"openshift-service-ca.crt\""
Jul 22 17:02:48.300229 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.300082    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-265741\"/\"kube-root-ca.crt\""
Jul 22 17:02:48.300229 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.300096    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-265741\"/\"default-dockercfg-psxpw\""
Jul 22 17:02:48.300229 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.300086    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-265741\"/\"auth-test-model-265741-kserve-self-signed-certs\""
Jul 22 17:02:48.306380 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.306360    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"]
Jul 22 17:02:48.474006 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.473973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-tls-certs\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.474189 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.474047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-model-cache\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.474189 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.474084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-tmp-dir\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.474189 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.474109    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-home\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.474189 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.474161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-dshm\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.474351 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.474192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4l6r\" (UniqueName: \"kubernetes.io/projected/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-kube-api-access-m4l6r\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.575765 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.575668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-model-cache\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.575765 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.575728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-tmp-dir\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.576004 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.575763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-home\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.576004 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.575815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-dshm\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.576004 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.575866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4l6r\" (UniqueName: \"kubernetes.io/projected/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-kube-api-access-m4l6r\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.576004 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.575912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-tls-certs\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.576230 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.576134    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-model-cache\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.576230 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.576193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-tmp-dir\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.576230 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.576199    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-home\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.578200 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.578177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-dshm\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.578411 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.578392    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-tls-certs\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.584987 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.584968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4l6r\" (UniqueName: \"kubernetes.io/projected/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-kube-api-access-m4l6r\") pod \"auth-test-model-265741-kserve-648bd8d655-6b7tb\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") " pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.606888 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.606852    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:48.743829 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:48.743801    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"]
Jul 22 17:02:48.745838 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:02:48.745813    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d2a0785_3dcc_4c0d_b9ad_23d564e5941f.slice/crio-41db31a8eb0594309f090fefa7c9b781dd17e82a8eaf7dd9f8701c359088ca01 WatchSource:0}: Error finding container 41db31a8eb0594309f090fefa7c9b781dd17e82a8eaf7dd9f8701c359088ca01: Status 404 returned error can't find the container with id 41db31a8eb0594309f090fefa7c9b781dd17e82a8eaf7dd9f8701c359088ca01
Jul 22 17:02:49.392475 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:49.392430    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb" event={"ID":"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f","Type":"ContainerStarted","Data":"513cb50867b2487e045cadf4bf2f722916ba924b98529bc679cb1e9fc32e8f38"}
Jul 22 17:02:49.392863 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:49.392493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb" event={"ID":"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f","Type":"ContainerStarted","Data":"41db31a8eb0594309f090fefa7c9b781dd17e82a8eaf7dd9f8701c359088ca01"}
Jul 22 17:02:49.409842 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:49.409792    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb" podStartSLOduration=1.409777022 podStartE2EDuration="1.409777022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:02:49.408464025 +0000 UTC m=+2398.760740047" watchObservedRunningTime="2026-07-22 17:02:49.409777022 +0000 UTC m=+2398.762053041"
Jul 22 17:02:58.607242 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:58.607205    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:58.607737 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:58.607258    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:58.619828 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:58.619799    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:02:59.457800 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:02:59.457768    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:05:18.786425 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:18.786381    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"]
Jul 22 17:05:33.604301 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.604268    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"]
Jul 22 17:05:33.607889 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.607868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.610334 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.610309    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-265741\"/\"sub-test-model-265741-kserve-self-signed-certs\""
Jul 22 17:05:33.617418 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.617389    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"]
Jul 22 17:05:33.697266 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.697229    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-home\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.697462 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.697349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-tmp-dir\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.697462 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.697383    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-tls-certs\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.697462 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.697411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hgtg\" (UniqueName: \"kubernetes.io/projected/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-kube-api-access-2hgtg\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.697462 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.697437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-dshm\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.697661 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.697496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-model-cache\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.798831 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.798790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-home\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.799071 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.798880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-tmp-dir\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.799071 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.798903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-tls-certs\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.799071 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.798923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hgtg\" (UniqueName: \"kubernetes.io/projected/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-kube-api-access-2hgtg\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.799071 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.798941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-dshm\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.799071 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.798974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-model-cache\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.799383 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.799277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-home\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.799383 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.799363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-model-cache\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.799455 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.799394    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-tmp-dir\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.801231 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.801210    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-dshm\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.801496 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.801477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-tls-certs\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.807095 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.807066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hgtg\" (UniqueName: \"kubernetes.io/projected/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-kube-api-access-2hgtg\") pod \"sub-test-model-265741-kserve-86977878c7-cdfrr\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") " pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:33.807489 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.807443    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb" podUID="9d2a0785-3dcc-4c0d-b9ad-23d564e5941f" containerName="main" containerID="cri-o://513cb50867b2487e045cadf4bf2f722916ba924b98529bc679cb1e9fc32e8f38" gracePeriod=45
Jul 22 17:05:33.919581 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:33.919543    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:34.062521 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.062486    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:05:34.063115 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.063094    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"]
Jul 22 17:05:34.064870 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:05:34.064848    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99c0aa23_2e30_4707_ba1b_7b3c4b4c25d9.slice/crio-4a962fe271f1ee1dac7214b44850b3dae162595ad11f6be5b96fa8aeb9501217 WatchSource:0}: Error finding container 4a962fe271f1ee1dac7214b44850b3dae162595ad11f6be5b96fa8aeb9501217: Status 404 returned error can't find the container with id 4a962fe271f1ee1dac7214b44850b3dae162595ad11f6be5b96fa8aeb9501217
Jul 22 17:05:34.202799 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.202722    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-tmp-dir\") pod \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") "
Jul 22 17:05:34.202799 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.202763    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-model-cache\") pod \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") "
Jul 22 17:05:34.202799 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.202788    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-home\") pod \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") "
Jul 22 17:05:34.203092 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.202833    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4l6r\" (UniqueName: \"kubernetes.io/projected/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-kube-api-access-m4l6r\") pod \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") "
Jul 22 17:05:34.203092 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.202888    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-tls-certs\") pod \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") "
Jul 22 17:05:34.203092 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.203012    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-dshm\") pod \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\" (UID: \"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f\") "
Jul 22 17:05:34.203092 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.203049    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-model-cache" (OuterVolumeSpecName: "model-cache") pod "9d2a0785-3dcc-4c0d-b9ad-23d564e5941f" (UID: "9d2a0785-3dcc-4c0d-b9ad-23d564e5941f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:05:34.203092 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.203064    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-home" (OuterVolumeSpecName: "home") pod "9d2a0785-3dcc-4c0d-b9ad-23d564e5941f" (UID: "9d2a0785-3dcc-4c0d-b9ad-23d564e5941f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:05:34.203092 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.203047    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9d2a0785-3dcc-4c0d-b9ad-23d564e5941f" (UID: "9d2a0785-3dcc-4c0d-b9ad-23d564e5941f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:05:34.203522 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.203487    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-tmp-dir\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:05:34.203522 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.203517    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-model-cache\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:05:34.203621 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.203532    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-home\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:05:34.205113 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.205086    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9d2a0785-3dcc-4c0d-b9ad-23d564e5941f" (UID: "9d2a0785-3dcc-4c0d-b9ad-23d564e5941f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:05:34.205222 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.205110    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-dshm" (OuterVolumeSpecName: "dshm") pod "9d2a0785-3dcc-4c0d-b9ad-23d564e5941f" (UID: "9d2a0785-3dcc-4c0d-b9ad-23d564e5941f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:05:34.205222 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.205127    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-kube-api-access-m4l6r" (OuterVolumeSpecName: "kube-api-access-m4l6r") pod "9d2a0785-3dcc-4c0d-b9ad-23d564e5941f" (UID: "9d2a0785-3dcc-4c0d-b9ad-23d564e5941f"). InnerVolumeSpecName "kube-api-access-m4l6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:05:34.264844 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.264808    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr" event={"ID":"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9","Type":"ContainerStarted","Data":"a8e610a074344aed60f11371ad1aa5a779a78dda4e7e5eb1699d211d8db1a00b"}
Jul 22 17:05:34.265037 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.264854    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr" event={"ID":"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9","Type":"ContainerStarted","Data":"4a962fe271f1ee1dac7214b44850b3dae162595ad11f6be5b96fa8aeb9501217"}
Jul 22 17:05:34.266098 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.266073    2580 generic.go:356] "Generic (PLEG): container finished" podID="9d2a0785-3dcc-4c0d-b9ad-23d564e5941f" containerID="513cb50867b2487e045cadf4bf2f722916ba924b98529bc679cb1e9fc32e8f38" exitCode=0
Jul 22 17:05:34.266204 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.266103    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"
Jul 22 17:05:34.266204 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.266127    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb" event={"ID":"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f","Type":"ContainerDied","Data":"513cb50867b2487e045cadf4bf2f722916ba924b98529bc679cb1e9fc32e8f38"}
Jul 22 17:05:34.266204 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.266162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb" event={"ID":"9d2a0785-3dcc-4c0d-b9ad-23d564e5941f","Type":"ContainerDied","Data":"41db31a8eb0594309f090fefa7c9b781dd17e82a8eaf7dd9f8701c359088ca01"}
Jul 22 17:05:34.266204 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.266180    2580 scope.go:117] "RemoveContainer" containerID="513cb50867b2487e045cadf4bf2f722916ba924b98529bc679cb1e9fc32e8f38"
Jul 22 17:05:34.275237 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.275218    2580 scope.go:117] "RemoveContainer" containerID="513cb50867b2487e045cadf4bf2f722916ba924b98529bc679cb1e9fc32e8f38"
Jul 22 17:05:34.275476 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:05:34.275456    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"513cb50867b2487e045cadf4bf2f722916ba924b98529bc679cb1e9fc32e8f38\": container with ID starting with 513cb50867b2487e045cadf4bf2f722916ba924b98529bc679cb1e9fc32e8f38 not found: ID does not exist" containerID="513cb50867b2487e045cadf4bf2f722916ba924b98529bc679cb1e9fc32e8f38"
Jul 22 17:05:34.275518 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.275484    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"513cb50867b2487e045cadf4bf2f722916ba924b98529bc679cb1e9fc32e8f38"} err="failed to get container status \"513cb50867b2487e045cadf4bf2f722916ba924b98529bc679cb1e9fc32e8f38\": rpc error: code = NotFound desc = could not find container \"513cb50867b2487e045cadf4bf2f722916ba924b98529bc679cb1e9fc32e8f38\": container with ID starting with 513cb50867b2487e045cadf4bf2f722916ba924b98529bc679cb1e9fc32e8f38 not found: ID does not exist"
Jul 22 17:05:34.283566 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.283524    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr" podStartSLOduration=1.2835121059999999 podStartE2EDuration="1.283512106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:05:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:05:34.281249717 +0000 UTC m=+2563.633525738" watchObservedRunningTime="2026-07-22 17:05:34.283512106 +0000 UTC m=+2563.635788127"
Jul 22 17:05:34.294256 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.294233    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"]
Jul 22 17:05:34.298421 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.298396    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-265741/auth-test-model-265741-kserve-648bd8d655-6b7tb"]
Jul 22 17:05:34.304778 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.304746    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4l6r\" (UniqueName: \"kubernetes.io/projected/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-kube-api-access-m4l6r\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:05:34.304778 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.304769    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-tls-certs\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:05:34.304934 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:34.304784    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f-dshm\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:05:35.373859 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:35.373818    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d2a0785-3dcc-4c0d-b9ad-23d564e5941f" path="/var/lib/kubelet/pods/9d2a0785-3dcc-4c0d-b9ad-23d564e5941f/volumes"
Jul 22 17:05:43.920664 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:43.920622    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:43.920664 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:43.920672    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:43.933277 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:43.933251    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:44.336352 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:44.336269    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:05:53.490841 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.490810    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"]
Jul 22 17:05:53.491276 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.491262    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d2a0785-3dcc-4c0d-b9ad-23d564e5941f" containerName="main"
Jul 22 17:05:53.491324 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.491279    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d2a0785-3dcc-4c0d-b9ad-23d564e5941f" containerName="main"
Jul 22 17:05:53.491359 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.491355    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d2a0785-3dcc-4c0d-b9ad-23d564e5941f" containerName="main"
Jul 22 17:05:53.496120 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.496101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.499720 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.499695    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-13a8c9\"/\"default-dockercfg-rlfst\""
Jul 22 17:05:53.499955 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.499912    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-13a8c9\"/\"openshift-service-ca.crt\""
Jul 22 17:05:53.500123 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.499824    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-13a8c9\"/\"kube-root-ca.crt\""
Jul 22 17:05:53.500123 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.499790    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-13a8c9\"/\"sub-test-model-13a8c9-kserve-self-signed-certs\""
Jul 22 17:05:53.501276 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.501253    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"]
Jul 22 17:05:53.592664 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.592628    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-home\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.592840 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.592715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-model-cache\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.592840 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.592744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-dshm\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.592840 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.592782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp5hq\" (UniqueName: \"kubernetes.io/projected/8bc117db-a158-4584-bed9-137ebbed6d8b-kube-api-access-qp5hq\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.592840 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.592807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-tmp-dir\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.592981 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.592844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc117db-a158-4584-bed9-137ebbed6d8b-tls-certs\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.694125 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.694092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc117db-a158-4584-bed9-137ebbed6d8b-tls-certs\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.694310 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.694152    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-home\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.694310 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.694212    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-model-cache\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.694310 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.694244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-dshm\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.694310 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.694281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp5hq\" (UniqueName: \"kubernetes.io/projected/8bc117db-a158-4584-bed9-137ebbed6d8b-kube-api-access-qp5hq\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.694502 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.694312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-tmp-dir\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.694612 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.694590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-home\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.694612 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.694604    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-model-cache\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.694732 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.694711    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-tmp-dir\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.696326 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.696306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-dshm\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.696482 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.696466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc117db-a158-4584-bed9-137ebbed6d8b-tls-certs\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.701929 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.701906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp5hq\" (UniqueName: \"kubernetes.io/projected/8bc117db-a158-4584-bed9-137ebbed6d8b-kube-api-access-qp5hq\") pod \"sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") " pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.807553 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.807465    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:05:53.945309 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:53.945279    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"]
Jul 22 17:05:53.948610 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:05:53.948580    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bc117db_a158_4584_bed9_137ebbed6d8b.slice/crio-d20c0adf6616a1a2d6a3fba111c26a0dbfcf63e4fd4693aa8a62b644ef7e13a3 WatchSource:0}: Error finding container d20c0adf6616a1a2d6a3fba111c26a0dbfcf63e4fd4693aa8a62b644ef7e13a3: Status 404 returned error can't find the container with id d20c0adf6616a1a2d6a3fba111c26a0dbfcf63e4fd4693aa8a62b644ef7e13a3
Jul 22 17:05:54.382410 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:54.382372    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5" event={"ID":"8bc117db-a158-4584-bed9-137ebbed6d8b","Type":"ContainerStarted","Data":"dca666af13468e7cdd2d51573a53f8b0a772582a53a541f3060184d65c358c24"}
Jul 22 17:05:54.382410 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:54.382414    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5" event={"ID":"8bc117db-a158-4584-bed9-137ebbed6d8b","Type":"ContainerStarted","Data":"d20c0adf6616a1a2d6a3fba111c26a0dbfcf63e4fd4693aa8a62b644ef7e13a3"}
Jul 22 17:05:54.402302 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:05:54.402247    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5" podStartSLOduration=1.402231702 podStartE2EDuration="1.402231702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:05:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:05:54.398546118 +0000 UTC m=+2583.750822138" watchObservedRunningTime="2026-07-22 17:05:54.402231702 +0000 UTC m=+2583.754507745"
Jul 22 17:06:03.808282 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:03.808246    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:06:03.808782 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:03.808294    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:06:03.820887 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:03.820860    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:06:04.445752 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:04.445724    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:06:28.238371 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:28.238280    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"]
Jul 22 17:06:29.171284 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:29.170675    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"]
Jul 22 17:06:43.258766 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.258716    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr" podUID="99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9" containerName="main" containerID="cri-o://a8e610a074344aed60f11371ad1aa5a779a78dda4e7e5eb1699d211d8db1a00b" gracePeriod=45
Jul 22 17:06:43.515143 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.515086    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:06:43.642673 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.642631    2580 generic.go:356] "Generic (PLEG): container finished" podID="99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9" containerID="a8e610a074344aed60f11371ad1aa5a779a78dda4e7e5eb1699d211d8db1a00b" exitCode=0
Jul 22 17:06:43.642673 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.642664    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"
Jul 22 17:06:43.642871 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.642702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr" event={"ID":"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9","Type":"ContainerDied","Data":"a8e610a074344aed60f11371ad1aa5a779a78dda4e7e5eb1699d211d8db1a00b"}
Jul 22 17:06:43.642871 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.642750    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr" event={"ID":"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9","Type":"ContainerDied","Data":"4a962fe271f1ee1dac7214b44850b3dae162595ad11f6be5b96fa8aeb9501217"}
Jul 22 17:06:43.642871 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.642768    2580 scope.go:117] "RemoveContainer" containerID="a8e610a074344aed60f11371ad1aa5a779a78dda4e7e5eb1699d211d8db1a00b"
Jul 22 17:06:43.651565 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.651542    2580 scope.go:117] "RemoveContainer" containerID="a8e610a074344aed60f11371ad1aa5a779a78dda4e7e5eb1699d211d8db1a00b"
Jul 22 17:06:43.651852 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:06:43.651834    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8e610a074344aed60f11371ad1aa5a779a78dda4e7e5eb1699d211d8db1a00b\": container with ID starting with a8e610a074344aed60f11371ad1aa5a779a78dda4e7e5eb1699d211d8db1a00b not found: ID does not exist" containerID="a8e610a074344aed60f11371ad1aa5a779a78dda4e7e5eb1699d211d8db1a00b"
Jul 22 17:06:43.651912 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.651863    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8e610a074344aed60f11371ad1aa5a779a78dda4e7e5eb1699d211d8db1a00b"} err="failed to get container status \"a8e610a074344aed60f11371ad1aa5a779a78dda4e7e5eb1699d211d8db1a00b\": rpc error: code = NotFound desc = could not find container \"a8e610a074344aed60f11371ad1aa5a779a78dda4e7e5eb1699d211d8db1a00b\": container with ID starting with a8e610a074344aed60f11371ad1aa5a779a78dda4e7e5eb1699d211d8db1a00b not found: ID does not exist"
Jul 22 17:06:43.678163 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.678136    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-tmp-dir\") pod \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") "
Jul 22 17:06:43.678307 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.678224    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-tls-certs\") pod \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") "
Jul 22 17:06:43.678307 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.678280    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-dshm\") pod \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") "
Jul 22 17:06:43.678431 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.678335    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-model-cache\") pod \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") "
Jul 22 17:06:43.678431 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.678379    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hgtg\" (UniqueName: \"kubernetes.io/projected/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-kube-api-access-2hgtg\") pod \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") "
Jul 22 17:06:43.678431 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.678414    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-home\") pod \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\" (UID: \"99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9\") "
Jul 22 17:06:43.678592 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.678431    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9" (UID: "99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:43.678790 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.678769    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-tmp-dir\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:06:43.679006 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.678979    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-model-cache" (OuterVolumeSpecName: "model-cache") pod "99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9" (UID: "99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:43.679115 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.678988    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-home" (OuterVolumeSpecName: "home") pod "99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9" (UID: "99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:43.681127 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.681084    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9" (UID: "99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:06:43.681127 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.681095    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-kube-api-access-2hgtg" (OuterVolumeSpecName: "kube-api-access-2hgtg") pod "99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9" (UID: "99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9"). InnerVolumeSpecName "kube-api-access-2hgtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:06:43.681258 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.681201    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-dshm" (OuterVolumeSpecName: "dshm") pod "99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9" (UID: "99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:43.697217 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.697192    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"]
Jul 22 17:06:43.698047 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.697910    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9" containerName="main"
Jul 22 17:06:43.698047 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.697933    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9" containerName="main"
Jul 22 17:06:43.698225 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.698064    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9" containerName="main"
Jul 22 17:06:43.702822 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.702800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.705357 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.705337    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-265741\"/\"rate-test-model-265741-kserve-self-signed-certs\""
Jul 22 17:06:43.709413 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.709391    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"]
Jul 22 17:06:43.779592 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.779516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-dshm\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.779592 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.779551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-tmp-dir\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.779592 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.779570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-home\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.779789 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.779687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-model-cache\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.779789 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.779710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sspv\" (UniqueName: \"kubernetes.io/projected/082de446-5795-4df6-982c-b5d9efb7b803-kube-api-access-6sspv\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.779789 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.779756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/082de446-5795-4df6-982c-b5d9efb7b803-tls-certs\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.779885 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.779855    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-tls-certs\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:06:43.779885 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.779865    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-dshm\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:06:43.779885 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.779873    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-model-cache\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:06:43.779885 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.779882    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hgtg\" (UniqueName: \"kubernetes.io/projected/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-kube-api-access-2hgtg\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:06:43.780008 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.779890    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9-home\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:06:43.880891 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.880857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-model-cache\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.880891 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.880893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sspv\" (UniqueName: \"kubernetes.io/projected/082de446-5795-4df6-982c-b5d9efb7b803-kube-api-access-6sspv\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.881134 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.880942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/082de446-5795-4df6-982c-b5d9efb7b803-tls-certs\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.881134 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.881050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-dshm\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.881134 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.881077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-tmp-dir\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.881134 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.881100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-home\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.881377 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.881357    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-model-cache\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.881440 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.881424    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-home\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.881503 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.881472    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-tmp-dir\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.883282 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.883259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-dshm\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.883558 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.883541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/082de446-5795-4df6-982c-b5d9efb7b803-tls-certs\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.888883 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.888865    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sspv\" (UniqueName: \"kubernetes.io/projected/082de446-5795-4df6-982c-b5d9efb7b803-kube-api-access-6sspv\") pod \"rate-test-model-265741-kserve-55ff8b6f47-l52d4\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") " pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:43.965735 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.965708    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"]
Jul 22 17:06:43.969163 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:43.969138    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-265741/sub-test-model-265741-kserve-86977878c7-cdfrr"]
Jul 22 17:06:44.014557 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.014522    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:44.148091 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.148065    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"]
Jul 22 17:06:44.150683 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:06:44.150658    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod082de446_5795_4df6_982c_b5d9efb7b803.slice/crio-1a38eba81b4b380492749e174b1cec269edd89aaa115961c1c9ac0c816337e02 WatchSource:0}: Error finding container 1a38eba81b4b380492749e174b1cec269edd89aaa115961c1c9ac0c816337e02: Status 404 returned error can't find the container with id 1a38eba81b4b380492749e174b1cec269edd89aaa115961c1c9ac0c816337e02
Jul 22 17:06:44.192810 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.192772    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5" podUID="8bc117db-a158-4584-bed9-137ebbed6d8b" containerName="main" containerID="cri-o://dca666af13468e7cdd2d51573a53f8b0a772582a53a541f3060184d65c358c24" gracePeriod=45
Jul 22 17:06:44.444502 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.444480    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:06:44.588158 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.588120    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-tmp-dir\") pod \"8bc117db-a158-4584-bed9-137ebbed6d8b\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") "
Jul 22 17:06:44.588158 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.588172    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-dshm\") pod \"8bc117db-a158-4584-bed9-137ebbed6d8b\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") "
Jul 22 17:06:44.588369 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.588208    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc117db-a158-4584-bed9-137ebbed6d8b-tls-certs\") pod \"8bc117db-a158-4584-bed9-137ebbed6d8b\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") "
Jul 22 17:06:44.588369 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.588270    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp5hq\" (UniqueName: \"kubernetes.io/projected/8bc117db-a158-4584-bed9-137ebbed6d8b-kube-api-access-qp5hq\") pod \"8bc117db-a158-4584-bed9-137ebbed6d8b\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") "
Jul 22 17:06:44.588369 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.588307    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-model-cache\") pod \"8bc117db-a158-4584-bed9-137ebbed6d8b\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") "
Jul 22 17:06:44.588369 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.588336    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-home\") pod \"8bc117db-a158-4584-bed9-137ebbed6d8b\" (UID: \"8bc117db-a158-4584-bed9-137ebbed6d8b\") "
Jul 22 17:06:44.588590 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.588427    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8bc117db-a158-4584-bed9-137ebbed6d8b" (UID: "8bc117db-a158-4584-bed9-137ebbed6d8b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:44.588677 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.588647    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-model-cache" (OuterVolumeSpecName: "model-cache") pod "8bc117db-a158-4584-bed9-137ebbed6d8b" (UID: "8bc117db-a158-4584-bed9-137ebbed6d8b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:44.588677 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.588659    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-home" (OuterVolumeSpecName: "home") pod "8bc117db-a158-4584-bed9-137ebbed6d8b" (UID: "8bc117db-a158-4584-bed9-137ebbed6d8b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:44.588791 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.588758    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-model-cache\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:06:44.588791 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.588777    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-home\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:06:44.588864 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.588792    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-tmp-dir\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:06:44.590402 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.590382    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-dshm" (OuterVolumeSpecName: "dshm") pod "8bc117db-a158-4584-bed9-137ebbed6d8b" (UID: "8bc117db-a158-4584-bed9-137ebbed6d8b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:44.590857 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.590833    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bc117db-a158-4584-bed9-137ebbed6d8b-kube-api-access-qp5hq" (OuterVolumeSpecName: "kube-api-access-qp5hq") pod "8bc117db-a158-4584-bed9-137ebbed6d8b" (UID: "8bc117db-a158-4584-bed9-137ebbed6d8b"). InnerVolumeSpecName "kube-api-access-qp5hq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:06:44.590857 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.590837    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc117db-a158-4584-bed9-137ebbed6d8b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8bc117db-a158-4584-bed9-137ebbed6d8b" (UID: "8bc117db-a158-4584-bed9-137ebbed6d8b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:06:44.650397 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.650367    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4" event={"ID":"082de446-5795-4df6-982c-b5d9efb7b803","Type":"ContainerStarted","Data":"a96c6f600e5f29cab1e65fee7cd4f5705be0ccc253cfde7439ee988fa0a61a86"}
Jul 22 17:06:44.650546 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.650410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4" event={"ID":"082de446-5795-4df6-982c-b5d9efb7b803","Type":"ContainerStarted","Data":"1a38eba81b4b380492749e174b1cec269edd89aaa115961c1c9ac0c816337e02"}
Jul 22 17:06:44.651687 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.651661    2580 generic.go:356] "Generic (PLEG): container finished" podID="8bc117db-a158-4584-bed9-137ebbed6d8b" containerID="dca666af13468e7cdd2d51573a53f8b0a772582a53a541f3060184d65c358c24" exitCode=0
Jul 22 17:06:44.651773 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.651704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5" event={"ID":"8bc117db-a158-4584-bed9-137ebbed6d8b","Type":"ContainerDied","Data":"dca666af13468e7cdd2d51573a53f8b0a772582a53a541f3060184d65c358c24"}
Jul 22 17:06:44.651773 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.651716    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"
Jul 22 17:06:44.651773 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.651727    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5" event={"ID":"8bc117db-a158-4584-bed9-137ebbed6d8b","Type":"ContainerDied","Data":"d20c0adf6616a1a2d6a3fba111c26a0dbfcf63e4fd4693aa8a62b644ef7e13a3"}
Jul 22 17:06:44.651773 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.651743    2580 scope.go:117] "RemoveContainer" containerID="dca666af13468e7cdd2d51573a53f8b0a772582a53a541f3060184d65c358c24"
Jul 22 17:06:44.661449 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.661432    2580 scope.go:117] "RemoveContainer" containerID="dca666af13468e7cdd2d51573a53f8b0a772582a53a541f3060184d65c358c24"
Jul 22 17:06:44.661687 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:06:44.661671    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dca666af13468e7cdd2d51573a53f8b0a772582a53a541f3060184d65c358c24\": container with ID starting with dca666af13468e7cdd2d51573a53f8b0a772582a53a541f3060184d65c358c24 not found: ID does not exist" containerID="dca666af13468e7cdd2d51573a53f8b0a772582a53a541f3060184d65c358c24"
Jul 22 17:06:44.661726 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.661696    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca666af13468e7cdd2d51573a53f8b0a772582a53a541f3060184d65c358c24"} err="failed to get container status \"dca666af13468e7cdd2d51573a53f8b0a772582a53a541f3060184d65c358c24\": rpc error: code = NotFound desc = could not find container \"dca666af13468e7cdd2d51573a53f8b0a772582a53a541f3060184d65c358c24\": container with ID starting with dca666af13468e7cdd2d51573a53f8b0a772582a53a541f3060184d65c358c24 not found: ID does not exist"
Jul 22 17:06:44.669323 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.669286    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4" podStartSLOduration=1.669273203 podStartE2EDuration="1.669273203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:06:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:06:44.667552639 +0000 UTC m=+2634.019828661" watchObservedRunningTime="2026-07-22 17:06:44.669273203 +0000 UTC m=+2634.021549222"
Jul 22 17:06:44.682030 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.682000    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"]
Jul 22 17:06:44.685382 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.685361    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5"]
Jul 22 17:06:44.689987 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.689968    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp5hq\" (UniqueName: \"kubernetes.io/projected/8bc117db-a158-4584-bed9-137ebbed6d8b-kube-api-access-qp5hq\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:06:44.690069 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.689990    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bc117db-a158-4584-bed9-137ebbed6d8b-dshm\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:06:44.690069 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:44.690001    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc117db-a158-4584-bed9-137ebbed6d8b-tls-certs\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:06:45.374673 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:45.374639    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bc117db-a158-4584-bed9-137ebbed6d8b" path="/var/lib/kubelet/pods/8bc117db-a158-4584-bed9-137ebbed6d8b/volumes"
Jul 22 17:06:45.375087 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:45.375073    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9" path="/var/lib/kubelet/pods/99c0aa23-2e30-4707-ba1b-7b3c4b4c25d9/volumes"
Jul 22 17:06:49.435498 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:49.435458    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-13a8c9/sub-test-model-13a8c9-kserve-7b5b4456f7-bdhh5" podUID="8bc117db-a158-4584-bed9-137ebbed6d8b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 22 17:06:51.668640 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:51.668601    2580 scope.go:117] "RemoveContainer" containerID="0d77c7d7dcf6f4ebfed04dc1da70cc698182c1c5c30d37bfd3a83c938c91a3c5"
Jul 22 17:06:54.015548 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:54.015521    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:54.015943 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:54.015773    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:54.028039 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:54.027991    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:06:54.717656 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:06:54.717620    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:07:13.707881 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.707848    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"]
Jul 22 17:07:13.708308 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.708294    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc117db-a158-4584-bed9-137ebbed6d8b" containerName="main"
Jul 22 17:07:13.708308 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.708310    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc117db-a158-4584-bed9-137ebbed6d8b" containerName="main"
Jul 22 17:07:13.708400 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.708387    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc117db-a158-4584-bed9-137ebbed6d8b" containerName="main"
Jul 22 17:07:13.711432 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.711410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.718131 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.718102    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-13a8c9\"/\"kube-root-ca.crt\""
Jul 22 17:07:13.719541 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.719517    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-13a8c9\"/\"rate-test-model-13a8c9-kserve-self-signed-certs\""
Jul 22 17:07:13.719704 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.719685    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-13a8c9\"/\"openshift-service-ca.crt\""
Jul 22 17:07:13.720287 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.720167    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-13a8c9\"/\"default-dockercfg-rlfst\""
Jul 22 17:07:13.722747 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.722723    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"]
Jul 22 17:07:13.766674 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.766648    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-model-cache\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.766816 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.766685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-tmp-dir\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.766816 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.766717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-home\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.766816 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.766779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-dshm\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.766938 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.766854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p27ht\" (UniqueName: \"kubernetes.io/projected/512f0659-39e7-4b89-a423-13eca0a41207-kube-api-access-p27ht\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.766938 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.766904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512f0659-39e7-4b89-a423-13eca0a41207-tls-certs\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.868065 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.868030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-tmp-dir\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.868242 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.868089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-home\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.868242 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.868132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-dshm\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.868242 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.868215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p27ht\" (UniqueName: \"kubernetes.io/projected/512f0659-39e7-4b89-a423-13eca0a41207-kube-api-access-p27ht\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.868384 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.868268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512f0659-39e7-4b89-a423-13eca0a41207-tls-certs\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.868384 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.868317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-model-cache\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.868493 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.868470    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-tmp-dir\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.868537 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.868521    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-home\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.868676 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.868653    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-model-cache\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.870438 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.870418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-dshm\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.870722 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.870703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512f0659-39e7-4b89-a423-13eca0a41207-tls-certs\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:13.876148 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:13.876125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p27ht\" (UniqueName: \"kubernetes.io/projected/512f0659-39e7-4b89-a423-13eca0a41207-kube-api-access-p27ht\") pod \"rate-test-model-13a8c9-kserve-6d88465595-nzdd7\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") " pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:14.029396 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:14.029314    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:14.164006 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:14.163983    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"]
Jul 22 17:07:14.165640 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:07:14.165612    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod512f0659_39e7_4b89_a423_13eca0a41207.slice/crio-f70820e052633e330b6dffe38902140211b38cb7d44194c4ad39a9a93acfa6bc WatchSource:0}: Error finding container f70820e052633e330b6dffe38902140211b38cb7d44194c4ad39a9a93acfa6bc: Status 404 returned error can't find the container with id f70820e052633e330b6dffe38902140211b38cb7d44194c4ad39a9a93acfa6bc
Jul 22 17:07:14.811665 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:14.811628    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7" event={"ID":"512f0659-39e7-4b89-a423-13eca0a41207","Type":"ContainerStarted","Data":"2c260cd9608dad5a709177388b8f3f2020f1260bcb4be609595e1f87d5929cba"}
Jul 22 17:07:14.812109 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:14.811672    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7" event={"ID":"512f0659-39e7-4b89-a423-13eca0a41207","Type":"ContainerStarted","Data":"f70820e052633e330b6dffe38902140211b38cb7d44194c4ad39a9a93acfa6bc"}
Jul 22 17:07:14.828722 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:14.828667    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7" podStartSLOduration=1.828652854 podStartE2EDuration="1.828652854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:07:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:07:14.827800342 +0000 UTC m=+2664.180076364" watchObservedRunningTime="2026-07-22 17:07:14.828652854 +0000 UTC m=+2664.180928873"
Jul 22 17:07:24.030367 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:24.030335    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:24.030842 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:24.030406    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:24.042581 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:24.042560    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:24.873904 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:24.873876    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:07:51.698183 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:07:51.698098    2580 scope.go:117] "RemoveContainer" containerID="ebd53263c2dd25cadca9de73f0437ea5e5898651527db7a5b1b415d6e1896ef8"
Jul 22 17:08:01.213637 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:01.213603    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"]
Jul 22 17:08:02.177437 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:02.177403    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"]
Jul 22 17:08:16.233995 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.233926    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4" podUID="082de446-5795-4df6-982c-b5d9efb7b803" containerName="main" containerID="cri-o://a96c6f600e5f29cab1e65fee7cd4f5705be0ccc253cfde7439ee988fa0a61a86" gracePeriod=45
Jul 22 17:08:16.487834 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.487770    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:08:16.600709 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.600679    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sspv\" (UniqueName: \"kubernetes.io/projected/082de446-5795-4df6-982c-b5d9efb7b803-kube-api-access-6sspv\") pod \"082de446-5795-4df6-982c-b5d9efb7b803\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") "
Jul 22 17:08:16.600916 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.600733    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/082de446-5795-4df6-982c-b5d9efb7b803-tls-certs\") pod \"082de446-5795-4df6-982c-b5d9efb7b803\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") "
Jul 22 17:08:16.600916 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.600773    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-tmp-dir\") pod \"082de446-5795-4df6-982c-b5d9efb7b803\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") "
Jul 22 17:08:16.600916 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.600856    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-model-cache\") pod \"082de446-5795-4df6-982c-b5d9efb7b803\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") "
Jul 22 17:08:16.600916 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.600903    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-dshm\") pod \"082de446-5795-4df6-982c-b5d9efb7b803\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") "
Jul 22 17:08:16.601171 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.600954    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-home\") pod \"082de446-5795-4df6-982c-b5d9efb7b803\" (UID: \"082de446-5795-4df6-982c-b5d9efb7b803\") "
Jul 22 17:08:16.601229 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.601174    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-model-cache" (OuterVolumeSpecName: "model-cache") pod "082de446-5795-4df6-982c-b5d9efb7b803" (UID: "082de446-5795-4df6-982c-b5d9efb7b803"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:16.601229 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.601181    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "082de446-5795-4df6-982c-b5d9efb7b803" (UID: "082de446-5795-4df6-982c-b5d9efb7b803"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:16.601308 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.601255    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-home" (OuterVolumeSpecName: "home") pod "082de446-5795-4df6-982c-b5d9efb7b803" (UID: "082de446-5795-4df6-982c-b5d9efb7b803"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:16.601308 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.601296    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-model-cache\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:16.601382 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.601310    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-tmp-dir\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:16.603143 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.603120    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-dshm" (OuterVolumeSpecName: "dshm") pod "082de446-5795-4df6-982c-b5d9efb7b803" (UID: "082de446-5795-4df6-982c-b5d9efb7b803"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:16.603413 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.603393    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/082de446-5795-4df6-982c-b5d9efb7b803-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "082de446-5795-4df6-982c-b5d9efb7b803" (UID: "082de446-5795-4df6-982c-b5d9efb7b803"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:08:16.603486 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.603427    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/082de446-5795-4df6-982c-b5d9efb7b803-kube-api-access-6sspv" (OuterVolumeSpecName: "kube-api-access-6sspv") pod "082de446-5795-4df6-982c-b5d9efb7b803" (UID: "082de446-5795-4df6-982c-b5d9efb7b803"). InnerVolumeSpecName "kube-api-access-6sspv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:08:16.702313 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.702274    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-dshm\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:16.702313 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.702305    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/082de446-5795-4df6-982c-b5d9efb7b803-home\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:16.702313 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.702317    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sspv\" (UniqueName: \"kubernetes.io/projected/082de446-5795-4df6-982c-b5d9efb7b803-kube-api-access-6sspv\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:16.702553 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:16.702331    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/082de446-5795-4df6-982c-b5d9efb7b803-tls-certs\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:17.132409 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.132370    2580 generic.go:356] "Generic (PLEG): container finished" podID="082de446-5795-4df6-982c-b5d9efb7b803" containerID="a96c6f600e5f29cab1e65fee7cd4f5705be0ccc253cfde7439ee988fa0a61a86" exitCode=0
Jul 22 17:08:17.132622 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.132426    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"
Jul 22 17:08:17.132622 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.132449    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4" event={"ID":"082de446-5795-4df6-982c-b5d9efb7b803","Type":"ContainerDied","Data":"a96c6f600e5f29cab1e65fee7cd4f5705be0ccc253cfde7439ee988fa0a61a86"}
Jul 22 17:08:17.132622 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.132492    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4" event={"ID":"082de446-5795-4df6-982c-b5d9efb7b803","Type":"ContainerDied","Data":"1a38eba81b4b380492749e174b1cec269edd89aaa115961c1c9ac0c816337e02"}
Jul 22 17:08:17.132622 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.132511    2580 scope.go:117] "RemoveContainer" containerID="a96c6f600e5f29cab1e65fee7cd4f5705be0ccc253cfde7439ee988fa0a61a86"
Jul 22 17:08:17.141852 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.141842    2580 scope.go:117] "RemoveContainer" containerID="a96c6f600e5f29cab1e65fee7cd4f5705be0ccc253cfde7439ee988fa0a61a86"
Jul 22 17:08:17.142098 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:08:17.142077    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a96c6f600e5f29cab1e65fee7cd4f5705be0ccc253cfde7439ee988fa0a61a86\": container with ID starting with a96c6f600e5f29cab1e65fee7cd4f5705be0ccc253cfde7439ee988fa0a61a86 not found: ID does not exist" containerID="a96c6f600e5f29cab1e65fee7cd4f5705be0ccc253cfde7439ee988fa0a61a86"
Jul 22 17:08:17.142199 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.142108    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96c6f600e5f29cab1e65fee7cd4f5705be0ccc253cfde7439ee988fa0a61a86"} err="failed to get container status \"a96c6f600e5f29cab1e65fee7cd4f5705be0ccc253cfde7439ee988fa0a61a86\": rpc error: code = NotFound desc = could not find container \"a96c6f600e5f29cab1e65fee7cd4f5705be0ccc253cfde7439ee988fa0a61a86\": container with ID starting with a96c6f600e5f29cab1e65fee7cd4f5705be0ccc253cfde7439ee988fa0a61a86 not found: ID does not exist"
Jul 22 17:08:17.153112 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.153085    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"]
Jul 22 17:08:17.156957 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.156935    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-265741/rate-test-model-265741-kserve-55ff8b6f47-l52d4"]
Jul 22 17:08:17.199257 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.199218    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7" podUID="512f0659-39e7-4b89-a423-13eca0a41207" containerName="main" containerID="cri-o://2c260cd9608dad5a709177388b8f3f2020f1260bcb4be609595e1f87d5929cba" gracePeriod=45
Jul 22 17:08:17.390539 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.390502    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="082de446-5795-4df6-982c-b5d9efb7b803" path="/var/lib/kubelet/pods/082de446-5795-4df6-982c-b5d9efb7b803/volumes"
Jul 22 17:08:17.450485 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.450460    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:08:17.511365 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.511330    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-home\") pod \"512f0659-39e7-4b89-a423-13eca0a41207\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") "
Jul 22 17:08:17.511531 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.511429    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512f0659-39e7-4b89-a423-13eca0a41207-tls-certs\") pod \"512f0659-39e7-4b89-a423-13eca0a41207\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") "
Jul 22 17:08:17.511531 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.511460    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-dshm\") pod \"512f0659-39e7-4b89-a423-13eca0a41207\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") "
Jul 22 17:08:17.511531 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.511513    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p27ht\" (UniqueName: \"kubernetes.io/projected/512f0659-39e7-4b89-a423-13eca0a41207-kube-api-access-p27ht\") pod \"512f0659-39e7-4b89-a423-13eca0a41207\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") "
Jul 22 17:08:17.511698 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.511546    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-model-cache\") pod \"512f0659-39e7-4b89-a423-13eca0a41207\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") "
Jul 22 17:08:17.511698 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.511610    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-home" (OuterVolumeSpecName: "home") pod "512f0659-39e7-4b89-a423-13eca0a41207" (UID: "512f0659-39e7-4b89-a423-13eca0a41207"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:17.511698 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.511621    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-tmp-dir\") pod \"512f0659-39e7-4b89-a423-13eca0a41207\" (UID: \"512f0659-39e7-4b89-a423-13eca0a41207\") "
Jul 22 17:08:17.511876 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.511812    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-model-cache" (OuterVolumeSpecName: "model-cache") pod "512f0659-39e7-4b89-a423-13eca0a41207" (UID: "512f0659-39e7-4b89-a423-13eca0a41207"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:17.511938 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.511907    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-model-cache\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:17.511938 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.511906    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "512f0659-39e7-4b89-a423-13eca0a41207" (UID: "512f0659-39e7-4b89-a423-13eca0a41207"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:17.511938 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.511921    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-home\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:17.513646 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.513622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-dshm" (OuterVolumeSpecName: "dshm") pod "512f0659-39e7-4b89-a423-13eca0a41207" (UID: "512f0659-39e7-4b89-a423-13eca0a41207"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:17.513932 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.513915    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/512f0659-39e7-4b89-a423-13eca0a41207-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "512f0659-39e7-4b89-a423-13eca0a41207" (UID: "512f0659-39e7-4b89-a423-13eca0a41207"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:08:17.514064 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.514047    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/512f0659-39e7-4b89-a423-13eca0a41207-kube-api-access-p27ht" (OuterVolumeSpecName: "kube-api-access-p27ht") pod "512f0659-39e7-4b89-a423-13eca0a41207" (UID: "512f0659-39e7-4b89-a423-13eca0a41207"). InnerVolumeSpecName "kube-api-access-p27ht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:08:17.613068 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.613002    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-tmp-dir\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:17.613068 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.613064    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512f0659-39e7-4b89-a423-13eca0a41207-tls-certs\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:17.613068 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.613075    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/512f0659-39e7-4b89-a423-13eca0a41207-dshm\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:17.613303 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:17.613084    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p27ht\" (UniqueName: \"kubernetes.io/projected/512f0659-39e7-4b89-a423-13eca0a41207-kube-api-access-p27ht\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:18.140209 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:18.140176    2580 generic.go:356] "Generic (PLEG): container finished" podID="512f0659-39e7-4b89-a423-13eca0a41207" containerID="2c260cd9608dad5a709177388b8f3f2020f1260bcb4be609595e1f87d5929cba" exitCode=0
Jul 22 17:08:18.140406 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:18.140218    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"
Jul 22 17:08:18.140406 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:18.140261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7" event={"ID":"512f0659-39e7-4b89-a423-13eca0a41207","Type":"ContainerDied","Data":"2c260cd9608dad5a709177388b8f3f2020f1260bcb4be609595e1f87d5929cba"}
Jul 22 17:08:18.140406 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:18.140302    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7" event={"ID":"512f0659-39e7-4b89-a423-13eca0a41207","Type":"ContainerDied","Data":"f70820e052633e330b6dffe38902140211b38cb7d44194c4ad39a9a93acfa6bc"}
Jul 22 17:08:18.140406 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:18.140319    2580 scope.go:117] "RemoveContainer" containerID="2c260cd9608dad5a709177388b8f3f2020f1260bcb4be609595e1f87d5929cba"
Jul 22 17:08:18.149735 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:18.149717    2580 scope.go:117] "RemoveContainer" containerID="2c260cd9608dad5a709177388b8f3f2020f1260bcb4be609595e1f87d5929cba"
Jul 22 17:08:18.149974 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:08:18.149957    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c260cd9608dad5a709177388b8f3f2020f1260bcb4be609595e1f87d5929cba\": container with ID starting with 2c260cd9608dad5a709177388b8f3f2020f1260bcb4be609595e1f87d5929cba not found: ID does not exist" containerID="2c260cd9608dad5a709177388b8f3f2020f1260bcb4be609595e1f87d5929cba"
Jul 22 17:08:18.150049 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:18.149983    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c260cd9608dad5a709177388b8f3f2020f1260bcb4be609595e1f87d5929cba"} err="failed to get container status \"2c260cd9608dad5a709177388b8f3f2020f1260bcb4be609595e1f87d5929cba\": rpc error: code = NotFound desc = could not find container \"2c260cd9608dad5a709177388b8f3f2020f1260bcb4be609595e1f87d5929cba\": container with ID starting with 2c260cd9608dad5a709177388b8f3f2020f1260bcb4be609595e1f87d5929cba not found: ID does not exist"
Jul 22 17:08:18.161370 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:18.161349    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"]
Jul 22 17:08:18.167105 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:18.167085    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-13a8c9/rate-test-model-13a8c9-kserve-6d88465595-nzdd7"]
Jul 22 17:08:19.373157 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:19.373123    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="512f0659-39e7-4b89-a423-13eca0a41207" path="/var/lib/kubelet/pods/512f0659-39e7-4b89-a423-13eca0a41207/volumes"
Jul 22 17:08:21.071357 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.071323    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds"]
Jul 22 17:08:21.071751 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.071722    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="082de446-5795-4df6-982c-b5d9efb7b803" containerName="main"
Jul 22 17:08:21.071751 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.071733    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="082de446-5795-4df6-982c-b5d9efb7b803" containerName="main"
Jul 22 17:08:21.071837 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.071753    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="512f0659-39e7-4b89-a423-13eca0a41207" containerName="main"
Jul 22 17:08:21.071837 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.071758    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="512f0659-39e7-4b89-a423-13eca0a41207" containerName="main"
Jul 22 17:08:21.071837 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.071818    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="512f0659-39e7-4b89-a423-13eca0a41207" containerName="main"
Jul 22 17:08:21.071837 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.071827    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="082de446-5795-4df6-982c-b5d9efb7b803" containerName="main"
Jul 22 17:08:21.076161 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.076140    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds"
Jul 22 17:08:21.078717 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.078692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sh5d4\""
Jul 22 17:08:21.081436 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.081403    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds"]
Jul 22 17:08:21.143412 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.143374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-265741-crkds\" (UID: \"94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds"
Jul 22 17:08:21.244826 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.244782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-265741-crkds\" (UID: \"94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds"
Jul 22 17:08:21.245475 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.245455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-265741-crkds\" (UID: \"94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds"
Jul 22 17:08:21.387798 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.387764    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds"
Jul 22 17:08:21.522678 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:21.522656    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds"]
Jul 22 17:08:21.524541 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:08:21.524513    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e3e5b3_3bf5_4a4f_80f8_772a39f2dcf3.slice/crio-187d304aa1cadcd8a93939f1054d32ff730d9b75515ebbd3a29b4a23f7709331 WatchSource:0}: Error finding container 187d304aa1cadcd8a93939f1054d32ff730d9b75515ebbd3a29b4a23f7709331: Status 404 returned error can't find the container with id 187d304aa1cadcd8a93939f1054d32ff730d9b75515ebbd3a29b4a23f7709331
Jul 22 17:08:22.165165 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:22.165124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds" event={"ID":"94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3","Type":"ContainerStarted","Data":"0adde033dc2a318c8e2ff0bce6c7667079f44f7bbc48c6c687abcc3c99659744"}
Jul 22 17:08:22.165608 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:22.165185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds" event={"ID":"94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3","Type":"ContainerStarted","Data":"187d304aa1cadcd8a93939f1054d32ff730d9b75515ebbd3a29b4a23f7709331"}
Jul 22 17:08:22.180752 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:22.180708    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds" podStartSLOduration=1.180694435 podStartE2EDuration="1.180694435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:08:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:08:22.179379301 +0000 UTC m=+2731.531655322" watchObservedRunningTime="2026-07-22 17:08:22.180694435 +0000 UTC m=+2731.532970455"
Jul 22 17:08:23.172221 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:23.172186    2580 generic.go:356] "Generic (PLEG): container finished" podID="94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3" containerID="0adde033dc2a318c8e2ff0bce6c7667079f44f7bbc48c6c687abcc3c99659744" exitCode=0
Jul 22 17:08:23.172221 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:23.172224    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds" event={"ID":"94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3","Type":"ContainerDied","Data":"0adde033dc2a318c8e2ff0bce6c7667079f44f7bbc48c6c687abcc3c99659744"}
Jul 22 17:08:24.303905 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:24.303880    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds"
Jul 22 17:08:24.373592 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:24.373567    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3-maas-api-service-ca\") pod \"94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3\" (UID: \"94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3\") "
Jul 22 17:08:24.373921 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:24.373900    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3" (UID: "94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:08:24.475410 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:24.475301    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3-maas-api-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:25.183389 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:25.183351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds" event={"ID":"94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3","Type":"ContainerDied","Data":"187d304aa1cadcd8a93939f1054d32ff730d9b75515ebbd3a29b4a23f7709331"}
Jul 22 17:08:25.183389 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:25.183389    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds"
Jul 22 17:08:25.183618 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:25.183412    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="187d304aa1cadcd8a93939f1054d32ff730d9b75515ebbd3a29b4a23f7709331"
Jul 22 17:08:31.575953 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:31.575919    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"]
Jul 22 17:08:31.576489 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:31.576182    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4" podUID="e5a18a36-1a54-4469-a174-ef336122ccf2" containerName="maas-api" containerID="cri-o://fe7c9fd5c53bd67effd51b970cbce37af86d2357d381114014b8c6716e356ea7" gracePeriod=30
Jul 22 17:08:32.026149 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.026126    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:08:32.147556 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.147528    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5a18a36-1a54-4469-a174-ef336122ccf2-openshift-service-ca\") pod \"e5a18a36-1a54-4469-a174-ef336122ccf2\" (UID: \"e5a18a36-1a54-4469-a174-ef336122ccf2\") "
Jul 22 17:08:32.147840 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.147577    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvd46\" (UniqueName: \"kubernetes.io/projected/e5a18a36-1a54-4469-a174-ef336122ccf2-kube-api-access-hvd46\") pod \"e5a18a36-1a54-4469-a174-ef336122ccf2\" (UID: \"e5a18a36-1a54-4469-a174-ef336122ccf2\") "
Jul 22 17:08:32.147840 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.147711    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a18a36-1a54-4469-a174-ef336122ccf2-maas-api-tls\") pod \"e5a18a36-1a54-4469-a174-ef336122ccf2\" (UID: \"e5a18a36-1a54-4469-a174-ef336122ccf2\") "
Jul 22 17:08:32.147986 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.147958    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5a18a36-1a54-4469-a174-ef336122ccf2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e5a18a36-1a54-4469-a174-ef336122ccf2" (UID: "e5a18a36-1a54-4469-a174-ef336122ccf2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:08:32.149800 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.149772    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5a18a36-1a54-4469-a174-ef336122ccf2-kube-api-access-hvd46" (OuterVolumeSpecName: "kube-api-access-hvd46") pod "e5a18a36-1a54-4469-a174-ef336122ccf2" (UID: "e5a18a36-1a54-4469-a174-ef336122ccf2"). InnerVolumeSpecName "kube-api-access-hvd46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:08:32.149800 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.149784    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5a18a36-1a54-4469-a174-ef336122ccf2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e5a18a36-1a54-4469-a174-ef336122ccf2" (UID: "e5a18a36-1a54-4469-a174-ef336122ccf2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:08:32.218808 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.218776    2580 generic.go:356] "Generic (PLEG): container finished" podID="e5a18a36-1a54-4469-a174-ef336122ccf2" containerID="fe7c9fd5c53bd67effd51b970cbce37af86d2357d381114014b8c6716e356ea7" exitCode=0
Jul 22 17:08:32.218950 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.218816    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"
Jul 22 17:08:32.218950 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.218864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4" event={"ID":"e5a18a36-1a54-4469-a174-ef336122ccf2","Type":"ContainerDied","Data":"fe7c9fd5c53bd67effd51b970cbce37af86d2357d381114014b8c6716e356ea7"}
Jul 22 17:08:32.218950 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.218908    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4" event={"ID":"e5a18a36-1a54-4469-a174-ef336122ccf2","Type":"ContainerDied","Data":"d1e2b161f0cdc37e0a8a1b7c8be54dc843ff945252af01a80205a3dc026f1ba6"}
Jul 22 17:08:32.218950 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.218929    2580 scope.go:117] "RemoveContainer" containerID="fe7c9fd5c53bd67effd51b970cbce37af86d2357d381114014b8c6716e356ea7"
Jul 22 17:08:32.228000 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.227982    2580 scope.go:117] "RemoveContainer" containerID="fe7c9fd5c53bd67effd51b970cbce37af86d2357d381114014b8c6716e356ea7"
Jul 22 17:08:32.228295 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:08:32.228272    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe7c9fd5c53bd67effd51b970cbce37af86d2357d381114014b8c6716e356ea7\": container with ID starting with fe7c9fd5c53bd67effd51b970cbce37af86d2357d381114014b8c6716e356ea7 not found: ID does not exist" containerID="fe7c9fd5c53bd67effd51b970cbce37af86d2357d381114014b8c6716e356ea7"
Jul 22 17:08:32.228352 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.228303    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe7c9fd5c53bd67effd51b970cbce37af86d2357d381114014b8c6716e356ea7"} err="failed to get container status \"fe7c9fd5c53bd67effd51b970cbce37af86d2357d381114014b8c6716e356ea7\": rpc error: code = NotFound desc = could not find container \"fe7c9fd5c53bd67effd51b970cbce37af86d2357d381114014b8c6716e356ea7\": container with ID starting with fe7c9fd5c53bd67effd51b970cbce37af86d2357d381114014b8c6716e356ea7 not found: ID does not exist"
Jul 22 17:08:32.239256 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.239234    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"]
Jul 22 17:08:32.242512 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.242492    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-265741-dd9786675-47kx4"]
Jul 22 17:08:32.249141 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.249121    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a18a36-1a54-4469-a174-ef336122ccf2-maas-api-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:32.249141 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.249141    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5a18a36-1a54-4469-a174-ef336122ccf2-openshift-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:32.249264 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:32.249151    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvd46\" (UniqueName: \"kubernetes.io/projected/e5a18a36-1a54-4469-a174-ef336122ccf2-kube-api-access-hvd46\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:33.373109 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:33.373073    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5a18a36-1a54-4469-a174-ef336122ccf2" path="/var/lib/kubelet/pods/e5a18a36-1a54-4469-a174-ef336122ccf2/volumes"
Jul 22 17:08:36.155318 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:36.155285    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds"]
Jul 22 17:08:36.158104 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:36.158078    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-265741-crkds"]
Jul 22 17:08:37.373658 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:37.373621    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3" path="/var/lib/kubelet/pods/94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3/volumes"
Jul 22 17:08:43.115172 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.115134    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89"]
Jul 22 17:08:43.115581 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.115530    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3" containerName="revoke-keys"
Jul 22 17:08:43.115581 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.115540    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3" containerName="revoke-keys"
Jul 22 17:08:43.115581 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.115558    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5a18a36-1a54-4469-a174-ef336122ccf2" containerName="maas-api"
Jul 22 17:08:43.115581 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.115563    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5a18a36-1a54-4469-a174-ef336122ccf2" containerName="maas-api"
Jul 22 17:08:43.115729 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.115633    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5a18a36-1a54-4469-a174-ef336122ccf2" containerName="maas-api"
Jul 22 17:08:43.115729 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.115642    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="94e3e5b3-3bf5-4a4f-80f8-772a39f2dcf3" containerName="revoke-keys"
Jul 22 17:08:43.120101 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.120081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89"
Jul 22 17:08:43.122565 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.122542    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sh5d4\""
Jul 22 17:08:43.126606 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.126583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89"]
Jul 22 17:08:43.253244 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.253213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/304fdad5-b5ec-4469-bded-87057c67d733-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89\" (UID: \"304fdad5-b5ec-4469-bded-87057c67d733\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89"
Jul 22 17:08:43.354307 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.354270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/304fdad5-b5ec-4469-bded-87057c67d733-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89\" (UID: \"304fdad5-b5ec-4469-bded-87057c67d733\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89"
Jul 22 17:08:43.354889 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.354870    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/304fdad5-b5ec-4469-bded-87057c67d733-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89\" (UID: \"304fdad5-b5ec-4469-bded-87057c67d733\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89"
Jul 22 17:08:43.431971 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.431943    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89"
Jul 22 17:08:43.566196 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:43.566171    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89"]
Jul 22 17:08:43.568224 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:08:43.568197    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod304fdad5_b5ec_4469_bded_87057c67d733.slice/crio-32e0cda347719477c2b0f360679084f9feb7c2bb3a69fc0ca7673bedda784529 WatchSource:0}: Error finding container 32e0cda347719477c2b0f360679084f9feb7c2bb3a69fc0ca7673bedda784529: Status 404 returned error can't find the container with id 32e0cda347719477c2b0f360679084f9feb7c2bb3a69fc0ca7673bedda784529
Jul 22 17:08:44.286169 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:44.286134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89" event={"ID":"304fdad5-b5ec-4469-bded-87057c67d733","Type":"ContainerStarted","Data":"e8ae8aa11d3e3538f96e45251592b853d417aebd93fcd6119724ac514d2711bb"}
Jul 22 17:08:44.286562 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:44.286188    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89" event={"ID":"304fdad5-b5ec-4469-bded-87057c67d733","Type":"ContainerStarted","Data":"32e0cda347719477c2b0f360679084f9feb7c2bb3a69fc0ca7673bedda784529"}
Jul 22 17:08:44.303496 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:44.303450    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89" podStartSLOduration=1.303435072 podStartE2EDuration="1.303435072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:08:44.301082632 +0000 UTC m=+2753.653358653" watchObservedRunningTime="2026-07-22 17:08:44.303435072 +0000 UTC m=+2753.655711092"
Jul 22 17:08:45.293182 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:45.293152    2580 generic.go:356] "Generic (PLEG): container finished" podID="304fdad5-b5ec-4469-bded-87057c67d733" containerID="e8ae8aa11d3e3538f96e45251592b853d417aebd93fcd6119724ac514d2711bb" exitCode=0
Jul 22 17:08:45.293583 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:45.293201    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89" event={"ID":"304fdad5-b5ec-4469-bded-87057c67d733","Type":"ContainerDied","Data":"e8ae8aa11d3e3538f96e45251592b853d417aebd93fcd6119724ac514d2711bb"}
Jul 22 17:08:46.428545 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:46.428511    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89"
Jul 22 17:08:46.482055 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:46.480029    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/304fdad5-b5ec-4469-bded-87057c67d733-maas-api-service-ca\") pod \"304fdad5-b5ec-4469-bded-87057c67d733\" (UID: \"304fdad5-b5ec-4469-bded-87057c67d733\") "
Jul 22 17:08:46.482055 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:46.480872    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/304fdad5-b5ec-4469-bded-87057c67d733-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "304fdad5-b5ec-4469-bded-87057c67d733" (UID: "304fdad5-b5ec-4469-bded-87057c67d733"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:08:46.581717 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:46.581631    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/304fdad5-b5ec-4469-bded-87057c67d733-maas-api-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:47.305334 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:47.305302    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89"
Jul 22 17:08:47.305513 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:47.305302    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89" event={"ID":"304fdad5-b5ec-4469-bded-87057c67d733","Type":"ContainerDied","Data":"32e0cda347719477c2b0f360679084f9feb7c2bb3a69fc0ca7673bedda784529"}
Jul 22 17:08:47.305513 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:47.305469    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32e0cda347719477c2b0f360679084f9feb7c2bb3a69fc0ca7673bedda784529"
Jul 22 17:08:51.718746 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:51.718711    2580 scope.go:117] "RemoveContainer" containerID="812d0c0654550095c4ec6a18630f1f554a12b4561ee23aeef1913ccd4884ba4c"
Jul 22 17:08:53.474589 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:53.474546    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"]
Jul 22 17:08:53.475066 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:53.474811    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222" podUID="2013a23c-77c4-49cf-a989-287d84825ac9" containerName="maas-api" containerID="cri-o://ab60f50dedd3a6ce2bda7a398d43ecd884141c2970291bbe3129f145c3a21a68" gracePeriod=30
Jul 22 17:08:53.724392 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:53.724370    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:08:53.745668 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:53.745607    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2013a23c-77c4-49cf-a989-287d84825ac9-maas-api-tls\") pod \"2013a23c-77c4-49cf-a989-287d84825ac9\" (UID: \"2013a23c-77c4-49cf-a989-287d84825ac9\") "
Jul 22 17:08:53.745778 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:53.745691    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6shcm\" (UniqueName: \"kubernetes.io/projected/2013a23c-77c4-49cf-a989-287d84825ac9-kube-api-access-6shcm\") pod \"2013a23c-77c4-49cf-a989-287d84825ac9\" (UID: \"2013a23c-77c4-49cf-a989-287d84825ac9\") "
Jul 22 17:08:53.745778 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:53.745726    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2013a23c-77c4-49cf-a989-287d84825ac9-openshift-service-ca\") pod \"2013a23c-77c4-49cf-a989-287d84825ac9\" (UID: \"2013a23c-77c4-49cf-a989-287d84825ac9\") "
Jul 22 17:08:53.746146 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:53.746121    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2013a23c-77c4-49cf-a989-287d84825ac9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2013a23c-77c4-49cf-a989-287d84825ac9" (UID: "2013a23c-77c4-49cf-a989-287d84825ac9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:08:53.747692 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:53.747664    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2013a23c-77c4-49cf-a989-287d84825ac9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2013a23c-77c4-49cf-a989-287d84825ac9" (UID: "2013a23c-77c4-49cf-a989-287d84825ac9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:08:53.747942 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:53.747917    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2013a23c-77c4-49cf-a989-287d84825ac9-kube-api-access-6shcm" (OuterVolumeSpecName: "kube-api-access-6shcm") pod "2013a23c-77c4-49cf-a989-287d84825ac9" (UID: "2013a23c-77c4-49cf-a989-287d84825ac9"). InnerVolumeSpecName "kube-api-access-6shcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:08:53.847207 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:53.847177    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2013a23c-77c4-49cf-a989-287d84825ac9-maas-api-tls\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:53.847207 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:53.847203    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6shcm\" (UniqueName: \"kubernetes.io/projected/2013a23c-77c4-49cf-a989-287d84825ac9-kube-api-access-6shcm\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:53.847207 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:53.847212    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2013a23c-77c4-49cf-a989-287d84825ac9-openshift-service-ca\") on node \"ip-10-0-142-32.ec2.internal\" DevicePath \"\""
Jul 22 17:08:54.343783 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:54.343744    2580 generic.go:356] "Generic (PLEG): container finished" podID="2013a23c-77c4-49cf-a989-287d84825ac9" containerID="ab60f50dedd3a6ce2bda7a398d43ecd884141c2970291bbe3129f145c3a21a68" exitCode=0
Jul 22 17:08:54.343783 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:54.343788    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"
Jul 22 17:08:54.343988 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:54.343821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222" event={"ID":"2013a23c-77c4-49cf-a989-287d84825ac9","Type":"ContainerDied","Data":"ab60f50dedd3a6ce2bda7a398d43ecd884141c2970291bbe3129f145c3a21a68"}
Jul 22 17:08:54.343988 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:54.343877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222" event={"ID":"2013a23c-77c4-49cf-a989-287d84825ac9","Type":"ContainerDied","Data":"ca98d66fd0ce098cb78498363eaced6ba61492f5b1ba8c26dcdbed54cfe436ab"}
Jul 22 17:08:54.343988 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:54.343901    2580 scope.go:117] "RemoveContainer" containerID="ab60f50dedd3a6ce2bda7a398d43ecd884141c2970291bbe3129f145c3a21a68"
Jul 22 17:08:54.353595 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:54.353577    2580 scope.go:117] "RemoveContainer" containerID="ab60f50dedd3a6ce2bda7a398d43ecd884141c2970291bbe3129f145c3a21a68"
Jul 22 17:08:54.353850 ip-10-0-142-32 kubenswrapper[2580]: E0722 17:08:54.353831    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab60f50dedd3a6ce2bda7a398d43ecd884141c2970291bbe3129f145c3a21a68\": container with ID starting with ab60f50dedd3a6ce2bda7a398d43ecd884141c2970291bbe3129f145c3a21a68 not found: ID does not exist" containerID="ab60f50dedd3a6ce2bda7a398d43ecd884141c2970291bbe3129f145c3a21a68"
Jul 22 17:08:54.353905 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:54.353860    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab60f50dedd3a6ce2bda7a398d43ecd884141c2970291bbe3129f145c3a21a68"} err="failed to get container status \"ab60f50dedd3a6ce2bda7a398d43ecd884141c2970291bbe3129f145c3a21a68\": rpc error: code = NotFound desc = could not find container \"ab60f50dedd3a6ce2bda7a398d43ecd884141c2970291bbe3129f145c3a21a68\": container with ID starting with ab60f50dedd3a6ce2bda7a398d43ecd884141c2970291bbe3129f145c3a21a68 not found: ID does not exist"
Jul 22 17:08:54.364393 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:54.364371    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"]
Jul 22 17:08:54.367833 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:54.367814    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-13a8c9-6b659d7646-wc222"]
Jul 22 17:08:55.373229 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:55.373196    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2013a23c-77c4-49cf-a989-287d84825ac9" path="/var/lib/kubelet/pods/2013a23c-77c4-49cf-a989-287d84825ac9/volumes"
Jul 22 17:08:58.176166 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:58.176131    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89"]
Jul 22 17:08:58.177948 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:58.177925    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-13a8c9-w2q89"]
Jul 22 17:08:59.372372 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:08:59.372335    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="304fdad5-b5ec-4469-bded-87057c67d733" path="/var/lib/kubelet/pods/304fdad5-b5ec-4469-bded-87057c67d733/volumes"
Jul 22 17:09:10.647933 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:10.647906    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d779b9754-w5pdb_690f674d-2a9f-4c35-8df3-3a80a2911d3e/manager/0.log"
Jul 22 17:09:10.989944 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:10.989870    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b566c8c6-hqfwj_7a7d805f-9c16-4862-afe5-e18aef50e568/copy-manifests/0.log"
Jul 22 17:09:10.995879 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:10.995861    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b566c8c6-hqfwj_7a7d805f-9c16-4862-afe5-e18aef50e568/manager/0.log"
Jul 22 17:09:11.589427 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:11.589398    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-86764bbb8-pbrsc_64020149-f5e3-4e7c-bafa-46b5c363fdbb/maas-api/0.log"
Jul 22 17:09:13.968386 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:13.968271    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b8gxc_e87d06d2-1c93-4c2e-a473-18eca2c46d9d/manager/0.log"
Jul 22 17:09:14.651464 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:14.651436    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d7df686d9-w2w9t_def25e33-b1a7-469f-a8e3-bd40d61249f9/kube-auth-proxy/0.log"
Jul 22 17:09:14.881783 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:14.881752    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jn648_b11c5d18-4916-42d6-8154-9c8ed61df8f8/payload-pre-processing/0.log"
Jul 22 17:09:15.565495 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:15.565465    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-mb8sw_adbd5968-ae2a-4c38-b06a-4927125a2100/main/0.log"
Jul 22 17:09:15.778317 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:15.778284    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7dnb4_c2fad8cf-9dc2-45b3-9240-4bde2ec49362/main/0.log"
Jul 22 17:09:15.997410 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:15.997385    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-8l98m_b3592305-7c2a-4fe0-8788-46c5f89f0984/main/0.log"
Jul 22 17:09:24.148092 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:24.148063    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x296k_dce853aa-d400-49b5-8902-cb4bf7e2c732/global-pull-secret-syncer/0.log"
Jul 22 17:09:24.271277 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:24.271245    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gm4w2_3f367069-f513-4d98-8aae-722c4b6dd495/konnectivity-agent/0.log"
Jul 22 17:09:24.342203 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:24.342170    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-32.ec2.internal_6e9fcf95a14b3457c9d6d94083569909/haproxy/0.log"
Jul 22 17:09:29.905937 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:29.905909    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b8gxc_e87d06d2-1c93-4c2e-a473-18eca2c46d9d/manager/0.log"
Jul 22 17:09:31.480268 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:31.480238    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64f9da1-af5a-4f1d-afe8-8566ddaa824b/alertmanager/0.log"
Jul 22 17:09:31.509458 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:31.509436    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64f9da1-af5a-4f1d-afe8-8566ddaa824b/config-reloader/0.log"
Jul 22 17:09:31.534377 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:31.534359    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64f9da1-af5a-4f1d-afe8-8566ddaa824b/kube-rbac-proxy-web/0.log"
Jul 22 17:09:31.561391 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:31.561373    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64f9da1-af5a-4f1d-afe8-8566ddaa824b/kube-rbac-proxy/0.log"
Jul 22 17:09:31.587934 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:31.587907    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64f9da1-af5a-4f1d-afe8-8566ddaa824b/kube-rbac-proxy-metric/0.log"
Jul 22 17:09:31.605399 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:31.605377    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64f9da1-af5a-4f1d-afe8-8566ddaa824b/prom-label-proxy/0.log"
Jul 22 17:09:31.629584 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:31.629561    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64f9da1-af5a-4f1d-afe8-8566ddaa824b/init-config-reloader/0.log"
Jul 22 17:09:31.695560 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:31.695528    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-wfmdq_3f92cae0-2bcd-4330-8786-ddea0a803ea7/kube-state-metrics/0.log"
Jul 22 17:09:31.713728 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:31.713705    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-wfmdq_3f92cae0-2bcd-4330-8786-ddea0a803ea7/kube-rbac-proxy-main/0.log"
Jul 22 17:09:31.734794 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:31.734720    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-wfmdq_3f92cae0-2bcd-4330-8786-ddea0a803ea7/kube-rbac-proxy-self/0.log"
Jul 22 17:09:31.771397 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:31.771370    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c75c584d6-8hkbl_ad098e57-57db-497b-85d3-a919ecbf3dce/metrics-server/0.log"
Jul 22 17:09:31.806930 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:31.806899    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-hmwzf_39de0651-9bb7-4640-a69f-94c984485dd9/monitoring-plugin/0.log"
Jul 22 17:09:32.002159 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.002079    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q7jnp_2aa76515-4335-4435-ab78-78492c7b83f8/node-exporter/0.log"
Jul 22 17:09:32.022935 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.022910    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q7jnp_2aa76515-4335-4435-ab78-78492c7b83f8/kube-rbac-proxy/0.log"
Jul 22 17:09:32.045177 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.045153    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q7jnp_2aa76515-4335-4435-ab78-78492c7b83f8/init-textfile/0.log"
Jul 22 17:09:32.072749 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.072726    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4m6f7_208a0947-cccd-4830-a739-683d3c8a6dac/kube-rbac-proxy-main/0.log"
Jul 22 17:09:32.095115 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.095095    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4m6f7_208a0947-cccd-4830-a739-683d3c8a6dac/kube-rbac-proxy-self/0.log"
Jul 22 17:09:32.117091 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.117062    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-4m6f7_208a0947-cccd-4830-a739-683d3c8a6dac/openshift-state-metrics/0.log"
Jul 22 17:09:32.161347 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.161325    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c70aa80e-a948-44a7-bea9-f59c951a238d/prometheus/0.log"
Jul 22 17:09:32.182834 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.182813    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c70aa80e-a948-44a7-bea9-f59c951a238d/config-reloader/0.log"
Jul 22 17:09:32.203964 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.203942    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c70aa80e-a948-44a7-bea9-f59c951a238d/thanos-sidecar/0.log"
Jul 22 17:09:32.225604 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.225589    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c70aa80e-a948-44a7-bea9-f59c951a238d/kube-rbac-proxy-web/0.log"
Jul 22 17:09:32.248762 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.248747    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c70aa80e-a948-44a7-bea9-f59c951a238d/kube-rbac-proxy/0.log"
Jul 22 17:09:32.270059 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.269994    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c70aa80e-a948-44a7-bea9-f59c951a238d/kube-rbac-proxy-thanos/0.log"
Jul 22 17:09:32.290304 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.290288    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c70aa80e-a948-44a7-bea9-f59c951a238d/init-config-reloader/0.log"
Jul 22 17:09:32.319495 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.319477    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-wj5zd_507c9870-86fa-4388-b8ba-433bc5c528dd/prometheus-operator/0.log"
Jul 22 17:09:32.338180 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.338164    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-wj5zd_507c9870-86fa-4388-b8ba-433bc5c528dd/kube-rbac-proxy/0.log"
Jul 22 17:09:32.363101 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.363076    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-4dfkr_ae1613d5-4a55-4aac-8fc1-3723fd760a24/prometheus-operator-admission-webhook/0.log"
Jul 22 17:09:32.392968 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.392939    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8bd5465d9-s47tg_6863f7ee-c966-4e64-b433-52c305dd55a2/telemeter-client/0.log"
Jul 22 17:09:32.415105 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.415069    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8bd5465d9-s47tg_6863f7ee-c966-4e64-b433-52c305dd55a2/reload/0.log"
Jul 22 17:09:32.437901 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.437876    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8bd5465d9-s47tg_6863f7ee-c966-4e64-b433-52c305dd55a2/kube-rbac-proxy/0.log"
Jul 22 17:09:32.471888 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.471867    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9d846c47-6h5tq_be3261be-5dcd-4bef-9ead-16434d548b18/thanos-query/0.log"
Jul 22 17:09:32.494655 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.494629    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9d846c47-6h5tq_be3261be-5dcd-4bef-9ead-16434d548b18/kube-rbac-proxy-web/0.log"
Jul 22 17:09:32.515140 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.515121    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9d846c47-6h5tq_be3261be-5dcd-4bef-9ead-16434d548b18/kube-rbac-proxy/0.log"
Jul 22 17:09:32.540626 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.540572    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9d846c47-6h5tq_be3261be-5dcd-4bef-9ead-16434d548b18/prom-label-proxy/0.log"
Jul 22 17:09:32.570405 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.570385    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9d846c47-6h5tq_be3261be-5dcd-4bef-9ead-16434d548b18/kube-rbac-proxy-rules/0.log"
Jul 22 17:09:32.592827 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:32.592806    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9d846c47-6h5tq_be3261be-5dcd-4bef-9ead-16434d548b18/kube-rbac-proxy-metrics/0.log"
Jul 22 17:09:34.077505 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.077473    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"]
Jul 22 17:09:34.078079 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.078058    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2013a23c-77c4-49cf-a989-287d84825ac9" containerName="maas-api"
Jul 22 17:09:34.078079 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.078081    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2013a23c-77c4-49cf-a989-287d84825ac9" containerName="maas-api"
Jul 22 17:09:34.078232 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.078113    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="304fdad5-b5ec-4469-bded-87057c67d733" containerName="revoke-keys"
Jul 22 17:09:34.078232 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.078121    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="304fdad5-b5ec-4469-bded-87057c67d733" containerName="revoke-keys"
Jul 22 17:09:34.078232 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.078223    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="304fdad5-b5ec-4469-bded-87057c67d733" containerName="revoke-keys"
Jul 22 17:09:34.078330 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.078239    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2013a23c-77c4-49cf-a989-287d84825ac9" containerName="maas-api"
Jul 22 17:09:34.081726 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.081707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.084200 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.084180    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2qjm\"/\"kube-root-ca.crt\""
Jul 22 17:09:34.084284 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.084221    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s2qjm\"/\"default-dockercfg-2dmcn\""
Jul 22 17:09:34.085182 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.085164    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s2qjm\"/\"openshift-service-ca.crt\""
Jul 22 17:09:34.091661 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.091637    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"]
Jul 22 17:09:34.113859 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.113834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-sys\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.113977 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.113876    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-podres\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.113977 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.113898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-lib-modules\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.114082 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.113977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xtvq\" (UniqueName: \"kubernetes.io/projected/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-kube-api-access-5xtvq\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.114082 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.114047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-proc\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.215062 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.215005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xtvq\" (UniqueName: \"kubernetes.io/projected/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-kube-api-access-5xtvq\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.215226 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.215101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-proc\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.215226 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.215147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-sys\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.215226 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.215195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-podres\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.215226 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.215223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-lib-modules\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.215576 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.215551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-lib-modules\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.215697 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.215661    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-proc\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.215697 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.215691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-sys\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.215902 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.215812    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-podres\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.224619 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.224587    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xtvq\" (UniqueName: \"kubernetes.io/projected/f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac-kube-api-access-5xtvq\") pod \"perf-node-gather-daemonset-rrbvb\" (UID: \"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac\") " pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.392708 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.392685    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:34.526947 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.526920    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"]
Jul 22 17:09:34.529660 ip-10-0-142-32 kubenswrapper[2580]: W0722 17:09:34.529637    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf0e8e89a_c9ce_4927_ba5d_f2bc9f6ffeac.slice/crio-59689c4676e8c608e89b1e6b1ca76d91cac29711094aad27e13e357570942343 WatchSource:0}: Error finding container 59689c4676e8c608e89b1e6b1ca76d91cac29711094aad27e13e357570942343: Status 404 returned error can't find the container with id 59689c4676e8c608e89b1e6b1ca76d91cac29711094aad27e13e357570942343
Jul 22 17:09:34.540515 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:34.540489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb" event={"ID":"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac","Type":"ContainerStarted","Data":"59689c4676e8c608e89b1e6b1ca76d91cac29711094aad27e13e357570942343"}
Jul 22 17:09:35.546747 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:35.546712    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb" event={"ID":"f0e8e89a-c9ce-4927-ba5d-f2bc9f6ffeac","Type":"ContainerStarted","Data":"37044bd380809dedfc7adaf9780400079a83bd3650d4befae7cc17f9fb07a3b1"}
Jul 22 17:09:35.547187 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:35.546789    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:35.563437 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:35.563377    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb" podStartSLOduration=1.5633650019999998 podStartE2EDuration="1.563365002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:09:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:09:35.561576914 +0000 UTC m=+2804.913852927" watchObservedRunningTime="2026-07-22 17:09:35.563365002 +0000 UTC m=+2804.915641021"
Jul 22 17:09:36.715509 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:36.715481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k7qtt_ce82ee36-977e-423a-9e0f-25d0359aaf21/dns/0.log"
Jul 22 17:09:36.739675 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:36.739647    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k7qtt_ce82ee36-977e-423a-9e0f-25d0359aaf21/kube-rbac-proxy/0.log"
Jul 22 17:09:36.763192 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:36.763165    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-65tvf_6cd5b8a2-941c-4540-a348-5faea8a1dc5f/dns-node-resolver/0.log"
Jul 22 17:09:37.430811 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:37.430780    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zbdf2_e6ab3c7a-0c2b-4baf-a92a-c641f928ddd6/node-ca/0.log"
Jul 22 17:09:38.665366 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:38.665313    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d7df686d9-w2w9t_def25e33-b1a7-469f-a8e3-bd40d61249f9/kube-auth-proxy/0.log"
Jul 22 17:09:38.753033 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:38.752991    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jn648_b11c5d18-4916-42d6-8154-9c8ed61df8f8/payload-pre-processing/0.log"
Jul 22 17:09:39.448570 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:39.448537    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5bb8q_5f5cfb28-29dd-42d3-8eba-1154596ddbe7/serve-healthcheck-canary/0.log"
Jul 22 17:09:40.060932 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:40.060903    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mtv44_8a425a4f-8adf-4012-95c7-580429622b1d/kube-rbac-proxy/0.log"
Jul 22 17:09:40.083080 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:40.083053    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mtv44_8a425a4f-8adf-4012-95c7-580429622b1d/exporter/0.log"
Jul 22 17:09:40.107696 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:40.107673    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mtv44_8a425a4f-8adf-4012-95c7-580429622b1d/extractor/0.log"
Jul 22 17:09:41.562450 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:41.562421    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s2qjm/perf-node-gather-daemonset-rrbvb"
Jul 22 17:09:42.544389 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:42.544326    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d779b9754-w5pdb_690f674d-2a9f-4c35-8df3-3a80a2911d3e/manager/0.log"
Jul 22 17:09:42.663681 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:42.663652    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b566c8c6-hqfwj_7a7d805f-9c16-4862-afe5-e18aef50e568/manager/0.log"
Jul 22 17:09:42.686653 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:42.686629    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b566c8c6-hqfwj_7a7d805f-9c16-4862-afe5-e18aef50e568/copy-manifests/0.log"
Jul 22 17:09:44.261892 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:44.261824    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65dd5d6b6d-4nd7m_7845b25b-66dc-4a20-b417-778775a23f61/manager/0.log"
Jul 22 17:09:44.894216 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:44.894187    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d7df686d9-w2w9t_def25e33-b1a7-469f-a8e3-bd40d61249f9/kube-auth-proxy/0.log"
Jul 22 17:09:44.957251 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:44.957219    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jn648_b11c5d18-4916-42d6-8154-9c8ed61df8f8/payload-pre-processing/0.log"
Jul 22 17:09:46.450207 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:46.450178    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d7df686d9-w2w9t_def25e33-b1a7-469f-a8e3-bd40d61249f9/kube-auth-proxy/0.log"
Jul 22 17:09:46.518095 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:46.518067    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jn648_b11c5d18-4916-42d6-8154-9c8ed61df8f8/payload-pre-processing/0.log"
Jul 22 17:09:50.683228 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:50.683148    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q49k_fcdfe093-5973-4a2e-a507-e7783f3fc908/kube-multus-additional-cni-plugins/0.log"
Jul 22 17:09:50.705296 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:50.705272    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q49k_fcdfe093-5973-4a2e-a507-e7783f3fc908/egress-router-binary-copy/0.log"
Jul 22 17:09:50.725572 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:50.725547    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q49k_fcdfe093-5973-4a2e-a507-e7783f3fc908/cni-plugins/0.log"
Jul 22 17:09:50.749132 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:50.749113    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q49k_fcdfe093-5973-4a2e-a507-e7783f3fc908/bond-cni-plugin/0.log"
Jul 22 17:09:50.770340 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:50.770319    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q49k_fcdfe093-5973-4a2e-a507-e7783f3fc908/routeoverride-cni/0.log"
Jul 22 17:09:50.790936 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:50.790912    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q49k_fcdfe093-5973-4a2e-a507-e7783f3fc908/whereabouts-cni-bincopy/0.log"
Jul 22 17:09:50.811571 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:50.811549    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q49k_fcdfe093-5973-4a2e-a507-e7783f3fc908/whereabouts-cni/0.log"
Jul 22 17:09:51.158783 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:51.158756    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mkxwr_57478d6c-8207-4831-ab7d-43c274460043/kube-multus/0.log"
Jul 22 17:09:51.226738 ip-10-0-142-32 kubenswrapper[2580]: I0722 17:09:51.226705    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r8tkj_6b538e50-43f8-44c8-ab6f-5188c3b0a6d0/network-metrics-daemon/0.log"