Jul 19 14:36:29.500506 ip-10-0-134-165 systemd[1]: Starting Kubernetes Kubelet...
Jul 19 14:36:30.786101 ip-10-0-134-165 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 19 14:36:30.786101 ip-10-0-134-165 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 19 14:36:30.786101 ip-10-0-134-165 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 19 14:36:30.786101 ip-10-0-134-165 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 19 14:36:30.786101 ip-10-0-134-165 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 19 14:36:30.787949 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.787857    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 19 14:36:30.793969 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.793954    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:36:30.793969 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.793969    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.793973    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.793976    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.793979    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.793982    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.793985    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.793988    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.793991    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.793995    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.793997    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794000    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794003    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794006    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794008    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794011    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794014    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794016    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794019    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794022    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794025    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:36:30.794030 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794027    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794030    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794033    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794043    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794046    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794049    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794051    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794054    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794058    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794062    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794072    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794075    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794077    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794080    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794083    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794085    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794088    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794090    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794092    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:36:30.794493 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794095    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794099    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794102    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794105    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794108    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794110    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794112    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794115    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794117    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794120    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794123    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794125    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794128    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794130    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794133    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794136    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794139    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794141    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794144    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794146    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:36:30.794919 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794149    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794152    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794154    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794157    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794159    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794162    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794164    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794167    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794184    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794187    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794191    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794194    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794196    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794199    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794202    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794205    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794207    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794210    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794212    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794215    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:36:30.795404 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794217    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794220    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794222    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794225    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794227    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794231    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794235    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794238    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794241    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794244    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794247    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794250    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794253    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794255    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794258    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794260    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794263    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794273    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.794276    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795092    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:36:30.795931 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795100    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795103    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795107    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795110    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795113    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795117    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795119    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795123    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795126    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795129    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795132    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795134    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795137    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795140    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795142    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795145    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795148    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795150    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795153    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:36:30.796411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795157    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795160    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795162    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795165    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795168    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795187    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795190    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795193    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795196    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795198    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795201    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795204    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795206    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795209    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795211    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795214    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795216    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795219    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795221    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795224    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:36:30.796909 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795227    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795229    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795232    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795235    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795238    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795240    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795243    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795247    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795251    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795254    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795257    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795259    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795263    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795266    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795269    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795271    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795275    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795278    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795281    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:36:30.797386 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795284    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795288    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795292    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795295    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795298    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795301    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795304    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795306    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795309    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795311    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795314    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795316    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795325    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795327    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795330    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795332    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795335    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795338    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795340    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795343    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:36:30.797865 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795346    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795348    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795351    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795353    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795356    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795359    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795362    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795365    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795367    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795370    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795372    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795375    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795377    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795380    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795382    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795385    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795387    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795390    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795392    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.795395    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:36:30.798371 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796077    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796083    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796087    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796090    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796093    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796096    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796099    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796102    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796104    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796108    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796110    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796113    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796115    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796118    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796120    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796123    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796125    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796128    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796131    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796134    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:36:30.798842 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796136    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796139    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796141    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796144    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796147    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796149    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796152    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796154    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796157    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796160    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796162    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796165    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796167    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796186    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796189    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796191    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796194    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796197    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796200    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796202    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:36:30.799355 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796205    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796208    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796211    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796213    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796216    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796219    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796222    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796225    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796227    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796230    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796232    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796235    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796237    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796240    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796242    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796247    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796249    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796252    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796254    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796257    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:36:30.799839 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796260    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796262    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796265    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796267    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796271    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796275    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796278    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796281    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796285    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796288    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796292    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796296    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796299    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796302    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796305    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796308    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796311    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796314    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:36:30.800324 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796316    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796319    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796321    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796324    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796326    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796329    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796331    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796333    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796336    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796339    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796341    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796344    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796346    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796349    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796351    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796353    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796356    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796358    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796361    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796363    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:36:30.800759 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.796366    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796432    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796444    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796450    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796455    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796460    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796463    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796467    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796472    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796475    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796478    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796482    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796485    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796488    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796491    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796494    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796497    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796499    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796502    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796508    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796511    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796514    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796517    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796520    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 19 14:36:30.801238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796524    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796527    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796530    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796533    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796537    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796540    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796542    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796545    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796549    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796553    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796556    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796559    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796562    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796565    2581 flags.go:64] FLAG: --enable-server="true"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796568    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796576    2581 flags.go:64] FLAG: --event-burst="100"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796579    2581 flags.go:64] FLAG: --event-qps="50"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796582    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796585    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796589    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796592    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796595    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796598    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796601    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796604    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 19 14:36:30.801796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796607    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796610    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796612    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796615    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796618    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796620    2581 flags.go:64] FLAG: --feature-gates=""
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796624    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796627    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796630    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796633    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796636    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796639    2581 flags.go:64] FLAG: --help="false"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796642    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-134-165.ec2.internal"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796645    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796648    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796651    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796655    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796659    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796662    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796665    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796668    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796671    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796675    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796679    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 19 14:36:30.802421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796682    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796685    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796687    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796690    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796693    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796696    2581 flags.go:64] FLAG: --lock-file=""
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796698    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796702    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796704    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796710    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796712    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796715    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796718    2581 flags.go:64] FLAG: --logging-format="text"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796721    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796724    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796727    2581 flags.go:64] FLAG: --manifest-url=""
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796730    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796734    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796737    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796741    2581 flags.go:64] FLAG: --max-pods="110"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796744    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796747    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796750    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796753    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796756    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 19 14:36:30.803039 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796759    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796762    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796769    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796772    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796774    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796780    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796784    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796789    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796792    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796795    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796798    2581 flags.go:64] FLAG: --port="10250"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796801    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796804    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-080d558e46f2d201b"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796807    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796810    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796813    2581 flags.go:64] FLAG: --register-node="true"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796816    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796819    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796822    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796825    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796827    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796831    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796834    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796836    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796839    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 19 14:36:30.803652 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796842    2581 flags.go:64] FLAG: --runonce="false"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796845    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796847    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796850    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796853    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796859    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796862    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796865    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796868    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796871    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796874    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796877    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796881    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796884    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796888    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796891    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796896    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796899    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796902    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796906    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796909    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796913    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796916    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796919    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796922    2581 flags.go:64] FLAG: --v="2"
Jul 19 14:36:30.804270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796925    2581 flags.go:64] FLAG: --version="false"
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796929    2581 flags.go:64] FLAG: --vmodule=""
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796933    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.796936    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797048    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797051    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797054    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797057    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797060    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797062    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797065    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797069    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797073    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797075    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797078    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797081    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797083    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797086    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797089    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797093    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:36:30.804856 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797096    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797098    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797101    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797105    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797109    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797112    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797115    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797117    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797120    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797122    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797125    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797127    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797130    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797132    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797135    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797137    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797140    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797142    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797145    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:36:30.805341 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797147    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797150    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797153    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797155    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797158    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797161    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797195    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797200    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797203    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797206    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797209    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797212    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797216    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797219    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797221    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797224    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797228    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797230    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797233    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797236    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:36:30.805792 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797238    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797241    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797244    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797246    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797249    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797251    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797254    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797256    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797259    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797262    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797264    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797268    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797271    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797274    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797277    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797280    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797282    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797287    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797289    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:36:30.806296 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797292    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797295    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797298    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797301    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797303    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797308    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797312    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797315    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797318    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797321    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797324    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797326    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797329    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797331    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797334    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797337    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797339    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797342    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797344    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:36:30.806755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797347    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797349    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797352    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797354    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797357    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.797359    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.797889    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.804842    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.804857    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.805407    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.805414    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805473    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805478    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805481    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805484    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:36:30.807230 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805487    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805490    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805492    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805495    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805498    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805500    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805503    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805505    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805508    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805511    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805514    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805517    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805519    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805522    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805525    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805527    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805531    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805535    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805538    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805541    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:36:30.807590 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805544    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805546    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805549    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805551    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805554    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805558    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805561    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805564    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805566    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805569    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805571    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805574    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805576    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805579    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805582    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805584    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805587    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805589    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805593    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:36:30.808084 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805597    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805600    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805603    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805606    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805609    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805612    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805615    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805617    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805620    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805623    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805626    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805629    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805632    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805634    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805637    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805640    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805642    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805646    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805650    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:36:30.808555 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805653    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805656    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805658    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805661    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805663    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805666    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805668    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805671    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805673    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805676    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805678    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805681    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805683    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805686    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805688    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805690    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805693    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805695    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805698    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805700    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:36:30.809015 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805702    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805705    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805707    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805710    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805712    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805715    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805718    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805720    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805723    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805726    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805728    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805731    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805733    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805736    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805739    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805742    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:36:30.809504 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805744    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.805749    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805862    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805868    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805871    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805873    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805876    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805879    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805882    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805884    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805887    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805890    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805893    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805895    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805898    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:36:30.809868 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805900    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805903    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805905    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805908    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805910    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805912    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805915    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805917    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805921    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805925    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805929    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805932    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805934    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805938    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805940    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805944    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805947    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805949    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805952    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:36:30.810263 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805955    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805957    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805960    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805962    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805965    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805967    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805970    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805972    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805975    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805977    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805979    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805982    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805984    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805987    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805989    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805992    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805994    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805996    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.805999    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806001    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:36:30.810705 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806004    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806006    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806008    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806011    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806013    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806016    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806019    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806021    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806024    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806027    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806030    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806033    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806035    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806037    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806040    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806042    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806045    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806047    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806049    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806052    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:36:30.811160 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806055    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806057    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806059    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806062    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806064    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806067    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806070    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806072    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806074    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806081    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806084    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806087    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806091    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806093    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806097    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806100    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806103    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806106    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806109    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:36:30.811642 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806112    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:36:30.812094 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806115    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:36:30.812094 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806117    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:36:30.812094 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806121    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:36:30.812094 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806123    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:36:30.812094 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806126    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:36:30.812094 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806128    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:36:30.812094 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:30.806131    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:36:30.812094 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.806136    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 19 14:36:30.812094 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.806280    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 19 14:36:30.812094 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.808132    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 19 14:36:30.812094 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.809330    2581 server.go:1019] "Starting client certificate rotation"
Jul 19 14:36:30.812094 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.809426    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 19 14:36:30.812094 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.809456    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 19 14:36:30.812431 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.812100    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 19 14:36:30.814728 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.814693    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 19 14:36:30.824810 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.824789    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 19 14:36:30.827343 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.827327    2581 log.go:25] "Validated CRI v1 image API"
Jul 19 14:36:30.828387 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.828372    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 19 14:36:30.831165 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.831146    2581 fs.go:135] Filesystem UUIDs: map[34bb0c7b-c49d-4ed3-a818-6da549367be5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fe49a91c-b3e3-4aa1-851e-530abae2b313:/dev/nvme0n1p4]
Jul 19 14:36:30.831237 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.831165    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 19 14:36:30.836546 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.836528    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 19 14:36:30.836853 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.836742    2581 manager.go:216] Machine: {Timestamp:2026-07-19 14:36:30.835396546 +0000 UTC m=+1.227958923 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101178 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ce8aba8c791c549c154d5cf039f3 SystemUUID:ec28ce8a-ba8c-791c-549c-154d5cf039f3 BootID:4409c478-bcff-4d1a-85d6-df368e6d481a Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:56:be:d8:75:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:56:be:d8:75:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:03:38:30:2f:35 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 19 14:36:30.836853 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.836849    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 19 14:36:30.836942 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.836933    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 19 14:36:30.838617 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.838588    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 19 14:36:30.838757 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.838621    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-165.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 19 14:36:30.839348 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.839339    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 19 14:36:30.839379 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.839350    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 19 14:36:30.839379 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.839358    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 19 14:36:30.840498 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.840487    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 19 14:36:30.841433 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.841423    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 19 14:36:30.844957 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.844938    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 19 14:36:30.845054 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.845045    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 19 14:36:30.845096 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.845073    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 19 14:36:30.845096 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.845083    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 19 14:36:30.845159 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.845099    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 19 14:36:30.845159 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.845128    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 19 14:36:30.845159 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.845136    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 19 14:36:30.845532 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.845519    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 19 14:36:30.845582 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.845546    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 19 14:36:30.847722 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.847706    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 19 14:36:30.849038 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849022    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 19 14:36:30.849102 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849071    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 19 14:36:30.849778 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849766    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 19 14:36:30.849825 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849783    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 19 14:36:30.849825 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849790    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 19 14:36:30.849825 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849797    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 19 14:36:30.849825 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849814    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 19 14:36:30.849825 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849822    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 19 14:36:30.849979 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849831    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 19 14:36:30.849979 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849836    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 19 14:36:30.849979 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849842    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 19 14:36:30.849979 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849847    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 19 14:36:30.849979 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849862    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 19 14:36:30.849979 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.849867    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 19 14:36:30.851048 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.851036    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 19 14:36:30.851048 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.851048    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 19 14:36:30.853505 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.853479    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8mzpz"
Jul 19 14:36:30.855358 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.855342    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-165.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 19 14:36:30.855586 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.855573    2581 server.go:1268] "Started kubelet"
Jul 19 14:36:30.855710 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:30.855685    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 19 14:36:30.855710 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:30.855569    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 19 14:36:30.855870 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.855737    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 19 14:36:30.855870 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.855812    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 19 14:36:30.855870 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.855810    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 19 14:36:30.856554 ip-10-0-134-165 systemd[1]: Started Kubernetes Kubelet.
Jul 19 14:36:30.857204 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.856801    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 19 14:36:30.858072 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.858055    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 19 14:36:30.860441 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.860426    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8mzpz"
Jul 19 14:36:30.860850 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:30.860825    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 19 14:36:30.861224 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:30.860224    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-165.ec2.internal.18c3b7a3a5a656a9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-165.ec2.internal,UID:ip-10-0-134-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-165.ec2.internal,},FirstTimestamp:2026-07-19 14:36:30.855542441 +0000 UTC m=+1.248104820,LastTimestamp:2026-07-19 14:36:30.855542441 +0000 UTC m=+1.248104820,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-165.ec2.internal,}"
Jul 19 14:36:30.864206 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.864168    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 19 14:36:30.864206 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.864194    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 19 14:36:30.864355 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:30.864277    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:30.864666 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.864647    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 19 14:36:30.864666 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.864649    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 19 14:36:30.864778 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.864679    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 19 14:36:30.864901 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.864880    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 19 14:36:30.865012 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.864993    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 19 14:36:30.865086 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.865075    2581 factory.go:55] Registering systemd factory
Jul 19 14:36:30.865086 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.865088    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 19 14:36:30.865346 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.865334    2581 factory.go:153] Registering CRI-O factory
Jul 19 14:36:30.865346 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.865348    2581 factory.go:223] Registration of the crio container factory successfully
Jul 19 14:36:30.865470 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.865396    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 19 14:36:30.865470 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.865420    2581 factory.go:103] Registering Raw factory
Jul 19 14:36:30.865470 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.865435    2581 manager.go:1196] Started watching for new ooms in manager
Jul 19 14:36:30.865955 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.865945    2581 manager.go:349] Starting recovery of all containers
Jul 19 14:36:30.866417 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:30.866382    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 19 14:36:30.866524 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:30.866501    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 19 14:36:30.878988 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.878830    2581 manager.go:354] Recovery completed
Jul 19 14:36:30.883053 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.883041    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:36:30.885021 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.885001    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:36:30.885085 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.885038    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:36:30.885085 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.885054    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:36:30.885627 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.885606    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 19 14:36:30.885627 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.885625    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 19 14:36:30.885744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.885638    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:36:30.885744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.885644    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 19 14:36:30.886378 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.886355    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:36:30.886455 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.886385    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:36:30.886455 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.886399    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:36:30.887829 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.887817    2581 policy_none.go:49] "None policy: Start"
Jul 19 14:36:30.887880 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.887833    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 19 14:36:30.887880 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.887843    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 19 14:36:30.889837 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.889825    2581 policy_none.go:47] "Start"
Jul 19 14:36:30.926743 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.926724    2581 manager.go:337] "Starting Device Plugin manager"
Jul 19 14:36:30.926878 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:30.926775    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 19 14:36:30.926878 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.926787    2581 server.go:87] "Starting device plugin registration server"
Jul 19 14:36:30.927073 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.927060    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 19 14:36:30.927135 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.927077    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 19 14:36:30.927192 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.927157    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 19 14:36:30.927270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.927258    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 19 14:36:30.927270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.927270    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 19 14:36:30.927820 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:30.927799    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 19 14:36:30.927897 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:30.927856    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:30.959850 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.959821    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 19 14:36:30.968015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.961211    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 19 14:36:30.968015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.961255    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 19 14:36:30.968015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.961281    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 19 14:36:30.968015 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:30.961315    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 19 14:36:30.968015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:30.963307    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:36:31.028233 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.028172    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:36:31.029127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.029107    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:36:31.029236 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.029138    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:36:31.029236 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.029151    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:36:31.029236 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.029199    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.034705 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.034687    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.034799 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:31.034712    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-165.ec2.internal\": node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:31.046136 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:31.046110    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:31.062069 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.062028    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"]
Jul 19 14:36:31.062237 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.062111    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:36:31.063510 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.063494    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:36:31.063588 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.063528    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:36:31.063588 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.063543    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:36:31.065726 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.065709    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:36:31.065848 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.065831    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.065893 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.065878    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:36:31.066107 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.066080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7880506548359367b66d0c274b80e32c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"7880506548359367b66d0c274b80e32c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.066223 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.066136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7880506548359367b66d0c274b80e32c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"7880506548359367b66d0c274b80e32c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.066441 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.066425    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:36:31.066490 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.066455    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:36:31.066490 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.066465    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:36:31.066565 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.066429    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:36:31.066565 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.066532    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:36:31.066565 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.066543    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:36:31.068726 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.068711    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.068805 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.068735    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:36:31.069476 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.069459    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:36:31.069544 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.069487    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:36:31.069544 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.069497    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:36:31.089008 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:31.088981    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-165.ec2.internal\" not found" node="ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.093514 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:31.093494    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-165.ec2.internal\" not found" node="ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.146700 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:31.146656    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:31.166403 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.166320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7880506548359367b66d0c274b80e32c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"7880506548359367b66d0c274b80e32c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.166403 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.166351    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7880506548359367b66d0c274b80e32c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"7880506548359367b66d0c274b80e32c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.166403 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.166373    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ed18d9f9ede21e451f5e83ef12c968d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-165.ec2.internal\" (UID: \"2ed18d9f9ede21e451f5e83ef12c968d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.166598 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.166422    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7880506548359367b66d0c274b80e32c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"7880506548359367b66d0c274b80e32c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.166598 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.166427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7880506548359367b66d0c274b80e32c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"7880506548359367b66d0c274b80e32c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.247531 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:31.247499    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:31.266843 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.266815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ed18d9f9ede21e451f5e83ef12c968d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-165.ec2.internal\" (UID: \"2ed18d9f9ede21e451f5e83ef12c968d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.266891 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.266860    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ed18d9f9ede21e451f5e83ef12c968d-config\") pod \"kube-apiserver-proxy-ip-10-0-134-165.ec2.internal\" (UID: \"2ed18d9f9ede21e451f5e83ef12c968d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.348314 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:31.348274    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:31.390795 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.390772    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.397161 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.397146    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:31.448974 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:31.448895    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:31.549407 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:31.549385    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:31.649959 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:31.649928    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:31.750593 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:31.750521    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:31.809105 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.809071    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 19 14:36:31.809682 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.809302    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 19 14:36:31.851500 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:31.851466    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:31.865525 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.865490    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-18 14:31:30 +0000 UTC" deadline="2028-03-04 16:19:16.372873388 +0000 UTC"
Jul 19 14:36:31.865525 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.865520    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14257h42m44.507356879s"
Jul 19 14:36:31.919667 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:31.919634    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7880506548359367b66d0c274b80e32c.slice/crio-011a5d906decb551de4c0774ef141deeb0e8f99b28023431acf32687845d4030 WatchSource:0}: Error finding container 011a5d906decb551de4c0774ef141deeb0e8f99b28023431acf32687845d4030: Status 404 returned error can't find the container with id 011a5d906decb551de4c0774ef141deeb0e8f99b28023431acf32687845d4030
Jul 19 14:36:31.919932 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:31.919916    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed18d9f9ede21e451f5e83ef12c968d.slice/crio-73b98aaed3edf3553e7f6b8471274b61673008963959e0c66fe69fb149ce7405 WatchSource:0}: Error finding container 73b98aaed3edf3553e7f6b8471274b61673008963959e0c66fe69fb149ce7405: Status 404 returned error can't find the container with id 73b98aaed3edf3553e7f6b8471274b61673008963959e0c66fe69fb149ce7405
Jul 19 14:36:31.926034 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.926014    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 14:36:31.952465 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:31.952438    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:31.964725 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.964680    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" event={"ID":"2ed18d9f9ede21e451f5e83ef12c968d","Type":"ContainerStarted","Data":"73b98aaed3edf3553e7f6b8471274b61673008963959e0c66fe69fb149ce7405"}
Jul 19 14:36:31.965629 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:31.965606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" event={"ID":"7880506548359367b66d0c274b80e32c","Type":"ContainerStarted","Data":"011a5d906decb551de4c0774ef141deeb0e8f99b28023431acf32687845d4030"}
Jul 19 14:36:32.053021 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:32.052934    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:32.153465 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:32.153422    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:32.175171 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.175148    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:36:32.254280 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:32.254243    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:32.323462 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.323390    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:36:32.354384 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:32.354330    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found"
Jul 19 14:36:32.397711 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.397672    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:36:32.464637 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.464607    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:32.473136 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.473111    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 19 14:36:32.474157 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.474136    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal"
Jul 19 14:36:32.482153 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.482049    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 19 14:36:32.841444 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.841411    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:36:32.846333 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.846312    2581 apiserver.go:52] "Watching apiserver"
Jul 19 14:36:32.852038 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.852019    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 19 14:36:32.854815 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.854790    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4hj4p","kube-system/konnectivity-agent-gtm8v","kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk","openshift-cluster-node-tuning-operator/tuned-ndp2f","openshift-dns/node-resolver-wcvsd","openshift-multus/multus-additional-cni-plugins-69b5h","openshift-multus/multus-lz9d6","openshift-image-registry/node-ca-264jl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal","openshift-multus/network-metrics-daemon-52jmh","openshift-network-diagnostics/network-check-target-ksr4t","openshift-network-operator/iptables-alerter-6787b","openshift-ovn-kubernetes/ovnkube-node-7kksm"]
Jul 19 14:36:32.857329 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.857309    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.859719 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.859699    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 19 14:36:32.859859 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.859835    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6787b"
Jul 19 14:36:32.859966 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.859882    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 19 14:36:32.859966 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.859945    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 19 14:36:32.860155 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.860116    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 19 14:36:32.860288 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.860269    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 19 14:36:32.860420 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.860400    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ggpxf\""
Jul 19 14:36:32.862114 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.862097    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.862685 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.862508    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:36:32.862685 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.862557    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 19 14:36:32.862859 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.862842    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bx6tl\""
Jul 19 14:36:32.862924 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.862859    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 19 14:36:32.864429 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.864362    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6c9kd\""
Jul 19 14:36:32.864527 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.864496    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 19 14:36:32.865573 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.865535    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 19 14:36:32.866397 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.866379    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 19 14:36:32.866907 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.866877    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 19 14:36:32.866992 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.866913    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 19 14:36:32.867526 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.867508    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 19 14:36:32.867857 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.867838    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 19 14:36:32.868044 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.868026    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.870113 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.870094    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 19 14:36:32.870268 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.870239    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.870772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.870756    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 19 14:36:32.870859 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.870769    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 19 14:36:32.870859 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.870834    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ktwws\""
Jul 19 14:36:32.872635 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.872600    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wcvsd"
Jul 19 14:36:32.872850 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.872828    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 19 14:36:32.873037 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.872941    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:36:32.873037 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.872965    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8z9bb\""
Jul 19 14:36:32.874105 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.874228 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-cni-bin\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.874228 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4994c0d-2b53-4d06-9f86-90f2e360b288-ovn-node-metrics-cert\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.874228 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874169    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdvg9\" (UniqueName: \"kubernetes.io/projected/04e03de4-06a6-40b9-b133-06b475e3bb25-kube-api-access-cdvg9\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.874228 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-host\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.874430 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-socket-dir\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.874430 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-sys-fs\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.874430 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84ef4e5f-28a8-4117-b65c-9001507529d0-tmp\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.874430 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874326    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldlw6\" (UniqueName: \"kubernetes.io/projected/84ef4e5f-28a8-4117-b65c-9001507529d0-kube-api-access-ldlw6\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.874430 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.874430 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/585a705f-24a6-4999-a1c1-cd94469c4f4a-iptables-alerter-script\") pod \"iptables-alerter-6787b\" (UID: \"585a705f-24a6-4999-a1c1-cd94469c4f4a\") " pod="openshift-network-operator/iptables-alerter-6787b"
Jul 19 14:36:32.874430 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874414    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-kubelet\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.874768 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-registration-dir\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.874768 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-kubernetes\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.874768 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874537    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-sysctl-conf\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.874862 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874794    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-527sj\""
Jul 19 14:36:32.874862 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874834    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 19 14:36:32.874923 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.874862    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 19 14:36:32.875045 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875028    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-264jl"
Jul 19 14:36:32.875247 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.875247 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp2pk\" (UniqueName: \"kubernetes.io/projected/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-kube-api-access-fp2pk\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.875247 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-systemd-units\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.875247 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-run-netns\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.875484 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-etc-openvswitch\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.875484 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4994c0d-2b53-4d06-9f86-90f2e360b288-ovnkube-config\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.875484 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-device-dir\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.875484 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875335    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-modprobe-d\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.875484 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-cnibin\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.875484 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-run-systemd\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.875484 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875407    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-var-lib-openvswitch\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.875484 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-run-ovn\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.875484 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875468    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-node-log\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-run-ovn-kubernetes\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875520    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-sysconfig\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/585a705f-24a6-4999-a1c1-cd94469c4f4a-host-slash\") pod \"iptables-alerter-6787b\" (UID: \"585a705f-24a6-4999-a1c1-cd94469c4f4a\") " pod="openshift-network-operator/iptables-alerter-6787b"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-log-socket\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4994c0d-2b53-4d06-9f86-90f2e360b288-ovnkube-script-lib\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87m5l\" (UniqueName: \"kubernetes.io/projected/b4994c0d-2b53-4d06-9f86-90f2e360b288-kube-api-access-87m5l\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-etc-selinux\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875677    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-run\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875735    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-sys\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-lib-modules\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-system-cni-dir\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875825    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fff52\" (UniqueName: \"kubernetes.io/projected/585a705f-24a6-4999-a1c1-cd94469c4f4a-kube-api-access-fff52\") pod \"iptables-alerter-6787b\" (UID: \"585a705f-24a6-4999-a1c1-cd94469c4f4a\") " pod="openshift-network-operator/iptables-alerter-6787b"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-run-openvswitch\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875898    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-sysctl-d\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875922    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-systemd\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.876755 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875943    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-var-lib-kubelet\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.876755 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.875974    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-tuned\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.876755 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.876003    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-os-release\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.876755 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.876028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.876755 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.876051    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-slash\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.876755 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.876072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-cni-netd\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.876755 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.876093    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4994c0d-2b53-4d06-9f86-90f2e360b288-env-overrides\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.876755 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.876127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.877126 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.877089    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rgq7n\""
Jul 19 14:36:32.877201 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.877171    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:32.877294 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:32.877268    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:32.877428 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.877409    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 19 14:36:32.877578 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.877559    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 19 14:36:32.877700 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.877685    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 19 14:36:32.879539 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.879520    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gtm8v"
Jul 19 14:36:32.882228 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.881958    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.882228 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.882031    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rwj4z\""
Jul 19 14:36:32.882228 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.882040    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 19 14:36:32.882228 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.882031    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 19 14:36:32.884130 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.884094    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zs8z7\""
Jul 19 14:36:32.884453 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.884435    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 19 14:36:32.884552 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.884484    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:32.884613 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:32.884580    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:32.887745 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.887637    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:32.887745 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:32.887705    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:32.895412 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.895392    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wwxv4"
Jul 19 14:36:32.905563 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.905539    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wwxv4"
Jul 19 14:36:32.967940 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.967827    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 19 14:36:32.977354 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977326    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.977354 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-kubelet\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.977579 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-registration-dir\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.977579 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-kubernetes\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.977579 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-sysctl-conf\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.977579 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977463    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-multus-cni-dir\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.977579 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977480    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmdlz\" (UniqueName: \"kubernetes.io/projected/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-kube-api-access-gmdlz\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.977579 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-run-netns\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.977579 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-registration-dir\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.977579 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4994c0d-2b53-4d06-9f86-90f2e360b288-ovnkube-config\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.977579 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977519    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-kubernetes\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.977579 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977575    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-kubelet\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-device-dir\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-sysctl-conf\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977618    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-dbus\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977635    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-run-netns\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-cnibin\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977654    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-device-dir\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbp7m\" (UniqueName: \"kubernetes.io/projected/0529a9f4-7d49-47f5-9c5f-e61102a365d9-kube-api-access-lbp7m\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977704    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-sysconfig\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-lib-modules\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977823    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-sysconfig\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71c9fd9a-f6de-4c6e-b44c-cb761417d887-hosts-file\") pod \"node-resolver-wcvsd\" (UID: \"71c9fd9a-f6de-4c6e-b44c-cb761417d887\") " pod="openshift-dns/node-resolver-wcvsd"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977911    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-lib-modules\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977918    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9dft\" (UniqueName: \"kubernetes.io/projected/71c9fd9a-f6de-4c6e-b44c-cb761417d887-kube-api-access-p9dft\") pod \"node-resolver-wcvsd\" (UID: \"71c9fd9a-f6de-4c6e-b44c-cb761417d887\") " pod="openshift-dns/node-resolver-wcvsd"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e02de66-c838-4a32-a23e-5e948f61cf8e-host\") pod \"node-ca-264jl\" (UID: \"6e02de66-c838-4a32-a23e-5e948f61cf8e\") " pod="openshift-image-registry/node-ca-264jl"
Jul 19 14:36:32.978060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.977982    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-multus-socket-dir-parent\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-run-netns\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978037    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/585a705f-24a6-4999-a1c1-cd94469c4f4a-host-slash\") pod \"iptables-alerter-6787b\" (UID: \"585a705f-24a6-4999-a1c1-cd94469c4f4a\") " pod="openshift-network-operator/iptables-alerter-6787b"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978047    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4994c0d-2b53-4d06-9f86-90f2e360b288-ovnkube-config\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978061    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87m5l\" (UniqueName: \"kubernetes.io/projected/b4994c0d-2b53-4d06-9f86-90f2e360b288-kube-api-access-87m5l\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/585a705f-24a6-4999-a1c1-cd94469c4f4a-host-slash\") pod \"iptables-alerter-6787b\" (UID: \"585a705f-24a6-4999-a1c1-cd94469c4f4a\") " pod="openshift-network-operator/iptables-alerter-6787b"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978152    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-sys\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-kubelet-config\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978225    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-var-lib-cni-multus\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978227    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-sys\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-run-multus-certs\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-system-cni-dir\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-run-openvswitch\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978357    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-run-openvswitch\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-sysctl-d\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978376    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-system-cni-dir\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.978772 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-systemd\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978418    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-system-cni-dir\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978430    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-systemd\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-os-release\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978467    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-cni-netd\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978477    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-sysctl-d\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978482    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-host\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978509    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-cni-netd\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-multus-daemon-config\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978537    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-os-release\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978543    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-host\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdvg9\" (UniqueName: \"kubernetes.io/projected/04e03de4-06a6-40b9-b133-06b475e3bb25-kube-api-access-cdvg9\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6e02de66-c838-4a32-a23e-5e948f61cf8e-serviceca\") pod \"node-ca-264jl\" (UID: \"6e02de66-c838-4a32-a23e-5e948f61cf8e\") " pod="openshift-image-registry/node-ca-264jl"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-var-lib-cni-bin\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978729    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-multus-conf-dir\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978778    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-socket-dir\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.979571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84ef4e5f-28a8-4117-b65c-9001507529d0-tmp\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/585a705f-24a6-4999-a1c1-cd94469c4f4a-iptables-alerter-script\") pod \"iptables-alerter-6787b\" (UID: \"585a705f-24a6-4999-a1c1-cd94469c4f4a\") " pod="openshift-network-operator/iptables-alerter-6787b"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-hostroot\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978911    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978923    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-socket-dir\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp2pk\" (UniqueName: \"kubernetes.io/projected/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-kube-api-access-fp2pk\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978971    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-systemd-units\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-etc-openvswitch\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.978999    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-modprobe-d\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-var-lib-kubelet\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-tuned\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-var-lib-kubelet\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-etc-openvswitch\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979212    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-var-lib-kubelet\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-cnibin\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979272    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-run-systemd\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.980355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979267    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-var-lib-openvswitch\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979312    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-cnibin\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-run-ovn\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979340    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-modprobe-d\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-node-log\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-run-systemd\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979370    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-run-ovn-kubernetes\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979383    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-node-log\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979400    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-run-ovn-kubernetes\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979406    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-var-lib-openvswitch\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-run-ovn\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979426    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-systemd-units\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41482ca2-bd13-4005-ba14-3077ac539682-konnectivity-ca\") pod \"konnectivity-agent-gtm8v\" (UID: \"41482ca2-bd13-4005-ba14-3077ac539682\") " pod="kube-system/konnectivity-agent-gtm8v"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979461    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c9fd9a-f6de-4c6e-b44c-cb761417d887-tmp-dir\") pod \"node-resolver-wcvsd\" (UID: \"71c9fd9a-f6de-4c6e-b44c-cb761417d887\") " pod="openshift-dns/node-resolver-wcvsd"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-log-socket\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4994c0d-2b53-4d06-9f86-90f2e360b288-ovnkube-script-lib\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-etc-selinux\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-log-socket\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979578    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-run\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979618    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h295w\" (UniqueName: \"kubernetes.io/projected/6e02de66-c838-4a32-a23e-5e948f61cf8e-kube-api-access-h295w\") pod \"node-ca-264jl\" (UID: \"6e02de66-c838-4a32-a23e-5e948f61cf8e\") " pod="openshift-image-registry/node-ca-264jl"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-cni-binary-copy\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979658    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84ef4e5f-28a8-4117-b65c-9001507529d0-run\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979667    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-etc-selinux\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979665    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-etc-kubernetes\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979658    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/585a705f-24a6-4999-a1c1-cd94469c4f4a-iptables-alerter-script\") pod \"iptables-alerter-6787b\" (UID: \"585a705f-24a6-4999-a1c1-cd94469c4f4a\") " pod="openshift-network-operator/iptables-alerter-6787b"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fff52\" (UniqueName: \"kubernetes.io/projected/585a705f-24a6-4999-a1c1-cd94469c4f4a-kube-api-access-fff52\") pod \"iptables-alerter-6787b\" (UID: \"585a705f-24a6-4999-a1c1-cd94469c4f4a\") " pod="openshift-network-operator/iptables-alerter-6787b"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41482ca2-bd13-4005-ba14-3077ac539682-agent-certs\") pod \"konnectivity-agent-gtm8v\" (UID: \"41482ca2-bd13-4005-ba14-3077ac539682\") " pod="kube-system/konnectivity-agent-gtm8v"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979884    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-slash\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4994c0d-2b53-4d06-9f86-90f2e360b288-env-overrides\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.979991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.981980 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-run-k8s-cni-cncf-io\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980064    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980070    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-cni-bin\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980119    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-slash\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4994c0d-2b53-4d06-9f86-90f2e360b288-ovn-node-metrics-cert\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980210    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4994c0d-2b53-4d06-9f86-90f2e360b288-ovnkube-script-lib\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980251    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-os-release\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980340    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4994c0d-2b53-4d06-9f86-90f2e360b288-host-cni-bin\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980365    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4994c0d-2b53-4d06-9f86-90f2e360b288-env-overrides\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980373    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-sys-fs\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldlw6\" (UniqueName: \"kubernetes.io/projected/84ef4e5f-28a8-4117-b65c-9001507529d0-kube-api-access-ldlw6\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980439    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04e03de4-06a6-40b9-b133-06b475e3bb25-sys-fs\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.982651 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.980475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45mw8\" (UniqueName: \"kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8\") pod \"network-check-target-ksr4t\" (UID: \"4e9756e3-8335-42c8-984a-12a873af3294\") " pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:32.983279 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.982769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84ef4e5f-28a8-4117-b65c-9001507529d0-tmp\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.983279 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.982810    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84ef4e5f-28a8-4117-b65c-9001507529d0-etc-tuned\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:32.983279 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.982971    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4994c0d-2b53-4d06-9f86-90f2e360b288-ovn-node-metrics-cert\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.986624 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.986463    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87m5l\" (UniqueName: \"kubernetes.io/projected/b4994c0d-2b53-4d06-9f86-90f2e360b288-kube-api-access-87m5l\") pod \"ovnkube-node-7kksm\" (UID: \"b4994c0d-2b53-4d06-9f86-90f2e360b288\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:32.986624 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.986604    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdvg9\" (UniqueName: \"kubernetes.io/projected/04e03de4-06a6-40b9-b133-06b475e3bb25-kube-api-access-cdvg9\") pod \"aws-ebs-csi-driver-node-zxjgk\" (UID: \"04e03de4-06a6-40b9-b133-06b475e3bb25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:32.987014 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.986986    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp2pk\" (UniqueName: \"kubernetes.io/projected/e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5-kube-api-access-fp2pk\") pod \"multus-additional-cni-plugins-69b5h\" (UID: \"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5\") " pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:32.987121 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.987087    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fff52\" (UniqueName: \"kubernetes.io/projected/585a705f-24a6-4999-a1c1-cd94469c4f4a-kube-api-access-fff52\") pod \"iptables-alerter-6787b\" (UID: \"585a705f-24a6-4999-a1c1-cd94469c4f4a\") " pod="openshift-network-operator/iptables-alerter-6787b"
Jul 19 14:36:32.988155 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:32.988134    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldlw6\" (UniqueName: \"kubernetes.io/projected/84ef4e5f-28a8-4117-b65c-9001507529d0-kube-api-access-ldlw6\") pod \"tuned-ndp2f\" (UID: \"84ef4e5f-28a8-4117-b65c-9001507529d0\") " pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:33.080957 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.080929    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6e02de66-c838-4a32-a23e-5e948f61cf8e-serviceca\") pod \"node-ca-264jl\" (UID: \"6e02de66-c838-4a32-a23e-5e948f61cf8e\") " pod="openshift-image-registry/node-ca-264jl"
Jul 19 14:36:33.080957 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.080960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-var-lib-cni-bin\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.080983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-multus-conf-dir\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-hostroot\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081022    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-var-lib-kubelet\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41482ca2-bd13-4005-ba14-3077ac539682-konnectivity-ca\") pod \"konnectivity-agent-gtm8v\" (UID: \"41482ca2-bd13-4005-ba14-3077ac539682\") " pod="kube-system/konnectivity-agent-gtm8v"
Jul 19 14:36:33.081270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081097    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-multus-conf-dir\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081101    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-var-lib-cni-bin\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c9fd9a-f6de-4c6e-b44c-cb761417d887-tmp-dir\") pod \"node-resolver-wcvsd\" (UID: \"71c9fd9a-f6de-4c6e-b44c-cb761417d887\") " pod="openshift-dns/node-resolver-wcvsd"
Jul 19 14:36:33.081270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081140    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-hostroot\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081167    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-var-lib-kubelet\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h295w\" (UniqueName: \"kubernetes.io/projected/6e02de66-c838-4a32-a23e-5e948f61cf8e-kube-api-access-h295w\") pod \"node-ca-264jl\" (UID: \"6e02de66-c838-4a32-a23e-5e948f61cf8e\") " pod="openshift-image-registry/node-ca-264jl"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-cni-binary-copy\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-etc-kubernetes\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41482ca2-bd13-4005-ba14-3077ac539682-agent-certs\") pod \"konnectivity-agent-gtm8v\" (UID: \"41482ca2-bd13-4005-ba14-3077ac539682\") " pod="kube-system/konnectivity-agent-gtm8v"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-run-k8s-cni-cncf-io\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081449    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6e02de66-c838-4a32-a23e-5e948f61cf8e-serviceca\") pod \"node-ca-264jl\" (UID: \"6e02de66-c838-4a32-a23e-5e948f61cf8e\") " pod="openshift-image-registry/node-ca-264jl"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081453    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-etc-kubernetes\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-os-release\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081532    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c9fd9a-f6de-4c6e-b44c-cb761417d887-tmp-dir\") pod \"node-resolver-wcvsd\" (UID: \"71c9fd9a-f6de-4c6e-b44c-cb761417d887\") " pod="openshift-dns/node-resolver-wcvsd"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081550    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-run-k8s-cni-cncf-io\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081583    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-os-release\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.081596    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.081604    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mw8\" (UniqueName: \"kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8\") pod \"network-check-target-ksr4t\" (UID: \"4e9756e3-8335-42c8-984a-12a873af3294\") " pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081625    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41482ca2-bd13-4005-ba14-3077ac539682-konnectivity-ca\") pod \"konnectivity-agent-gtm8v\" (UID: \"41482ca2-bd13-4005-ba14-3077ac539682\") " pod="kube-system/konnectivity-agent-gtm8v"
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.081727    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs podName:0529a9f4-7d49-47f5-9c5f-e61102a365d9 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:33.581685958 +0000 UTC m=+3.974248320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs") pod "network-metrics-daemon-52jmh" (UID: "0529a9f4-7d49-47f5-9c5f-e61102a365d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:36:33.081744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-multus-cni-dir\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.081764    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret podName:c2b7dc9f-5e13-4837-b5db-9b68f3cae761 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:33.581745991 +0000 UTC m=+3.974308365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret") pod "global-pull-secret-syncer-4hj4p" (UID: "c2b7dc9f-5e13-4837-b5db-9b68f3cae761") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmdlz\" (UniqueName: \"kubernetes.io/projected/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-kube-api-access-gmdlz\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-dbus\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-cnibin\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbp7m\" (UniqueName: \"kubernetes.io/projected/0529a9f4-7d49-47f5-9c5f-e61102a365d9-kube-api-access-lbp7m\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081929    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71c9fd9a-f6de-4c6e-b44c-cb761417d887-hosts-file\") pod \"node-resolver-wcvsd\" (UID: \"71c9fd9a-f6de-4c6e-b44c-cb761417d887\") " pod="openshift-dns/node-resolver-wcvsd"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9dft\" (UniqueName: \"kubernetes.io/projected/71c9fd9a-f6de-4c6e-b44c-cb761417d887-kube-api-access-p9dft\") pod \"node-resolver-wcvsd\" (UID: \"71c9fd9a-f6de-4c6e-b44c-cb761417d887\") " pod="openshift-dns/node-resolver-wcvsd"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e02de66-c838-4a32-a23e-5e948f61cf8e-host\") pod \"node-ca-264jl\" (UID: \"6e02de66-c838-4a32-a23e-5e948f61cf8e\") " pod="openshift-image-registry/node-ca-264jl"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081998    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-cnibin\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082010    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-multus-socket-dir-parent\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-cni-binary-copy\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-dbus\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082075    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-multus-socket-dir-parent\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.081961    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-multus-cni-dir\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082106    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e02de66-c838-4a32-a23e-5e948f61cf8e-host\") pod \"node-ca-264jl\" (UID: \"6e02de66-c838-4a32-a23e-5e948f61cf8e\") " pod="openshift-image-registry/node-ca-264jl"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082093    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71c9fd9a-f6de-4c6e-b44c-cb761417d887-hosts-file\") pod \"node-resolver-wcvsd\" (UID: \"71c9fd9a-f6de-4c6e-b44c-cb761417d887\") " pod="openshift-dns/node-resolver-wcvsd"
Jul 19 14:36:33.082602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-run-netns\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.083447 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082157    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-kubelet-config\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:33.083447 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-var-lib-cni-multus\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.083447 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082208    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-run-netns\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.083447 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-run-multus-certs\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.083447 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-kubelet-config\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:33.083447 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-system-cni-dir\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.083447 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082259    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-var-lib-cni-multus\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.083447 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082281    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-multus-daemon-config\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.083447 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082289    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-host-run-multus-certs\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.083447 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082305    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-system-cni-dir\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.083447 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.082770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-multus-daemon-config\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.084329 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.084310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41482ca2-bd13-4005-ba14-3077ac539682-agent-certs\") pod \"konnectivity-agent-gtm8v\" (UID: \"41482ca2-bd13-4005-ba14-3077ac539682\") " pod="kube-system/konnectivity-agent-gtm8v"
Jul 19 14:36:33.090643 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.090591    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:36:33.090643 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.090618    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:36:33.090643 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.090631    2581 projected.go:196] Error preparing data for projected volume kube-api-access-45mw8 for pod openshift-network-diagnostics/network-check-target-ksr4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:36:33.090875 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.090699    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8 podName:4e9756e3-8335-42c8-984a-12a873af3294 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:33.590681774 +0000 UTC m=+3.983244143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-45mw8" (UniqueName: "kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8") pod "network-check-target-ksr4t" (UID: "4e9756e3-8335-42c8-984a-12a873af3294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:36:33.092523 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.092450    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h295w\" (UniqueName: \"kubernetes.io/projected/6e02de66-c838-4a32-a23e-5e948f61cf8e-kube-api-access-h295w\") pod \"node-ca-264jl\" (UID: \"6e02de66-c838-4a32-a23e-5e948f61cf8e\") " pod="openshift-image-registry/node-ca-264jl"
Jul 19 14:36:33.093124 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.093097    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9dft\" (UniqueName: \"kubernetes.io/projected/71c9fd9a-f6de-4c6e-b44c-cb761417d887-kube-api-access-p9dft\") pod \"node-resolver-wcvsd\" (UID: \"71c9fd9a-f6de-4c6e-b44c-cb761417d887\") " pod="openshift-dns/node-resolver-wcvsd"
Jul 19 14:36:33.093617 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.093598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbp7m\" (UniqueName: \"kubernetes.io/projected/0529a9f4-7d49-47f5-9c5f-e61102a365d9-kube-api-access-lbp7m\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:33.094001 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.093973    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmdlz\" (UniqueName: \"kubernetes.io/projected/7ac73163-d7e2-4658-ac4d-c4cdd46ca467-kube-api-access-gmdlz\") pod \"multus-lz9d6\" (UID: \"7ac73163-d7e2-4658-ac4d-c4cdd46ca467\") " pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.171709 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.171678    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-69b5h"
Jul 19 14:36:33.180159 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.180128    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6787b"
Jul 19 14:36:33.189942 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.189919    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:33.194650 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.194633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk"
Jul 19 14:36:33.201374 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.201351    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ndp2f"
Jul 19 14:36:33.207050 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.207028    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wcvsd"
Jul 19 14:36:33.214675 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.214648    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-264jl"
Jul 19 14:36:33.221282 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.221260    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gtm8v"
Jul 19 14:36:33.226839 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.226821    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lz9d6"
Jul 19 14:36:33.584423 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.584339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:33.584423 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.584379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:33.584584 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.584482    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:36:33.584584 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.584483    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:36:33.584584 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.584531    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret podName:c2b7dc9f-5e13-4837-b5db-9b68f3cae761 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:34.584517515 +0000 UTC m=+4.977079878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret") pod "global-pull-secret-syncer-4hj4p" (UID: "c2b7dc9f-5e13-4837-b5db-9b68f3cae761") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:36:33.584584 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.584544    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs podName:0529a9f4-7d49-47f5-9c5f-e61102a365d9 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:34.584537802 +0000 UTC m=+4.977100166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs") pod "network-metrics-daemon-52jmh" (UID: "0529a9f4-7d49-47f5-9c5f-e61102a365d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:36:33.685602 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.685568    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mw8\" (UniqueName: \"kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8\") pod \"network-check-target-ksr4t\" (UID: \"4e9756e3-8335-42c8-984a-12a873af3294\") " pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:33.685742 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.685725    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:36:33.685782 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.685744    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:36:33.685782 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.685752    2581 projected.go:196] Error preparing data for projected volume kube-api-access-45mw8 for pod openshift-network-diagnostics/network-check-target-ksr4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:36:33.685846 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:33.685800    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8 podName:4e9756e3-8335-42c8-984a-12a873af3294 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:34.685786389 +0000 UTC m=+5.078348752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-45mw8" (UniqueName: "kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8") pod "network-check-target-ksr4t" (UID: "4e9756e3-8335-42c8-984a-12a873af3294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:36:33.705764 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:33.705736    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ef4e5f_28a8_4117_b65c_9001507529d0.slice/crio-2e5c81548d0dcfcb8b0d81182011c7a3185e4c246592c76f7175c9a56f2e12e3 WatchSource:0}: Error finding container 2e5c81548d0dcfcb8b0d81182011c7a3185e4c246592c76f7175c9a56f2e12e3: Status 404 returned error can't find the container with id 2e5c81548d0dcfcb8b0d81182011c7a3185e4c246592c76f7175c9a56f2e12e3
Jul 19 14:36:33.728247 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:33.728221    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c9fd9a_f6de_4c6e_b44c_cb761417d887.slice/crio-e980c8ac4cf06f4d20d0603350277082accbf59d52a8ac41efd9c26875e2dd20 WatchSource:0}: Error finding container e980c8ac4cf06f4d20d0603350277082accbf59d52a8ac41efd9c26875e2dd20: Status 404 returned error can't find the container with id e980c8ac4cf06f4d20d0603350277082accbf59d52a8ac41efd9c26875e2dd20
Jul 19 14:36:33.729064 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:33.728931    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b299eb_dc12_43c9_ab17_3e86ca3ae6c5.slice/crio-3241de21685bca2bac8e29691163aea950699581075a14634a81dc56a774c2ed WatchSource:0}: Error finding container 3241de21685bca2bac8e29691163aea950699581075a14634a81dc56a774c2ed: Status 404 returned error can't find the container with id 3241de21685bca2bac8e29691163aea950699581075a14634a81dc56a774c2ed
Jul 19 14:36:33.729755 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:33.729662    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e02de66_c838_4a32_a23e_5e948f61cf8e.slice/crio-12d283a02b81319638c22ef81762077b58c50231958e948f89a3f60e74481703 WatchSource:0}: Error finding container 12d283a02b81319638c22ef81762077b58c50231958e948f89a3f60e74481703: Status 404 returned error can't find the container with id 12d283a02b81319638c22ef81762077b58c50231958e948f89a3f60e74481703
Jul 19 14:36:33.730529 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:33.730491    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4994c0d_2b53_4d06_9f86_90f2e360b288.slice/crio-87c1fa3122131c4d43be2bc3dac2d4a42691728e38ed7a0c471cebd4e9cabadf WatchSource:0}: Error finding container 87c1fa3122131c4d43be2bc3dac2d4a42691728e38ed7a0c471cebd4e9cabadf: Status 404 returned error can't find the container with id 87c1fa3122131c4d43be2bc3dac2d4a42691728e38ed7a0c471cebd4e9cabadf
Jul 19 14:36:33.731736 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:33.731713    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41482ca2_bd13_4005_ba14_3077ac539682.slice/crio-f5f07cb4c7d2ed343ac0aa5f8edea36c9f5d163d4130cd3c1d90aa69ad284d38 WatchSource:0}: Error finding container f5f07cb4c7d2ed343ac0aa5f8edea36c9f5d163d4130cd3c1d90aa69ad284d38: Status 404 returned error can't find the container with id f5f07cb4c7d2ed343ac0aa5f8edea36c9f5d163d4130cd3c1d90aa69ad284d38
Jul 19 14:36:33.732621 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:36:33.732455    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585a705f_24a6_4999_a1c1_cd94469c4f4a.slice/crio-3a3d25a561f34e4aae7ed218bd6a02a879afdc5c29fc403a093d2651006dfbf7 WatchSource:0}: Error finding container 3a3d25a561f34e4aae7ed218bd6a02a879afdc5c29fc403a093d2651006dfbf7: Status 404 returned error can't find the container with id 3a3d25a561f34e4aae7ed218bd6a02a879afdc5c29fc403a093d2651006dfbf7
Jul 19 14:36:33.909513 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.909457    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-18 14:31:32 +0000 UTC" deadline="2028-03-07 21:32:00.325301334 +0000 UTC"
Jul 19 14:36:33.909875 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.909515    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14334h55m26.415791109s"
Jul 19 14:36:33.971102 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.971069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ndp2f" event={"ID":"84ef4e5f-28a8-4117-b65c-9001507529d0","Type":"ContainerStarted","Data":"2e5c81548d0dcfcb8b0d81182011c7a3185e4c246592c76f7175c9a56f2e12e3"}
Jul 19 14:36:33.972951 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.972918    2581 generic.go:356] "Generic (PLEG): container finished" podID="7880506548359367b66d0c274b80e32c" containerID="d31e4d0946c7fe781e0dc47fe893ba61a0ee5ca2f4d3d71c1cbccfc0f6dc9a73" exitCode=0
Jul 19 14:36:33.973073 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.973009    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" event={"ID":"7880506548359367b66d0c274b80e32c","Type":"ContainerDied","Data":"d31e4d0946c7fe781e0dc47fe893ba61a0ee5ca2f4d3d71c1cbccfc0f6dc9a73"}
Jul 19 14:36:33.974098 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.974080    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lz9d6" event={"ID":"7ac73163-d7e2-4658-ac4d-c4cdd46ca467","Type":"ContainerStarted","Data":"fc2ecf2a6c5bb28b2e4bd9e7f19de16975dc08da4817f8799ab04cbe714b41b1"}
Jul 19 14:36:33.975100 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.975077    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gtm8v" event={"ID":"41482ca2-bd13-4005-ba14-3077ac539682","Type":"ContainerStarted","Data":"f5f07cb4c7d2ed343ac0aa5f8edea36c9f5d163d4130cd3c1d90aa69ad284d38"}
Jul 19 14:36:33.976128 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.976107    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm" event={"ID":"b4994c0d-2b53-4d06-9f86-90f2e360b288","Type":"ContainerStarted","Data":"87c1fa3122131c4d43be2bc3dac2d4a42691728e38ed7a0c471cebd4e9cabadf"}
Jul 19 14:36:33.977088 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.977071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-264jl" event={"ID":"6e02de66-c838-4a32-a23e-5e948f61cf8e","Type":"ContainerStarted","Data":"12d283a02b81319638c22ef81762077b58c50231958e948f89a3f60e74481703"}
Jul 19 14:36:33.978070 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.978052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wcvsd" event={"ID":"71c9fd9a-f6de-4c6e-b44c-cb761417d887","Type":"ContainerStarted","Data":"e980c8ac4cf06f4d20d0603350277082accbf59d52a8ac41efd9c26875e2dd20"}
Jul 19 14:36:33.979480 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.979452    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" event={"ID":"2ed18d9f9ede21e451f5e83ef12c968d","Type":"ContainerStarted","Data":"47897c492bbc4f64b779436ad60d296119f68a40cfe53e8e43fab203b73be590"}
Jul 19 14:36:33.980595 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.980555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk" event={"ID":"04e03de4-06a6-40b9-b133-06b475e3bb25","Type":"ContainerStarted","Data":"1747eac61b8a5c6f5ecddc35adf15334f876bc9d227599719414caaaa3aa2011"}
Jul 19 14:36:33.981535 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.981514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6787b" event={"ID":"585a705f-24a6-4999-a1c1-cd94469c4f4a","Type":"ContainerStarted","Data":"3a3d25a561f34e4aae7ed218bd6a02a879afdc5c29fc403a093d2651006dfbf7"}
Jul 19 14:36:33.982799 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.982780    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69b5h" event={"ID":"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5","Type":"ContainerStarted","Data":"3241de21685bca2bac8e29691163aea950699581075a14634a81dc56a774c2ed"}
Jul 19 14:36:33.998581 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:33.998542    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" podStartSLOduration=1.998528828 podStartE2EDuration="1.998528828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:36:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:36:33.998468251 +0000 UTC m=+4.391030638" watchObservedRunningTime="2026-07-19 14:36:33.998528828 +0000 UTC m=+4.391091212"
Jul 19 14:36:34.594129 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:34.594037    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:34.594129 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:34.594103    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:34.594443 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:34.594286    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:36:34.594443 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:34.594352    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret podName:c2b7dc9f-5e13-4837-b5db-9b68f3cae761 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:36.594330527 +0000 UTC m=+6.986892913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret") pod "global-pull-secret-syncer-4hj4p" (UID: "c2b7dc9f-5e13-4837-b5db-9b68f3cae761") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:36:34.594773 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:34.594753    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:36:34.594866 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:34.594808    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs podName:0529a9f4-7d49-47f5-9c5f-e61102a365d9 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:36.594793268 +0000 UTC m=+6.987355637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs") pod "network-metrics-daemon-52jmh" (UID: "0529a9f4-7d49-47f5-9c5f-e61102a365d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:36:34.695235 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:34.695086    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mw8\" (UniqueName: \"kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8\") pod \"network-check-target-ksr4t\" (UID: \"4e9756e3-8335-42c8-984a-12a873af3294\") " pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:34.695431 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:34.695304    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:36:34.695431 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:34.695333    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:36:34.695431 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:34.695346    2581 projected.go:196] Error preparing data for projected volume kube-api-access-45mw8 for pod openshift-network-diagnostics/network-check-target-ksr4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:36:34.695431 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:34.695407    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8 podName:4e9756e3-8335-42c8-984a-12a873af3294 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:36.69538815 +0000 UTC m=+7.087950534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-45mw8" (UniqueName: "kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8") pod "network-check-target-ksr4t" (UID: "4e9756e3-8335-42c8-984a-12a873af3294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:36:34.910117 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:34.910005    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-18 14:31:32 +0000 UTC" deadline="2028-03-10 23:02:09.002130927 +0000 UTC"
Jul 19 14:36:34.910117 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:34.910069    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14408h25m34.092065506s"
Jul 19 14:36:34.962454 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:34.962248    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:34.962454 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:34.962374    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:34.962841 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:34.962802    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:34.962967 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:34.962949    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:34.963089 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:34.963032    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:34.963145 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:34.963119    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:34.995440 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:34.994872    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" event={"ID":"7880506548359367b66d0c274b80e32c","Type":"ContainerStarted","Data":"9fcd4ba0c1ba23a0490f777c9d7e0bb8867055c38c2fb6d850e0bc40f3a07a33"}
Jul 19 14:36:36.612151 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:36.612112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:36.612693 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:36.612172    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:36.612693 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:36.612317    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:36:36.612693 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:36.612387    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret podName:c2b7dc9f-5e13-4837-b5db-9b68f3cae761 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:40.61236739 +0000 UTC m=+11.004929753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret") pod "global-pull-secret-syncer-4hj4p" (UID: "c2b7dc9f-5e13-4837-b5db-9b68f3cae761") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:36:36.612980 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:36.612781    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:36:36.612980 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:36.612829    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs podName:0529a9f4-7d49-47f5-9c5f-e61102a365d9 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:40.612812768 +0000 UTC m=+11.005375153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs") pod "network-metrics-daemon-52jmh" (UID: "0529a9f4-7d49-47f5-9c5f-e61102a365d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:36:36.713582 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:36.712895    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mw8\" (UniqueName: \"kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8\") pod \"network-check-target-ksr4t\" (UID: \"4e9756e3-8335-42c8-984a-12a873af3294\") " pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:36.713582 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:36.713089    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:36:36.713582 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:36.713109    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:36:36.713582 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:36.713123    2581 projected.go:196] Error preparing data for projected volume kube-api-access-45mw8 for pod openshift-network-diagnostics/network-check-target-ksr4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:36:36.713582 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:36.713207    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8 podName:4e9756e3-8335-42c8-984a-12a873af3294 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:40.713165687 +0000 UTC m=+11.105728059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-45mw8" (UniqueName: "kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8") pod "network-check-target-ksr4t" (UID: "4e9756e3-8335-42c8-984a-12a873af3294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:36:36.963256 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:36.963166    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:36.963418 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:36.963166    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:36.963418 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:36.963314    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:36.963418 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:36.963333    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:36.963575 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:36.963455    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:36.963575 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:36.963504    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:38.962609 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:38.962574    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:38.962974 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:38.962585    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:38.962974 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:38.962717    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:38.962974 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:38.962714    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:38.962974 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:38.962788    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:38.962974 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:38.962865    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:40.647948 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:40.647916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:40.648449 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:40.647962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:40.648449 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:40.648136    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:36:40.648449 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:40.648270    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:36:40.648449 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:40.648320    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs podName:0529a9f4-7d49-47f5-9c5f-e61102a365d9 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:48.648300412 +0000 UTC m=+19.040862792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs") pod "network-metrics-daemon-52jmh" (UID: "0529a9f4-7d49-47f5-9c5f-e61102a365d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:36:40.648449 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:40.648354    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret podName:c2b7dc9f-5e13-4837-b5db-9b68f3cae761 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:48.648342709 +0000 UTC m=+19.040905086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret") pod "global-pull-secret-syncer-4hj4p" (UID: "c2b7dc9f-5e13-4837-b5db-9b68f3cae761") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:36:40.748769 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:40.748711    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mw8\" (UniqueName: \"kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8\") pod \"network-check-target-ksr4t\" (UID: \"4e9756e3-8335-42c8-984a-12a873af3294\") " pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:40.749003 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:40.748886    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:36:40.749003 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:40.748909    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:36:40.749003 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:40.748922    2581 projected.go:196] Error preparing data for projected volume kube-api-access-45mw8 for pod openshift-network-diagnostics/network-check-target-ksr4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:36:40.749003 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:40.748976    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8 podName:4e9756e3-8335-42c8-984a-12a873af3294 nodeName:}" failed. No retries permitted until 2026-07-19 14:36:48.748958337 +0000 UTC m=+19.141520717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-45mw8" (UniqueName: "kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8") pod "network-check-target-ksr4t" (UID: "4e9756e3-8335-42c8-984a-12a873af3294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:36:40.963158 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:40.962996    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:40.963158 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:40.963035    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:40.963158 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:40.963129    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:40.963663 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:40.963489    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:40.963663 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:40.963590    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:40.963963 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:40.963659    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:42.962214 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:42.962162    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:42.962669 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:42.962303    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:42.962669 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:42.962324    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:42.962669 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:42.962443    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:42.962669 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:42.962162    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:42.962669 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:42.962547    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:44.962371 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:44.962340    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:44.962845 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:44.962348    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:44.962845 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:44.962472    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:44.962845 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:44.962474    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:44.962845 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:44.962555    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:44.962845 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:44.962635    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:46.962074 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:46.962044    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:46.962571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:46.962038    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:46.962571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:46.962202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:46.962571 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:46.962192    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:46.962571 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:46.962306    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:46.962571 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:46.962395    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:48.704403 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:48.704360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:48.704970 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:48.704412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:48.704970 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:48.704523    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:36:48.704970 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:48.704529    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:36:48.704970 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:48.704596    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret podName:c2b7dc9f-5e13-4837-b5db-9b68f3cae761 nodeName:}" failed. No retries permitted until 2026-07-19 14:37:04.704577014 +0000 UTC m=+35.097139396 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret") pod "global-pull-secret-syncer-4hj4p" (UID: "c2b7dc9f-5e13-4837-b5db-9b68f3cae761") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:36:48.704970 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:48.704617    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs podName:0529a9f4-7d49-47f5-9c5f-e61102a365d9 nodeName:}" failed. No retries permitted until 2026-07-19 14:37:04.704606525 +0000 UTC m=+35.097168890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs") pod "network-metrics-daemon-52jmh" (UID: "0529a9f4-7d49-47f5-9c5f-e61102a365d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:36:48.805562 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:48.805530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mw8\" (UniqueName: \"kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8\") pod \"network-check-target-ksr4t\" (UID: \"4e9756e3-8335-42c8-984a-12a873af3294\") " pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:48.805723 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:48.805663    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:36:48.805723 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:48.805682    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:36:48.805723 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:48.805693    2581 projected.go:196] Error preparing data for projected volume kube-api-access-45mw8 for pod openshift-network-diagnostics/network-check-target-ksr4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:36:48.805846 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:48.805741    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8 podName:4e9756e3-8335-42c8-984a-12a873af3294 nodeName:}" failed. No retries permitted until 2026-07-19 14:37:04.805729342 +0000 UTC m=+35.198291706 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-45mw8" (UniqueName: "kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8") pod "network-check-target-ksr4t" (UID: "4e9756e3-8335-42c8-984a-12a873af3294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:36:48.962031 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:48.961884    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:48.962031 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:48.961948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:48.962031 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:48.961953    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:48.962311 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:48.962066    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:48.962311 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:48.962195    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:48.962311 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:48.962273    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:50.962974 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:50.962937    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:50.963432 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:50.963024    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:50.963432 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:50.963028    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:50.963432 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:50.963141    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:50.963432 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:50.963141    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:50.963432 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:50.963238    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:52.962567 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:52.962272    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:52.963211 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:52.962272    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:52.963211 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:52.962656    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:52.963211 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:52.962272    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:52.963211 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:52.962733    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:52.963211 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:52.962786    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:53.044799 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.044768    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk" event={"ID":"04e03de4-06a6-40b9-b133-06b475e3bb25","Type":"ContainerStarted","Data":"ef343635d588cff78d19df691b03869a998be828bf7623e7c77614e7ea5169ff"}
Jul 19 14:36:53.046458 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.046430    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5" containerID="d21d1e88c23ee4b1695e4f2199cb5f3624244a48e3a85b73af6213c52f5608d3" exitCode=0
Jul 19 14:36:53.046569 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.046514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69b5h" event={"ID":"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5","Type":"ContainerDied","Data":"d21d1e88c23ee4b1695e4f2199cb5f3624244a48e3a85b73af6213c52f5608d3"}
Jul 19 14:36:53.048582 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.048561    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ndp2f" event={"ID":"84ef4e5f-28a8-4117-b65c-9001507529d0","Type":"ContainerStarted","Data":"2b8a95f6b7f32772ef1b7cfc9de75f882f17657138efa0d891fbbf1dc6899835"}
Jul 19 14:36:53.050323 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.050299    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lz9d6" event={"ID":"7ac73163-d7e2-4658-ac4d-c4cdd46ca467","Type":"ContainerStarted","Data":"6db39c7b7036c28b1bde0f98dfe0c64b1ee3c3f8a207a23b56576f4d2dda3cf1"}
Jul 19 14:36:53.051969 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.051924    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gtm8v" event={"ID":"41482ca2-bd13-4005-ba14-3077ac539682","Type":"ContainerStarted","Data":"b52cb0b83d16f52fff949343681631e0e802dda827bb3ac7f0431c7c16234c7d"}
Jul 19 14:36:53.054856 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.054836    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm" event={"ID":"b4994c0d-2b53-4d06-9f86-90f2e360b288","Type":"ContainerStarted","Data":"fd5424bd1039938e747f4f4dfc4e3952a3847ddb912f7c30d304cf144614dc18"}
Jul 19 14:36:53.054937 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.054902    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm" event={"ID":"b4994c0d-2b53-4d06-9f86-90f2e360b288","Type":"ContainerStarted","Data":"9e57ac7356a1d0b8e40c8b699c94bc3363174df37441141faa08e51610cd2104"}
Jul 19 14:36:53.054998 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.054954    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm" event={"ID":"b4994c0d-2b53-4d06-9f86-90f2e360b288","Type":"ContainerStarted","Data":"05283e3fd2cf3711e91e1eaa08fde2dc0afe2f782510bcdb6ccb0f9c3b395c89"}
Jul 19 14:36:53.054998 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.054993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm" event={"ID":"b4994c0d-2b53-4d06-9f86-90f2e360b288","Type":"ContainerStarted","Data":"b458cfed4c4bf588fd7dd73fb4481c8a39d9fc86b08fad5c176cc7f483d825a8"}
Jul 19 14:36:53.055107 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.055030    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm" event={"ID":"b4994c0d-2b53-4d06-9f86-90f2e360b288","Type":"ContainerStarted","Data":"b682473b9883819baf02728d094174a18231f4b6380246c186996f627cca2023"}
Jul 19 14:36:53.057939 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.056897    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-264jl" event={"ID":"6e02de66-c838-4a32-a23e-5e948f61cf8e","Type":"ContainerStarted","Data":"ad002c6a1beaff4a55a042d6437c18c28450f408ef477b64dd8ee6a401098b5a"}
Jul 19 14:36:53.059361 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.059337    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wcvsd" event={"ID":"71c9fd9a-f6de-4c6e-b44c-cb761417d887","Type":"ContainerStarted","Data":"e5301d952c5c9b8270dec03a50b07fab5a7d0975b29f494b223b37b051bc117a"}
Jul 19 14:36:53.066633 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.066580    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" podStartSLOduration=21.066567462 podStartE2EDuration="21.066567462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:36:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:36:35.012259408 +0000 UTC m=+5.404821793" watchObservedRunningTime="2026-07-19 14:36:53.066567462 +0000 UTC m=+23.459129848"
Jul 19 14:36:53.080142 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.080098    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-264jl" podStartSLOduration=3.416534987 podStartE2EDuration="22.080084123s" totalImagesPullingTime="18.663549136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:36:53.079948425 +0000 UTC m=+23.472510810" watchObservedRunningTime="2026-07-19 14:36:53.080084123 +0000 UTC m=+23.472646511"
Jul 19 14:36:53.092969 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.092922    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gtm8v" podStartSLOduration=11.799090436 podStartE2EDuration="22.092903307s" totalImagesPullingTime="10.293812871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:36:53.092895529 +0000 UTC m=+23.485457914" watchObservedRunningTime="2026-07-19 14:36:53.092903307 +0000 UTC m=+23.485465694"
Jul 19 14:36:53.107758 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.107713    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ndp2f" podStartSLOduration=3.434797793 podStartE2EDuration="22.107693134s" totalImagesPullingTime="18.672895341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:36:53.107632029 +0000 UTC m=+23.500194415" watchObservedRunningTime="2026-07-19 14:36:53.107693134 +0000 UTC m=+23.500255521"
Jul 19 14:36:53.122584 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.122535    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wcvsd" podStartSLOduration=3.4588634320000002 podStartE2EDuration="22.122522307s" totalImagesPullingTime="18.663658875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:36:53.12225405 +0000 UTC m=+23.514816463" watchObservedRunningTime="2026-07-19 14:36:53.122522307 +0000 UTC m=+23.515084694"
Jul 19 14:36:53.139406 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.139289    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lz9d6" podStartSLOduration=3.462351733 podStartE2EDuration="22.13926432s" totalImagesPullingTime="18.676912587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:36:53.13848447 +0000 UTC m=+23.531046854" watchObservedRunningTime="2026-07-19 14:36:53.13926432 +0000 UTC m=+23.531826707"
Jul 19 14:36:53.850035 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.850000    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 19 14:36:53.940487 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.940353    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-19T14:36:53.850018554Z","UUID":"9389cada-e3ef-4429-a099-fdcf266e17f5","Handler":null,"Name":"","Endpoint":""}
Jul 19 14:36:53.941903 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.941882    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 19 14:36:53.942026 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:53.941923    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 19 14:36:54.065057 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:54.065022    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm" event={"ID":"b4994c0d-2b53-4d06-9f86-90f2e360b288","Type":"ContainerStarted","Data":"2319ab5d7e7ef5bd2a557cdb73b1172a53f299684834ac96338bc17b67aef929"}
Jul 19 14:36:54.067159 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:54.067126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk" event={"ID":"04e03de4-06a6-40b9-b133-06b475e3bb25","Type":"ContainerStarted","Data":"634ec6ddee454dcf5996fc3bfeab6a87493bf45c69ddfbd5db31722bad2e8092"}
Jul 19 14:36:54.068666 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:54.068640    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6787b" event={"ID":"585a705f-24a6-4999-a1c1-cd94469c4f4a","Type":"ContainerStarted","Data":"5f9836dceaf59ccf02609c938519a5a9c72586520d01ed084d25584964c947bf"}
Jul 19 14:36:54.083863 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:54.083809    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6787b" podStartSLOduration=4.423268116 podStartE2EDuration="23.083792995s" totalImagesPullingTime="18.660524879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:36:54.083335595 +0000 UTC m=+24.475897984" watchObservedRunningTime="2026-07-19 14:36:54.083792995 +0000 UTC m=+24.476355379"
Jul 19 14:36:54.239226 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:54.239133    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gtm8v"
Jul 19 14:36:54.239856 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:54.239831    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gtm8v"
Jul 19 14:36:54.962467 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:54.962387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:54.962467 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:54.962427    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:54.962753 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:54.962387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:54.962753 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:54.962523    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:54.962753 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:54.962572    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:54.962753 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:54.962634    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:55.073113 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:55.073014    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk" event={"ID":"04e03de4-06a6-40b9-b133-06b475e3bb25","Type":"ContainerStarted","Data":"cb082342fce3f55719ad99fdd3db16516e85090c81e2a71465fd530c8a5d5545"}
Jul 19 14:36:55.073653 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:55.073503    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gtm8v"
Jul 19 14:36:55.073929 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:55.073909    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gtm8v"
Jul 19 14:36:55.090105 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:55.090046    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxjgk" podStartSLOduration=3.375423888 podStartE2EDuration="24.090032496s" totalImagesPullingTime="20.714608608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:36:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:36:55.08962311 +0000 UTC m=+25.482185494" watchObservedRunningTime="2026-07-19 14:36:55.090032496 +0000 UTC m=+25.482594880"
Jul 19 14:36:56.079002 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:56.078762    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm" event={"ID":"b4994c0d-2b53-4d06-9f86-90f2e360b288","Type":"ContainerStarted","Data":"0daee4e1f54e4cb71491f6e299fb974c33aa763dcc1bc393e0d7e9d9b7649353"}
Jul 19 14:36:56.962125 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:56.962091    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:56.962364 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:56.962096    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:56.962364 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:56.962247    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:56.962364 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:56.962096    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:56.962364 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:56.962331    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:56.962567 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:56.962378    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:58.085010 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:58.084803    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5" containerID="6cedadc38dab40bb9e1f457e50b2807f18e896cde76f3d402f60995e2108ddab" exitCode=0
Jul 19 14:36:58.085926 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:58.084898    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69b5h" event={"ID":"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5","Type":"ContainerDied","Data":"6cedadc38dab40bb9e1f457e50b2807f18e896cde76f3d402f60995e2108ddab"}
Jul 19 14:36:58.090324 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:58.089748    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm" event={"ID":"b4994c0d-2b53-4d06-9f86-90f2e360b288","Type":"ContainerStarted","Data":"90e620c284560bcfb8d4f426d61f4aeba1594dac1f902664767712297743b1ab"}
Jul 19 14:36:58.090419 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:58.090387    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:58.090472 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:58.090439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:58.105836 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:58.105811    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:58.105963 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:58.105913    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:36:58.143295 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:58.143231    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm" podStartSLOduration=8.378261949 podStartE2EDuration="27.143210094s" totalImagesPullingTime="18.764948145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:36:58.137026364 +0000 UTC m=+28.529588749" watchObservedRunningTime="2026-07-19 14:36:58.143210094 +0000 UTC m=+28.535772481"
Jul 19 14:36:58.962128 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:58.962099    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:58.962397 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:58.962099    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:58.962397 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:58.962226    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:36:58.962397 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:58.962234    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:58.962397 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:58.962347    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:58.962543 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:58.962416    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:59.092046 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:59.092022    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 19 14:36:59.405943 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:59.405912    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-52jmh"]
Jul 19 14:36:59.406226 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:59.406033    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:36:59.406226 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:59.406132    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:36:59.408885 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:59.408851    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ksr4t"]
Jul 19 14:36:59.409014 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:59.408964    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:36:59.409094 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:59.409062    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:36:59.409428 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:59.409401    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4hj4p"]
Jul 19 14:36:59.409491 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:36:59.409477    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:36:59.409575 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:36:59.409550    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:37:00.096846 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:00.096811    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5" containerID="f2a9e504aeaf60cfaa0daf1e9e988f110e7ccf757c2abbd1f3ce3ee9df46963f" exitCode=0
Jul 19 14:37:00.097340 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:00.096897    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69b5h" event={"ID":"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5","Type":"ContainerDied","Data":"f2a9e504aeaf60cfaa0daf1e9e988f110e7ccf757c2abbd1f3ce3ee9df46963f"}
Jul 19 14:37:00.097340 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:00.096985    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 19 14:37:00.962675 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:00.962489    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:37:00.962675 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:00.962668    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:37:00.962866 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:00.962609    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:37:00.962866 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:00.962753    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:37:00.963024 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:00.962858    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:37:00.963024 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:00.962944    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:37:01.101307 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:01.101272    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5" containerID="3ebab5af1ea963a725f502c6fbee835e3e6d56a6120d678aaeac2d5d8bb88f3c" exitCode=0
Jul 19 14:37:01.101673 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:01.101333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69b5h" event={"ID":"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5","Type":"ContainerDied","Data":"3ebab5af1ea963a725f502c6fbee835e3e6d56a6120d678aaeac2d5d8bb88f3c"}
Jul 19 14:37:01.450451 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:01.450423    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:37:02.961902 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:02.961866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:37:02.962557 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:02.961910    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:37:02.962557 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:02.961866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:37:02.962557 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:02.962008    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:37:02.962557 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:02.962101    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:37:02.962557 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:02.962221    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:37:04.724633 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:04.724601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:37:04.725032 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:04.724640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:37:04.725032 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:04.724762    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:37:04.725032 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:04.724818    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret podName:c2b7dc9f-5e13-4837-b5db-9b68f3cae761 nodeName:}" failed. No retries permitted until 2026-07-19 14:37:36.724799942 +0000 UTC m=+67.117362319 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret") pod "global-pull-secret-syncer-4hj4p" (UID: "c2b7dc9f-5e13-4837-b5db-9b68f3cae761") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:37:04.725032 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:04.724762    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:37:04.725032 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:04.724924    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs podName:0529a9f4-7d49-47f5-9c5f-e61102a365d9 nodeName:}" failed. No retries permitted until 2026-07-19 14:37:36.724900399 +0000 UTC m=+67.117462770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs") pod "network-metrics-daemon-52jmh" (UID: "0529a9f4-7d49-47f5-9c5f-e61102a365d9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:37:04.826438 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:04.826403    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mw8\" (UniqueName: \"kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8\") pod \"network-check-target-ksr4t\" (UID: \"4e9756e3-8335-42c8-984a-12a873af3294\") " pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:37:04.826621 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:04.826555    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:37:04.826621 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:04.826579    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:37:04.826621 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:04.826591    2581 projected.go:196] Error preparing data for projected volume kube-api-access-45mw8 for pod openshift-network-diagnostics/network-check-target-ksr4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:37:04.826756 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:04.826655    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8 podName:4e9756e3-8335-42c8-984a-12a873af3294 nodeName:}" failed. No retries permitted until 2026-07-19 14:37:36.826635001 +0000 UTC m=+67.219197378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-45mw8" (UniqueName: "kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8") pod "network-check-target-ksr4t" (UID: "4e9756e3-8335-42c8-984a-12a873af3294") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:37:04.962382 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:04.962353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:37:04.962549 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:04.962353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:37:04.962549 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:04.962487    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hj4p" podUID="c2b7dc9f-5e13-4837-b5db-9b68f3cae761"
Jul 19 14:37:04.962549 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:04.962528    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:37:04.962723 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:04.962616    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:37:04.962723 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:04.962691    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksr4t" podUID="4e9756e3-8335-42c8-984a-12a873af3294"
Jul 19 14:37:05.429355 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.429319    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeReady"
Jul 19 14:37:05.429537 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.429468    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 19 14:37:05.462218 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.462170    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86d4c85d56-km8dh"]
Jul 19 14:37:05.487270 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.487239    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d66jn"]
Jul 19 14:37:05.487414 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.487360    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.489726 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.489703    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 19 14:37:05.489891 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.489868    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 19 14:37:05.489969 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.489868    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rz27h\""
Jul 19 14:37:05.489969 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.489922    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 19 14:37:05.495341 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.495315    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 19 14:37:05.503305 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.503284    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4wrzz"]
Jul 19 14:37:05.503402 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.503317    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d66jn"
Jul 19 14:37:05.505770 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.505750    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rbc88\""
Jul 19 14:37:05.505770 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.505766    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 19 14:37:05.505921 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.505804    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 19 14:37:05.505921 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.505809    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 19 14:37:05.527618 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.527593    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86d4c85d56-km8dh"]
Jul 19 14:37:05.527618 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.527623    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d66jn"]
Jul 19 14:37:05.527773 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.527638    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4wrzz"]
Jul 19 14:37:05.527773 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.527704    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:05.529940 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.529926    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 19 14:37:05.530034 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.530019    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 19 14:37:05.530239 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.530226    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vqq7\""
Jul 19 14:37:05.630496 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630469    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-installation-pull-secrets\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.630659 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbdd8533-9848-42a8-99f0-1f28ae211619-config-volume\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:05.630659 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-certificates\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.630659 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630550    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-image-registry-private-configuration\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.630659 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-ca-trust-extracted\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.630659 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630646    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-bound-sa-token\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.630820 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630685    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.630820 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:05.630820 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630736    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-trusted-ca\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.630820 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q956f\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-kube-api-access-q956f\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.630820 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcfm8\" (UniqueName: \"kubernetes.io/projected/cbdd8533-9848-42a8-99f0-1f28ae211619-kube-api-access-rcfm8\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:05.630958 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54c8a2d7-3080-4b45-b121-4f689792949b-cert\") pod \"ingress-canary-d66jn\" (UID: \"54c8a2d7-3080-4b45-b121-4f689792949b\") " pod="openshift-ingress-canary/ingress-canary-d66jn"
Jul 19 14:37:05.630958 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbdd8533-9848-42a8-99f0-1f28ae211619-tmp-dir\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:05.630958 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.630928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zs6n\" (UniqueName: \"kubernetes.io/projected/54c8a2d7-3080-4b45-b121-4f689792949b-kube-api-access-6zs6n\") pod \"ingress-canary-d66jn\" (UID: \"54c8a2d7-3080-4b45-b121-4f689792949b\") " pod="openshift-ingress-canary/ingress-canary-d66jn"
Jul 19 14:37:05.731591 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.731565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q956f\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-kube-api-access-q956f\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.732060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.731617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcfm8\" (UniqueName: \"kubernetes.io/projected/cbdd8533-9848-42a8-99f0-1f28ae211619-kube-api-access-rcfm8\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:05.732060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.731826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54c8a2d7-3080-4b45-b121-4f689792949b-cert\") pod \"ingress-canary-d66jn\" (UID: \"54c8a2d7-3080-4b45-b121-4f689792949b\") " pod="openshift-ingress-canary/ingress-canary-d66jn"
Jul 19 14:37:05.732060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.731875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbdd8533-9848-42a8-99f0-1f28ae211619-tmp-dir\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:05.732060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.731910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zs6n\" (UniqueName: \"kubernetes.io/projected/54c8a2d7-3080-4b45-b121-4f689792949b-kube-api-access-6zs6n\") pod \"ingress-canary-d66jn\" (UID: \"54c8a2d7-3080-4b45-b121-4f689792949b\") " pod="openshift-ingress-canary/ingress-canary-d66jn"
Jul 19 14:37:05.732060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.731950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-installation-pull-secrets\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.732060 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.731986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbdd8533-9848-42a8-99f0-1f28ae211619-config-volume\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:05.732354 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.732159    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-certificates\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.732354 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.732218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-image-registry-private-configuration\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.732354 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.732245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-ca-trust-extracted\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.732354 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.732270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-bound-sa-token\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.732354 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.732300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbdd8533-9848-42a8-99f0-1f28ae211619-tmp-dir\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:05.732354 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.732317    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.732629 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.732374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:05.732629 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:05.732389    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:37:05.732629 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:05.732405    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d4c85d56-km8dh: secret "image-registry-tls" not found
Jul 19 14:37:05.732629 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.732403    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-trusted-ca\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.732629 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:05.732458    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls podName:d76814d5-2688-48b2-8374-9ae7ac8a5e1e nodeName:}" failed. No retries permitted until 2026-07-19 14:37:06.23243853 +0000 UTC m=+36.625000898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls") pod "image-registry-86d4c85d56-km8dh" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e") : secret "image-registry-tls" not found
Jul 19 14:37:05.732629 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.732618    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbdd8533-9848-42a8-99f0-1f28ae211619-config-volume\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:05.732944 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:05.732698    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:37:05.732944 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:05.732755    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls podName:cbdd8533-9848-42a8-99f0-1f28ae211619 nodeName:}" failed. No retries permitted until 2026-07-19 14:37:06.232739126 +0000 UTC m=+36.625301498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls") pod "dns-default-4wrzz" (UID: "cbdd8533-9848-42a8-99f0-1f28ae211619") : secret "dns-default-metrics-tls" not found
Jul 19 14:37:05.732944 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.732757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-certificates\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.732944 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.732905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-ca-trust-extracted\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.733151 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.733132    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-trusted-ca\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.736138 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.736107    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54c8a2d7-3080-4b45-b121-4f689792949b-cert\") pod \"ingress-canary-d66jn\" (UID: \"54c8a2d7-3080-4b45-b121-4f689792949b\") " pod="openshift-ingress-canary/ingress-canary-d66jn"
Jul 19 14:37:05.736250 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.736148    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-installation-pull-secrets\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.736250 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.736152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-image-registry-private-configuration\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.743720 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.743690    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-bound-sa-token\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.743872 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.743852    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcfm8\" (UniqueName: \"kubernetes.io/projected/cbdd8533-9848-42a8-99f0-1f28ae211619-kube-api-access-rcfm8\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:05.744078 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.744061    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q956f\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-kube-api-access-q956f\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:05.744120 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.744103    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zs6n\" (UniqueName: \"kubernetes.io/projected/54c8a2d7-3080-4b45-b121-4f689792949b-kube-api-access-6zs6n\") pod \"ingress-canary-d66jn\" (UID: \"54c8a2d7-3080-4b45-b121-4f689792949b\") " pod="openshift-ingress-canary/ingress-canary-d66jn"
Jul 19 14:37:05.811785 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.811759    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d66jn"
Jul 19 14:37:05.938585 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:05.938408    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d66jn"]
Jul 19 14:37:05.941507 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:37:05.941476    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c8a2d7_3080_4b45_b121_4f689792949b.slice/crio-1fbb0ab5248517b54fa7c1389ff0a5a110cea5d46f2490e2ea3b1eaed611a8dc WatchSource:0}: Error finding container 1fbb0ab5248517b54fa7c1389ff0a5a110cea5d46f2490e2ea3b1eaed611a8dc: Status 404 returned error can't find the container with id 1fbb0ab5248517b54fa7c1389ff0a5a110cea5d46f2490e2ea3b1eaed611a8dc
Jul 19 14:37:06.117020 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.116986    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5" containerID="8624f393cac2d4b941bf79dc3c596305511a97a536b279a405997b6fb744fd52" exitCode=0
Jul 19 14:37:06.117214 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.117074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69b5h" event={"ID":"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5","Type":"ContainerDied","Data":"8624f393cac2d4b941bf79dc3c596305511a97a536b279a405997b6fb744fd52"}
Jul 19 14:37:06.118123 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.118101    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d66jn" event={"ID":"54c8a2d7-3080-4b45-b121-4f689792949b","Type":"ContainerStarted","Data":"1fbb0ab5248517b54fa7c1389ff0a5a110cea5d46f2490e2ea3b1eaed611a8dc"}
Jul 19 14:37:06.237278 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.237252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:06.237404 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.237298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:06.237475 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:06.237406    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:37:06.237475 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:06.237421    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:37:06.237475 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:06.237429    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d4c85d56-km8dh: secret "image-registry-tls" not found
Jul 19 14:37:06.237590 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:06.237486    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls podName:cbdd8533-9848-42a8-99f0-1f28ae211619 nodeName:}" failed. No retries permitted until 2026-07-19 14:37:07.237466247 +0000 UTC m=+37.630028626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls") pod "dns-default-4wrzz" (UID: "cbdd8533-9848-42a8-99f0-1f28ae211619") : secret "dns-default-metrics-tls" not found
Jul 19 14:37:06.237590 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:06.237507    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls podName:d76814d5-2688-48b2-8374-9ae7ac8a5e1e nodeName:}" failed. No retries permitted until 2026-07-19 14:37:07.237497062 +0000 UTC m=+37.630059426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls") pod "image-registry-86d4c85d56-km8dh" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e") : secret "image-registry-tls" not found
Jul 19 14:37:06.962075 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.962042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:37:06.962610 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.962098    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:37:06.962610 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.962042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:37:06.964669 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.964638    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 19 14:37:06.964767 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.964690    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 19 14:37:06.964767 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.964705    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 19 14:37:06.965682 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.965661    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xgfj\""
Jul 19 14:37:06.965788 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.965772    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 19 14:37:06.965853 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:06.965819    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f5r6f\""
Jul 19 14:37:07.124739 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:07.124704    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5" containerID="42b3695722dd38c40e60dcbc21b294c122c37e466b2a5a35713eae163efd65d8" exitCode=0
Jul 19 14:37:07.124911 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:07.124747    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69b5h" event={"ID":"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5","Type":"ContainerDied","Data":"42b3695722dd38c40e60dcbc21b294c122c37e466b2a5a35713eae163efd65d8"}
Jul 19 14:37:07.245505 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:07.245477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:07.245667 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:07.245531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:07.245732 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:07.245659    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:37:07.245732 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:07.245681    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d4c85d56-km8dh: secret "image-registry-tls" not found
Jul 19 14:37:07.245831 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:07.245733    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:37:07.245831 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:07.245740    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls podName:d76814d5-2688-48b2-8374-9ae7ac8a5e1e nodeName:}" failed. No retries permitted until 2026-07-19 14:37:09.245720395 +0000 UTC m=+39.638282770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls") pod "image-registry-86d4c85d56-km8dh" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e") : secret "image-registry-tls" not found
Jul 19 14:37:07.245831 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:07.245802    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls podName:cbdd8533-9848-42a8-99f0-1f28ae211619 nodeName:}" failed. No retries permitted until 2026-07-19 14:37:09.245784984 +0000 UTC m=+39.638347353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls") pod "dns-default-4wrzz" (UID: "cbdd8533-9848-42a8-99f0-1f28ae211619") : secret "dns-default-metrics-tls" not found
Jul 19 14:37:08.131208 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:08.130987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69b5h" event={"ID":"e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5","Type":"ContainerStarted","Data":"b877636be762313982009bc79e2d051b2e3d5bbac29d3d2811ff725e31dcf81c"}
Jul 19 14:37:08.132578 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:08.132547    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d66jn" event={"ID":"54c8a2d7-3080-4b45-b121-4f689792949b","Type":"ContainerStarted","Data":"644e8ff7bee5885e4de100658c35ac13f43ecf15b8acd9e6f8ec57178d3d3208"}
Jul 19 14:37:08.155932 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:08.155836    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-69b5h" podStartSLOduration=7.750932194 podStartE2EDuration="37.155818718s" totalImagesPullingTime="29.404886524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:36:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:37:08.154325305 +0000 UTC m=+38.546887689" watchObservedRunningTime="2026-07-19 14:37:08.155818718 +0000 UTC m=+38.548381104"
Jul 19 14:37:08.170660 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:08.170614    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d66jn" podStartSLOduration=1.108639998 podStartE2EDuration="3.170599097s" totalImagesPullingTime="2.061959099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:37:08.170021535 +0000 UTC m=+38.562583921" watchObservedRunningTime="2026-07-19 14:37:08.170599097 +0000 UTC m=+38.563161481"
Jul 19 14:37:09.261885 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:09.261846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:09.262557 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:09.261961    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:37:09.262557 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:09.261977    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d4c85d56-km8dh: secret "image-registry-tls" not found
Jul 19 14:37:09.262557 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:09.262034    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls podName:d76814d5-2688-48b2-8374-9ae7ac8a5e1e nodeName:}" failed. No retries permitted until 2026-07-19 14:37:13.262014052 +0000 UTC m=+43.654576429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls") pod "image-registry-86d4c85d56-km8dh" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e") : secret "image-registry-tls" not found
Jul 19 14:37:09.262557 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:09.262253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:09.262557 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:09.262329    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:37:09.262557 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:09.262378    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls podName:cbdd8533-9848-42a8-99f0-1f28ae211619 nodeName:}" failed. No retries permitted until 2026-07-19 14:37:13.262364974 +0000 UTC m=+43.654927336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls") pod "dns-default-4wrzz" (UID: "cbdd8533-9848-42a8-99f0-1f28ae211619") : secret "dns-default-metrics-tls" not found
Jul 19 14:37:13.292509 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:13.292473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:13.292509 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:13.292515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:13.292931 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:13.292625    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:37:13.292931 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:13.292647    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d4c85d56-km8dh: secret "image-registry-tls" not found
Jul 19 14:37:13.292931 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:13.292697    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls podName:d76814d5-2688-48b2-8374-9ae7ac8a5e1e nodeName:}" failed. No retries permitted until 2026-07-19 14:37:21.29268275 +0000 UTC m=+51.685245115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls") pod "image-registry-86d4c85d56-km8dh" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e") : secret "image-registry-tls" not found
Jul 19 14:37:13.292931 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:13.292630    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:37:13.292931 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:13.292756    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls podName:cbdd8533-9848-42a8-99f0-1f28ae211619 nodeName:}" failed. No retries permitted until 2026-07-19 14:37:21.292742266 +0000 UTC m=+51.685304632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls") pod "dns-default-4wrzz" (UID: "cbdd8533-9848-42a8-99f0-1f28ae211619") : secret "dns-default-metrics-tls" not found
Jul 19 14:37:21.350498 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:21.350458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:21.350981 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:21.350507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:21.350981 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:21.350610    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:37:21.350981 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:21.350626    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:37:21.350981 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:21.350629    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d4c85d56-km8dh: secret "image-registry-tls" not found
Jul 19 14:37:21.350981 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:21.350684    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls podName:d76814d5-2688-48b2-8374-9ae7ac8a5e1e nodeName:}" failed. No retries permitted until 2026-07-19 14:37:37.35066918 +0000 UTC m=+67.743231543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls") pod "image-registry-86d4c85d56-km8dh" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e") : secret "image-registry-tls" not found
Jul 19 14:37:21.350981 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:21.350716    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls podName:cbdd8533-9848-42a8-99f0-1f28ae211619 nodeName:}" failed. No retries permitted until 2026-07-19 14:37:37.350694017 +0000 UTC m=+67.743256385 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls") pod "dns-default-4wrzz" (UID: "cbdd8533-9848-42a8-99f0-1f28ae211619") : secret "dns-default-metrics-tls" not found
Jul 19 14:37:31.461169 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:31.461137    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kksm"
Jul 19 14:37:36.762276 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:36.762236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:37:36.762669 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:36.762286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:37:36.764992 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:36.764971    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 19 14:37:36.765053 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:36.764994    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 19 14:37:36.772908 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:36.772889    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 19 14:37:36.772965 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:36.772948    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs podName:0529a9f4-7d49-47f5-9c5f-e61102a365d9 nodeName:}" failed. No retries permitted until 2026-07-19 14:38:40.772932073 +0000 UTC m=+131.165494436 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs") pod "network-metrics-daemon-52jmh" (UID: "0529a9f4-7d49-47f5-9c5f-e61102a365d9") : secret "metrics-daemon-secret" not found
Jul 19 14:37:36.776566 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:36.776540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2b7dc9f-5e13-4837-b5db-9b68f3cae761-original-pull-secret\") pod \"global-pull-secret-syncer-4hj4p\" (UID: \"c2b7dc9f-5e13-4837-b5db-9b68f3cae761\") " pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:37:36.862804 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:36.862773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mw8\" (UniqueName: \"kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8\") pod \"network-check-target-ksr4t\" (UID: \"4e9756e3-8335-42c8-984a-12a873af3294\") " pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:37:36.865472 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:36.865455    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 19 14:37:36.875318 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:36.875303    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 19 14:37:36.886222 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:36.886197    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45mw8\" (UniqueName: \"kubernetes.io/projected/4e9756e3-8335-42c8-984a-12a873af3294-kube-api-access-45mw8\") pod \"network-check-target-ksr4t\" (UID: \"4e9756e3-8335-42c8-984a-12a873af3294\") " pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:37:36.975254 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:36.975229    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hj4p"
Jul 19 14:37:36.990940 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:36.990918    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xgfj\""
Jul 19 14:37:36.998739 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:36.998710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:37:37.126312 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:37.126281    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4hj4p"]
Jul 19 14:37:37.129289 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:37:37.129265    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b7dc9f_5e13_4837_b5db_9b68f3cae761.slice/crio-022b25c334dac8a070d377320dbbfb3bc35800ba45a2ab65e535634edbda1a39 WatchSource:0}: Error finding container 022b25c334dac8a070d377320dbbfb3bc35800ba45a2ab65e535634edbda1a39: Status 404 returned error can't find the container with id 022b25c334dac8a070d377320dbbfb3bc35800ba45a2ab65e535634edbda1a39
Jul 19 14:37:37.140715 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:37.140689    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ksr4t"]
Jul 19 14:37:37.142981 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:37:37.142958    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e9756e3_8335_42c8_984a_12a873af3294.slice/crio-c0ea0330ea324dde752a87aad23373598ab3c8813cfd0d5d2496b935b05d58da WatchSource:0}: Error finding container c0ea0330ea324dde752a87aad23373598ab3c8813cfd0d5d2496b935b05d58da: Status 404 returned error can't find the container with id c0ea0330ea324dde752a87aad23373598ab3c8813cfd0d5d2496b935b05d58da
Jul 19 14:37:37.198531 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:37.198494    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ksr4t" event={"ID":"4e9756e3-8335-42c8-984a-12a873af3294","Type":"ContainerStarted","Data":"c0ea0330ea324dde752a87aad23373598ab3c8813cfd0d5d2496b935b05d58da"}
Jul 19 14:37:37.199403 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:37.199385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4hj4p" event={"ID":"c2b7dc9f-5e13-4837-b5db-9b68f3cae761","Type":"ContainerStarted","Data":"022b25c334dac8a070d377320dbbfb3bc35800ba45a2ab65e535634edbda1a39"}
Jul 19 14:37:37.367715 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:37.367634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:37:37.367715 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:37.367675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:37:37.367889 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:37.367789    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:37:37.367889 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:37.367793    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:37:37.367889 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:37.367813    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d4c85d56-km8dh: secret "image-registry-tls" not found
Jul 19 14:37:37.367889 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:37.367846    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls podName:cbdd8533-9848-42a8-99f0-1f28ae211619 nodeName:}" failed. No retries permitted until 2026-07-19 14:38:09.367830973 +0000 UTC m=+99.760393339 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls") pod "dns-default-4wrzz" (UID: "cbdd8533-9848-42a8-99f0-1f28ae211619") : secret "dns-default-metrics-tls" not found
Jul 19 14:37:37.367889 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:37:37.367861    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls podName:d76814d5-2688-48b2-8374-9ae7ac8a5e1e nodeName:}" failed. No retries permitted until 2026-07-19 14:38:09.367853624 +0000 UTC m=+99.760415987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls") pod "image-registry-86d4c85d56-km8dh" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e") : secret "image-registry-tls" not found
Jul 19 14:37:42.214913 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:42.214882    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ksr4t" event={"ID":"4e9756e3-8335-42c8-984a-12a873af3294","Type":"ContainerStarted","Data":"833ceeaa25c0143f2bff71ee1cace177b70821121ffc1e0261f8196a917ba67f"}
Jul 19 14:37:42.215450 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:42.214978    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:37:42.216325 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:42.216304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4hj4p" event={"ID":"c2b7dc9f-5e13-4837-b5db-9b68f3cae761","Type":"ContainerStarted","Data":"bb111a0bb553211ae2d12d2c5be0b4ce08b1ff4cb2c72b65706433be6f2110fd"}
Jul 19 14:37:42.230069 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:42.230027    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ksr4t" podStartSLOduration=66.482576318 podStartE2EDuration="1m11.230014068s" totalImagesPullingTime="4.74743775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:37:42.228822666 +0000 UTC m=+72.621385051" watchObservedRunningTime="2026-07-19 14:37:42.230014068 +0000 UTC m=+72.622576454"
Jul 19 14:37:42.242408 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:37:42.242366    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4hj4p" podStartSLOduration=66.469441478 podStartE2EDuration="1m11.242353419s" totalImagesPullingTime="4.772911941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:37:42.242043311 +0000 UTC m=+72.634605696" watchObservedRunningTime="2026-07-19 14:37:42.242353419 +0000 UTC m=+72.634915804"
Jul 19 14:38:09.385250 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:09.385210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:38:09.385678 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:09.385260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:38:09.385678 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:38:09.385360    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:38:09.385678 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:38:09.385365    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:38:09.385678 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:38:09.385385    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d4c85d56-km8dh: secret "image-registry-tls" not found
Jul 19 14:38:09.385678 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:38:09.385423    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls podName:cbdd8533-9848-42a8-99f0-1f28ae211619 nodeName:}" failed. No retries permitted until 2026-07-19 14:39:13.38540893 +0000 UTC m=+163.777971293 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls") pod "dns-default-4wrzz" (UID: "cbdd8533-9848-42a8-99f0-1f28ae211619") : secret "dns-default-metrics-tls" not found
Jul 19 14:38:09.385678 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:38:09.385443    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls podName:d76814d5-2688-48b2-8374-9ae7ac8a5e1e nodeName:}" failed. No retries permitted until 2026-07-19 14:39:13.385428386 +0000 UTC m=+163.777990749 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls") pod "image-registry-86d4c85d56-km8dh" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e") : secret "image-registry-tls" not found
Jul 19 14:38:13.221312 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:13.221280    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ksr4t"
Jul 19 14:38:28.142866 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.142828    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"]
Jul 19 14:38:28.144608 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.144592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.147084 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.147054    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 19 14:38:28.147224 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.147188    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 19 14:38:28.147287 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.147220    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 19 14:38:28.148237 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.148217    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 19 14:38:28.148336 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.148296    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 19 14:38:28.148396 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.148348    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 19 14:38:28.148513 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.148498    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 19 14:38:28.159944 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.159918    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"]
Jul 19 14:38:28.207637 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.207606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b13f469-8f88-4b47-84e8-13a4a5433a10-ca\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.207818 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.207641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b13f469-8f88-4b47-84e8-13a4a5433a10-hub\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.207818 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.207666    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b13f469-8f88-4b47-84e8-13a4a5433a10-additional-service-ca\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.207818 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.207700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b13f469-8f88-4b47-84e8-13a4a5433a10-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.207818 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.207749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b13f469-8f88-4b47-84e8-13a4a5433a10-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.207818 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.207782    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdnwp\" (UniqueName: \"kubernetes.io/projected/7b13f469-8f88-4b47-84e8-13a4a5433a10-kube-api-access-zdnwp\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.308097 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.308058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b13f469-8f88-4b47-84e8-13a4a5433a10-ca\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.308097 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.308099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b13f469-8f88-4b47-84e8-13a4a5433a10-hub\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.308316 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.308126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b13f469-8f88-4b47-84e8-13a4a5433a10-additional-service-ca\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.308316 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.308220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b13f469-8f88-4b47-84e8-13a4a5433a10-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.308316 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.308260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b13f469-8f88-4b47-84e8-13a4a5433a10-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.308316 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.308291    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdnwp\" (UniqueName: \"kubernetes.io/projected/7b13f469-8f88-4b47-84e8-13a4a5433a10-kube-api-access-zdnwp\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.308983 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.308955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b13f469-8f88-4b47-84e8-13a4a5433a10-additional-service-ca\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.310583 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.310540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b13f469-8f88-4b47-84e8-13a4a5433a10-ca\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.310970 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.310952    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b13f469-8f88-4b47-84e8-13a4a5433a10-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.311073 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.311055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b13f469-8f88-4b47-84e8-13a4a5433a10-hub\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.311135 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.311117    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b13f469-8f88-4b47-84e8-13a4a5433a10-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.317118 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.317094    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdnwp\" (UniqueName: \"kubernetes.io/projected/7b13f469-8f88-4b47-84e8-13a4a5433a10-kube-api-access-zdnwp\") pod \"cluster-proxy-proxy-agent-667d545484-t6cjs\" (UID: \"7b13f469-8f88-4b47-84e8-13a4a5433a10\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.466048 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.466021    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:38:28.585854 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:28.585825    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"]
Jul 19 14:38:28.589136 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:38:28.589111    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b13f469_8f88_4b47_84e8_13a4a5433a10.slice/crio-1a97d27f23cc1133546d53417fb4d086a29f725cee5866a9c963ddc0c369172f WatchSource:0}: Error finding container 1a97d27f23cc1133546d53417fb4d086a29f725cee5866a9c963ddc0c369172f: Status 404 returned error can't find the container with id 1a97d27f23cc1133546d53417fb4d086a29f725cee5866a9c963ddc0c369172f
Jul 19 14:38:29.332689 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:29.332648    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs" event={"ID":"7b13f469-8f88-4b47-84e8-13a4a5433a10","Type":"ContainerStarted","Data":"1a97d27f23cc1133546d53417fb4d086a29f725cee5866a9c963ddc0c369172f"}
Jul 19 14:38:33.345662 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:33.345618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs" event={"ID":"7b13f469-8f88-4b47-84e8-13a4a5433a10","Type":"ContainerStarted","Data":"caa63ff725c2272e98409a5a75978c687417b3004b7a20d213ad759305a9192d"}
Jul 19 14:38:33.345662 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:33.345666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs" event={"ID":"7b13f469-8f88-4b47-84e8-13a4a5433a10","Type":"ContainerStarted","Data":"4e6da3779683d9944c9f11da3f82371ba533eaec7a45603977c2b60761a43048"}
Jul 19 14:38:33.346134 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:33.345680    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs" event={"ID":"7b13f469-8f88-4b47-84e8-13a4a5433a10","Type":"ContainerStarted","Data":"b9168fd983dee5f1854dd4d88ee0d4fbfbeea5af742236701015926eccf3c473"}
Jul 19 14:38:33.363471 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:33.363429    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs" podStartSLOduration=1.6400187480000001 podStartE2EDuration="5.363414289s" totalImagesPullingTime="3.723395541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:38:33.362289254 +0000 UTC m=+123.754851641" watchObservedRunningTime="2026-07-19 14:38:33.363414289 +0000 UTC m=+123.755976674"
Jul 19 14:38:40.798293 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:38:40.798245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:38:40.798712 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:38:40.798411    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 19 14:38:40.798712 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:38:40.798490    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs podName:0529a9f4-7d49-47f5-9c5f-e61102a365d9 nodeName:}" failed. No retries permitted until 2026-07-19 14:40:42.798473877 +0000 UTC m=+253.191036243 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs") pod "network-metrics-daemon-52jmh" (UID: "0529a9f4-7d49-47f5-9c5f-e61102a365d9") : secret "metrics-daemon-secret" not found
Jul 19 14:39:08.498334 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:39:08.498292    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh" podUID="d76814d5-2688-48b2-8374-9ae7ac8a5e1e"
Jul 19 14:39:08.535464 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:39:08.535434    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4wrzz" podUID="cbdd8533-9848-42a8-99f0-1f28ae211619"
Jul 19 14:39:09.446148 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:39:09.446106    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:39:09.446612 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:39:09.446594    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:39:09.982675 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:39:09.982635    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:39:13.430415 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:39:13.430380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:39:13.430415 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:39:13.430423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:39:13.430839 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:39:13.430524    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:39:13.430839 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:39:13.430530    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:39:13.430839 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:39:13.430551    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86d4c85d56-km8dh: secret "image-registry-tls" not found
Jul 19 14:39:13.430839 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:39:13.430575    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls podName:cbdd8533-9848-42a8-99f0-1f28ae211619 nodeName:}" failed. No retries permitted until 2026-07-19 14:41:15.430561622 +0000 UTC m=+285.823123985 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls") pod "dns-default-4wrzz" (UID: "cbdd8533-9848-42a8-99f0-1f28ae211619") : secret "dns-default-metrics-tls" not found
Jul 19 14:39:13.430839 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:39:13.430602    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls podName:d76814d5-2688-48b2-8374-9ae7ac8a5e1e nodeName:}" failed. No retries permitted until 2026-07-19 14:41:15.430588562 +0000 UTC m=+285.823150925 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls") pod "image-registry-86d4c85d56-km8dh" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e") : secret "image-registry-tls" not found
Jul 19 14:39:24.962358 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:39:24.962266    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:40:42.876015 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:40:42.875974    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:40:42.876525 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:40:42.876137    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 19 14:40:42.876525 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:40:42.876215    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs podName:0529a9f4-7d49-47f5-9c5f-e61102a365d9 nodeName:}" failed. No retries permitted until 2026-07-19 14:42:44.876199668 +0000 UTC m=+375.268762035 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs") pod "network-metrics-daemon-52jmh" (UID: "0529a9f4-7d49-47f5-9c5f-e61102a365d9") : secret "metrics-daemon-secret" not found
Jul 19 14:41:00.189527 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.189441    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4s7vz"]
Jul 19 14:41:00.192598 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.192576    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.194830 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.194802    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 19 14:41:00.195810 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.195790    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 19 14:41:00.195872 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.195823    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 19 14:41:00.195872 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.195856    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 19 14:41:00.195952 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.195875    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4qjwr\""
Jul 19 14:41:00.202029 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.201998    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4s7vz"]
Jul 19 14:41:00.295847 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.295807    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4384ca8c-19d8-4d39-9022-13785e868b59-data-volume\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.296052 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.295873    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.296052 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.295900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4384ca8c-19d8-4d39-9022-13785e868b59-crio-socket\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.296052 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.295923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw5gj\" (UniqueName: \"kubernetes.io/projected/4384ca8c-19d8-4d39-9022-13785e868b59-kube-api-access-nw5gj\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.296052 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.295993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.396316 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.396282    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.396316 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.396316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4384ca8c-19d8-4d39-9022-13785e868b59-crio-socket\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.396510 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.396338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw5gj\" (UniqueName: \"kubernetes.io/projected/4384ca8c-19d8-4d39-9022-13785e868b59-kube-api-access-nw5gj\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.396510 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.396366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.396510 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.396433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4384ca8c-19d8-4d39-9022-13785e868b59-data-volume\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.396510 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.396430    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4384ca8c-19d8-4d39-9022-13785e868b59-crio-socket\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.396637 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:00.396512    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 19 14:41:00.396637 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:00.396537    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 19 14:41:00.396637 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:00.396576    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls podName:4384ca8c-19d8-4d39-9022-13785e868b59 nodeName:}" failed. No retries permitted until 2026-07-19 14:41:00.896561405 +0000 UTC m=+271.289123768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s7vz" (UID: "4384ca8c-19d8-4d39-9022-13785e868b59") : secret "insights-runtime-extractor-tls" not found
Jul 19 14:41:00.396637 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:00.396607    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm podName:4384ca8c-19d8-4d39-9022-13785e868b59 nodeName:}" failed. No retries permitted until 2026-07-19 14:41:00.896590207 +0000 UTC m=+271.289152586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s7vz" (UID: "4384ca8c-19d8-4d39-9022-13785e868b59") : configmap "kube-rbac-proxy" not found
Jul 19 14:41:00.396784 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.396768    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4384ca8c-19d8-4d39-9022-13785e868b59-data-volume\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.406663 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.406633    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw5gj\" (UniqueName: \"kubernetes.io/projected/4384ca8c-19d8-4d39-9022-13785e868b59-kube-api-access-nw5gj\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.899974 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.899918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.899974 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:00.899982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:00.900255 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:00.900041    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 19 14:41:00.900255 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:00.900095    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 19 14:41:00.900255 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:00.900106    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm podName:4384ca8c-19d8-4d39-9022-13785e868b59 nodeName:}" failed. No retries permitted until 2026-07-19 14:41:01.900091181 +0000 UTC m=+272.292653543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s7vz" (UID: "4384ca8c-19d8-4d39-9022-13785e868b59") : configmap "kube-rbac-proxy" not found
Jul 19 14:41:00.900255 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:00.900151    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls podName:4384ca8c-19d8-4d39-9022-13785e868b59 nodeName:}" failed. No retries permitted until 2026-07-19 14:41:01.900137215 +0000 UTC m=+272.292699592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s7vz" (UID: "4384ca8c-19d8-4d39-9022-13785e868b59") : secret "insights-runtime-extractor-tls" not found
Jul 19 14:41:01.908058 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:01.908018    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:01.908058 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:01.908058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:01.908488 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:01.908136    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 19 14:41:01.908488 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:01.908215    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 19 14:41:01.908488 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:01.908220    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm podName:4384ca8c-19d8-4d39-9022-13785e868b59 nodeName:}" failed. No retries permitted until 2026-07-19 14:41:03.908203004 +0000 UTC m=+274.300765368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s7vz" (UID: "4384ca8c-19d8-4d39-9022-13785e868b59") : configmap "kube-rbac-proxy" not found
Jul 19 14:41:01.908488 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:01.908254    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls podName:4384ca8c-19d8-4d39-9022-13785e868b59 nodeName:}" failed. No retries permitted until 2026-07-19 14:41:03.908243371 +0000 UTC m=+274.300805734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s7vz" (UID: "4384ca8c-19d8-4d39-9022-13785e868b59") : secret "insights-runtime-extractor-tls" not found
Jul 19 14:41:03.271470 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:03.271440    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wcvsd_71c9fd9a-f6de-4c6e-b44c-cb761417d887/dns-node-resolver/0.log"
Jul 19 14:41:03.870883 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:03.870857    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-264jl_6e02de66-c838-4a32-a23e-5e948f61cf8e/node-ca/0.log"
Jul 19 14:41:03.923360 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:03.923327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:03.923542 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:03.923449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:03.923542 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:03.923478    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 19 14:41:03.923542 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:03.923530    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 19 14:41:03.923675 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:03.923552    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls podName:4384ca8c-19d8-4d39-9022-13785e868b59 nodeName:}" failed. No retries permitted until 2026-07-19 14:41:07.923535743 +0000 UTC m=+278.316098113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s7vz" (UID: "4384ca8c-19d8-4d39-9022-13785e868b59") : secret "insights-runtime-extractor-tls" not found
Jul 19 14:41:03.923675 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:03.923594    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm podName:4384ca8c-19d8-4d39-9022-13785e868b59 nodeName:}" failed. No retries permitted until 2026-07-19 14:41:07.923578222 +0000 UTC m=+278.316140614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s7vz" (UID: "4384ca8c-19d8-4d39-9022-13785e868b59") : configmap "kube-rbac-proxy" not found
Jul 19 14:41:04.871202 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:04.871164    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d66jn_54c8a2d7-3080-4b45-b121-4f689792949b/serve-healthcheck-canary/0.log"
Jul 19 14:41:07.952590 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:07.952557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:07.952590 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:07.952592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:07.953082 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:07.952692    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 19 14:41:07.953082 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:07.952709    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 19 14:41:07.953082 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:07.952757    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls podName:4384ca8c-19d8-4d39-9022-13785e868b59 nodeName:}" failed. No retries permitted until 2026-07-19 14:41:15.952744114 +0000 UTC m=+286.345306481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s7vz" (UID: "4384ca8c-19d8-4d39-9022-13785e868b59") : secret "insights-runtime-extractor-tls" not found
Jul 19 14:41:07.953082 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:07.952771    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm podName:4384ca8c-19d8-4d39-9022-13785e868b59 nodeName:}" failed. No retries permitted until 2026-07-19 14:41:15.952764132 +0000 UTC m=+286.345326494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s7vz" (UID: "4384ca8c-19d8-4d39-9022-13785e868b59") : configmap "kube-rbac-proxy" not found
Jul 19 14:41:12.447094 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:12.447048    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh" podUID="d76814d5-2688-48b2-8374-9ae7ac8a5e1e"
Jul 19 14:41:12.447094 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:12.447048    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4wrzz" podUID="cbdd8533-9848-42a8-99f0-1f28ae211619"
Jul 19 14:41:12.779756 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:12.779729    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:41:12.779923 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:12.779730    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:41:15.519535 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:15.519494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:41:15.519535 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:15.519542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:41:15.521884 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:15.521864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbdd8533-9848-42a8-99f0-1f28ae211619-metrics-tls\") pod \"dns-default-4wrzz\" (UID: \"cbdd8533-9848-42a8-99f0-1f28ae211619\") " pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:41:15.521959 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:15.521915    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") pod \"image-registry-86d4c85d56-km8dh\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") " pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:41:15.783743 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:15.783649    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rz27h\""
Jul 19 14:41:15.783743 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:15.783649    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vqq7\""
Jul 19 14:41:15.791114 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:15.791092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:41:15.791259 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:15.791114    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:41:15.935645 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:15.935613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86d4c85d56-km8dh"]
Jul 19 14:41:15.939411 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:41:15.939383    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd76814d5_2688_48b2_8374_9ae7ac8a5e1e.slice/crio-99e678f7c30d9b53149a44fcc03148b06629b7ba64308aebcc0679f2465baec0 WatchSource:0}: Error finding container 99e678f7c30d9b53149a44fcc03148b06629b7ba64308aebcc0679f2465baec0: Status 404 returned error can't find the container with id 99e678f7c30d9b53149a44fcc03148b06629b7ba64308aebcc0679f2465baec0
Jul 19 14:41:15.949257 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:15.949218    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4wrzz"]
Jul 19 14:41:15.953872 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:41:15.953842    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbdd8533_9848_42a8_99f0_1f28ae211619.slice/crio-89d6143735bb93760b766719dd5a4611a5d478af8c87272a9629059d67536988 WatchSource:0}: Error finding container 89d6143735bb93760b766719dd5a4611a5d478af8c87272a9629059d67536988: Status 404 returned error can't find the container with id 89d6143735bb93760b766719dd5a4611a5d478af8c87272a9629059d67536988
Jul 19 14:41:16.024502 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:16.024474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:16.024502 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:16.024514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:16.024994 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:16.024969    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4384ca8c-19d8-4d39-9022-13785e868b59-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:16.026659 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:16.026637    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4384ca8c-19d8-4d39-9022-13785e868b59-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s7vz\" (UID: \"4384ca8c-19d8-4d39-9022-13785e868b59\") " pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:16.102266 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:16.102158    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4s7vz"
Jul 19 14:41:16.226023 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:16.225991    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4s7vz"]
Jul 19 14:41:16.228959 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:41:16.228938    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4384ca8c_19d8_4d39_9022_13785e868b59.slice/crio-b443e3429fb5047088e6625c5eb1f86007f9e0dca089c8b8c980f0294970b444 WatchSource:0}: Error finding container b443e3429fb5047088e6625c5eb1f86007f9e0dca089c8b8c980f0294970b444: Status 404 returned error can't find the container with id b443e3429fb5047088e6625c5eb1f86007f9e0dca089c8b8c980f0294970b444
Jul 19 14:41:16.795299 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:16.795206    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s7vz" event={"ID":"4384ca8c-19d8-4d39-9022-13785e868b59","Type":"ContainerStarted","Data":"b443e3429fb5047088e6625c5eb1f86007f9e0dca089c8b8c980f0294970b444"}
Jul 19 14:41:16.799031 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:16.798732    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh" event={"ID":"d76814d5-2688-48b2-8374-9ae7ac8a5e1e","Type":"ContainerStarted","Data":"cac7db0f6a0535eb7a36f06ae09b9d5d26ae666c67d04a6afc3cafaa15cfcd2c"}
Jul 19 14:41:16.799031 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:16.798779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh" event={"ID":"d76814d5-2688-48b2-8374-9ae7ac8a5e1e","Type":"ContainerStarted","Data":"99e678f7c30d9b53149a44fcc03148b06629b7ba64308aebcc0679f2465baec0"}
Jul 19 14:41:16.799031 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:16.798819    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:41:16.801196 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:16.801155    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4wrzz" event={"ID":"cbdd8533-9848-42a8-99f0-1f28ae211619","Type":"ContainerStarted","Data":"89d6143735bb93760b766719dd5a4611a5d478af8c87272a9629059d67536988"}
Jul 19 14:41:16.819158 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:16.819101    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh" podStartSLOduration=266.819079925 podStartE2EDuration="4m26.819079925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:36:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:41:16.818374851 +0000 UTC m=+287.210937237" watchObservedRunningTime="2026-07-19 14:41:16.819079925 +0000 UTC m=+287.211642312"
Jul 19 14:41:17.806553 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:17.806513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4wrzz" event={"ID":"cbdd8533-9848-42a8-99f0-1f28ae211619","Type":"ContainerStarted","Data":"770889c0f81e6ba5e76275ff5050bd4f0a324c144ad90b08ed4dd5fc34331415"}
Jul 19 14:41:18.812860 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:18.812816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4wrzz" event={"ID":"cbdd8533-9848-42a8-99f0-1f28ae211619","Type":"ContainerStarted","Data":"457d2d82d246c5884425dab0633f52124db6cab360419683bb088487fa2c6b07"}
Jul 19 14:41:18.813350 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:18.812959    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:41:18.830678 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:18.830604    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4wrzz" podStartSLOduration=252.086660113 podStartE2EDuration="4m13.830579617s" totalImagesPullingTime="1.743919504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:41:18.829543577 +0000 UTC m=+289.222105961" watchObservedRunningTime="2026-07-19 14:41:18.830579617 +0000 UTC m=+289.223142003"
Jul 19 14:41:21.827406 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:21.827368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s7vz" event={"ID":"4384ca8c-19d8-4d39-9022-13785e868b59","Type":"ContainerStarted","Data":"e06defa32c53cd8ebb3137e5ae34d37d3526a4cc90e0cc86c9ff7f95bcda3e4b"}
Jul 19 14:41:24.529800 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:24.529764    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86d4c85d56-km8dh"]
Jul 19 14:41:24.531951 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:24.531922    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-fc6lx"]
Jul 19 14:41:24.543683 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:24.543656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-fc6lx"
Jul 19 14:41:24.545219 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:24.545193    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-fc6lx"]
Jul 19 14:41:24.546027 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:24.546012    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 19 14:41:24.546324 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:24.546308    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 19 14:41:24.546405 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:24.546362    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mxffd\""
Jul 19 14:41:24.694064 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:24.694041    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqdjr\" (UniqueName: \"kubernetes.io/projected/4f08afff-1a6e-4d89-9a38-aaae8d5c7877-kube-api-access-hqdjr\") pod \"downloads-5bc67dcd46-fc6lx\" (UID: \"4f08afff-1a6e-4d89-9a38-aaae8d5c7877\") " pod="openshift-console/downloads-5bc67dcd46-fc6lx"
Jul 19 14:41:24.795201 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:24.795087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqdjr\" (UniqueName: \"kubernetes.io/projected/4f08afff-1a6e-4d89-9a38-aaae8d5c7877-kube-api-access-hqdjr\") pod \"downloads-5bc67dcd46-fc6lx\" (UID: \"4f08afff-1a6e-4d89-9a38-aaae8d5c7877\") " pod="openshift-console/downloads-5bc67dcd46-fc6lx"
Jul 19 14:41:24.806511 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:24.806479    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqdjr\" (UniqueName: \"kubernetes.io/projected/4f08afff-1a6e-4d89-9a38-aaae8d5c7877-kube-api-access-hqdjr\") pod \"downloads-5bc67dcd46-fc6lx\" (UID: \"4f08afff-1a6e-4d89-9a38-aaae8d5c7877\") " pod="openshift-console/downloads-5bc67dcd46-fc6lx"
Jul 19 14:41:24.838472 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:24.838437    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s7vz" event={"ID":"4384ca8c-19d8-4d39-9022-13785e868b59","Type":"ContainerStarted","Data":"2208230aa30ff11923c28c56e939d5a5d1d08500da384e20f773056c22ec4dd2"}
Jul 19 14:41:24.852760 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:24.852734    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-fc6lx"
Jul 19 14:41:24.978945 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:24.978912    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-fc6lx"]
Jul 19 14:41:24.983003 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:41:24.982977    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f08afff_1a6e_4d89_9a38_aaae8d5c7877.slice/crio-fb33aebb38cad41ba4a075124531a2e0c81d7cd05be7ff83e28d0733fa6244d9 WatchSource:0}: Error finding container fb33aebb38cad41ba4a075124531a2e0c81d7cd05be7ff83e28d0733fa6244d9: Status 404 returned error can't find the container with id fb33aebb38cad41ba4a075124531a2e0c81d7cd05be7ff83e28d0733fa6244d9
Jul 19 14:41:25.845841 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:25.845767    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-fc6lx" event={"ID":"4f08afff-1a6e-4d89-9a38-aaae8d5c7877","Type":"ContainerStarted","Data":"fb33aebb38cad41ba4a075124531a2e0c81d7cd05be7ff83e28d0733fa6244d9"}
Jul 19 14:41:27.963012 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:27.962965    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-52jmh" podUID="0529a9f4-7d49-47f5-9c5f-e61102a365d9"
Jul 19 14:41:28.819199 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:28.819150    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4wrzz"
Jul 19 14:41:28.860939 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:28.860849    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s7vz" event={"ID":"4384ca8c-19d8-4d39-9022-13785e868b59","Type":"ContainerStarted","Data":"1d8605705a7edfcc89bca8799b77bf952a8c51ed3835eac41d7a7205f0c918f5"}
Jul 19 14:41:28.877435 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:28.877024    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4s7vz" podStartSLOduration=16.619034966 podStartE2EDuration="28.877002191s" totalImagesPullingTime="12.257967225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:41:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:41:28.876979527 +0000 UTC m=+299.269541912" watchObservedRunningTime="2026-07-19 14:41:28.877002191 +0000 UTC m=+299.269564577"
Jul 19 14:41:30.884638 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:30.884612    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 19 14:41:34.536611 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.536581    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:41:34.660158 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.660117    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"]
Jul 19 14:41:34.663125 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.663096    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:34.665830 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.665799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d16b3033-1593-4d5b-8e4b-a63289b75b7b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-5zpkx\" (UID: \"d16b3033-1593-4d5b-8e4b-a63289b75b7b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:34.665973 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.665862    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gvsjt\""
Jul 19 14:41:34.665973 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.665874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d16b3033-1593-4d5b-8e4b-a63289b75b7b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-5zpkx\" (UID: \"d16b3033-1593-4d5b-8e4b-a63289b75b7b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:34.665973 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.665888    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 19 14:41:34.665973 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.665906    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d16b3033-1593-4d5b-8e4b-a63289b75b7b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-5zpkx\" (UID: \"d16b3033-1593-4d5b-8e4b-a63289b75b7b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:34.665973 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.665929    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 19 14:41:34.665973 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.665935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wthcn\" (UniqueName: \"kubernetes.io/projected/d16b3033-1593-4d5b-8e4b-a63289b75b7b-kube-api-access-wthcn\") pod \"openshift-state-metrics-79f6958cdf-5zpkx\" (UID: \"d16b3033-1593-4d5b-8e4b-a63289b75b7b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:34.666314 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.666164    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 19 14:41:34.666314 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.666239    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 19 14:41:34.666314 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.666253    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 19 14:41:34.675286 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.675235    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"]
Jul 19 14:41:34.689790 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.689702    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sflgh"]
Jul 19 14:41:34.693009 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.692977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.695589 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.695520    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 19 14:41:34.695720 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.695524    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zt9dh\""
Jul 19 14:41:34.695788 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.695746    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 19 14:41:34.695872 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.695844    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 19 14:41:34.766697 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.766660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d16b3033-1593-4d5b-8e4b-a63289b75b7b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-5zpkx\" (UID: \"d16b3033-1593-4d5b-8e4b-a63289b75b7b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:34.766697 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.766699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-wtmp\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.766948 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.766718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d16b3033-1593-4d5b-8e4b-a63289b75b7b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-5zpkx\" (UID: \"d16b3033-1593-4d5b-8e4b-a63289b75b7b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:34.766948 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.766737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wthcn\" (UniqueName: \"kubernetes.io/projected/d16b3033-1593-4d5b-8e4b-a63289b75b7b-kube-api-access-wthcn\") pod \"openshift-state-metrics-79f6958cdf-5zpkx\" (UID: \"d16b3033-1593-4d5b-8e4b-a63289b75b7b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:34.766948 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.766763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d35b32d7-a273-4ab9-b3c3-51a246672fb2-sys\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.766948 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.766785    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.766948 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.766839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d35b32d7-a273-4ab9-b3c3-51a246672fb2-metrics-client-ca\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.766948 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.766907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d16b3033-1593-4d5b-8e4b-a63289b75b7b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-5zpkx\" (UID: \"d16b3033-1593-4d5b-8e4b-a63289b75b7b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:34.767287 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.766954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-tls\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.767287 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.766982    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4cpp\" (UniqueName: \"kubernetes.io/projected/d35b32d7-a273-4ab9-b3c3-51a246672fb2-kube-api-access-k4cpp\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.767287 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.767013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d35b32d7-a273-4ab9-b3c3-51a246672fb2-root\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.767287 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.767039    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-textfile\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.767287 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:34.767014    2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 19 14:41:34.767287 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.767064    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-accelerators-collector-config\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.767287 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:34.767114    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d16b3033-1593-4d5b-8e4b-a63289b75b7b-openshift-state-metrics-tls podName:d16b3033-1593-4d5b-8e4b-a63289b75b7b nodeName:}" failed. No retries permitted until 2026-07-19 14:41:35.267093072 +0000 UTC m=+305.659655440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d16b3033-1593-4d5b-8e4b-a63289b75b7b-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-5zpkx" (UID: "d16b3033-1593-4d5b-8e4b-a63289b75b7b") : secret "openshift-state-metrics-tls" not found
Jul 19 14:41:34.767560 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.767543    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d16b3033-1593-4d5b-8e4b-a63289b75b7b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-5zpkx\" (UID: \"d16b3033-1593-4d5b-8e4b-a63289b75b7b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:34.769422 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.769400    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d16b3033-1593-4d5b-8e4b-a63289b75b7b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-5zpkx\" (UID: \"d16b3033-1593-4d5b-8e4b-a63289b75b7b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:34.777531 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.777505    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wthcn\" (UniqueName: \"kubernetes.io/projected/d16b3033-1593-4d5b-8e4b-a63289b75b7b-kube-api-access-wthcn\") pod \"openshift-state-metrics-79f6958cdf-5zpkx\" (UID: \"d16b3033-1593-4d5b-8e4b-a63289b75b7b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:34.868101 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d35b32d7-a273-4ab9-b3c3-51a246672fb2-sys\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.868101 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.868343 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d35b32d7-a273-4ab9-b3c3-51a246672fb2-metrics-client-ca\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.868343 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-tls\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.868343 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4cpp\" (UniqueName: \"kubernetes.io/projected/d35b32d7-a273-4ab9-b3c3-51a246672fb2-kube-api-access-k4cpp\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.868343 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868275    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d35b32d7-a273-4ab9-b3c3-51a246672fb2-sys\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.868343 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d35b32d7-a273-4ab9-b3c3-51a246672fb2-root\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.868343 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868319    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d35b32d7-a273-4ab9-b3c3-51a246672fb2-root\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.868343 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-textfile\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.868686 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-accelerators-collector-config\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.868686 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-wtmp\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.868686 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868518    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-wtmp\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.868835 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868697    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-textfile\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.868835 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868812    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d35b32d7-a273-4ab9-b3c3-51a246672fb2-metrics-client-ca\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.869013 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.868991    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-accelerators-collector-config\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.870777 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.870754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-tls\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.870878 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.870851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d35b32d7-a273-4ab9-b3c3-51a246672fb2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:34.875438 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:34.875415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4cpp\" (UniqueName: \"kubernetes.io/projected/d35b32d7-a273-4ab9-b3c3-51a246672fb2-kube-api-access-k4cpp\") pod \"node-exporter-sflgh\" (UID: \"d35b32d7-a273-4ab9-b3c3-51a246672fb2\") " pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:35.003583 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.003553    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sflgh"
Jul 19 14:41:35.197366 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.197292    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77795bf9c-2wj5r"]
Jul 19 14:41:35.200375 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.200354    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.203100 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.203039    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 19 14:41:35.203100 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.203082    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lzfm7\""
Jul 19 14:41:35.203307 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.203219    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 19 14:41:35.203377 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.203334    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 19 14:41:35.203377 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.203353    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 19 14:41:35.203476 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.203453    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 19 14:41:35.208282 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.208222    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 19 14:41:35.211389 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.211353    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77795bf9c-2wj5r"]
Jul 19 14:41:35.272241 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.272197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afedeaed-4628-490e-99f5-ddb2b291665b-console-serving-cert\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.272417 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.272271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-service-ca\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.272417 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.272300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-trusted-ca-bundle\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.272417 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.272353    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d16b3033-1593-4d5b-8e4b-a63289b75b7b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-5zpkx\" (UID: \"d16b3033-1593-4d5b-8e4b-a63289b75b7b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:35.272417 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.272386    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afedeaed-4628-490e-99f5-ddb2b291665b-console-oauth-config\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.272625 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.272418    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-oauth-serving-cert\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.272625 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.272442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6wfh\" (UniqueName: \"kubernetes.io/projected/afedeaed-4628-490e-99f5-ddb2b291665b-kube-api-access-d6wfh\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.272625 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.272497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-console-config\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.274933 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.274909    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d16b3033-1593-4d5b-8e4b-a63289b75b7b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-5zpkx\" (UID: \"d16b3033-1593-4d5b-8e4b-a63289b75b7b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:35.373501 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.373455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afedeaed-4628-490e-99f5-ddb2b291665b-console-serving-cert\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.373676 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.373523    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-service-ca\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.373676 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.373547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-trusted-ca-bundle\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.373676 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.373595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afedeaed-4628-490e-99f5-ddb2b291665b-console-oauth-config\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.373787 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.373669    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-oauth-serving-cert\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.373787 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.373705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6wfh\" (UniqueName: \"kubernetes.io/projected/afedeaed-4628-490e-99f5-ddb2b291665b-kube-api-access-d6wfh\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.373787 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.373730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-console-config\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.374456 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.374429    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-service-ca\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.374568 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.374482    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-console-config\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.374568 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.374559    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-oauth-serving-cert\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.374904 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.374878    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-trusted-ca-bundle\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.376248 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.376226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afedeaed-4628-490e-99f5-ddb2b291665b-console-serving-cert\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.376368 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.376336    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afedeaed-4628-490e-99f5-ddb2b291665b-console-oauth-config\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.382148 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.382125    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6wfh\" (UniqueName: \"kubernetes.io/projected/afedeaed-4628-490e-99f5-ddb2b291665b-kube-api-access-d6wfh\") pod \"console-77795bf9c-2wj5r\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") " pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.512549 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.512498    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:35.573882 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:35.573847    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"
Jul 19 14:41:36.651904 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.651871    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"]
Jul 19 14:41:36.658638 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.658609    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.660997 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.660950    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 19 14:41:36.661114 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.661088    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 19 14:41:36.661207 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.661088    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 19 14:41:36.661207 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.661120    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 19 14:41:36.661207 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.661195    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-29fecvcsnutva\""
Jul 19 14:41:36.661383 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.661204    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 19 14:41:36.661575 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.661558    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4g5rz\""
Jul 19 14:41:36.666086 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.666036    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"]
Jul 19 14:41:36.683760 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.683723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.683931 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.683781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7317a362-036e-4229-a6c1-3b4a69e83a78-metrics-client-ca\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.683931 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.683858    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-grpc-tls\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.683931 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.683900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6k8l\" (UniqueName: \"kubernetes.io/projected/7317a362-036e-4229-a6c1-3b4a69e83a78-kube-api-access-d6k8l\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.683931 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.683926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.684115 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.683951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-tls\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.684115 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.684021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.684115 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.684099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.785137 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.785097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-tls\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.785332 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.785158    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.785332 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.785213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.785332 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.785282    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.785332 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.785321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7317a362-036e-4229-a6c1-3b4a69e83a78-metrics-client-ca\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.785512 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.785349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-grpc-tls\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.785512 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.785374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6k8l\" (UniqueName: \"kubernetes.io/projected/7317a362-036e-4229-a6c1-3b4a69e83a78-kube-api-access-d6k8l\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.785512 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.785407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.786486 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.786435    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7317a362-036e-4229-a6c1-3b4a69e83a78-metrics-client-ca\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.788593 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.788525    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-tls\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.788593 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.788529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.788840 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.788815    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-grpc-tls\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.788966 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.788895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.789164 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.789140    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.789267 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.789200    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7317a362-036e-4229-a6c1-3b4a69e83a78-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.794007 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.793983    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6k8l\" (UniqueName: \"kubernetes.io/projected/7317a362-036e-4229-a6c1-3b4a69e83a78-kube-api-access-d6k8l\") pod \"thanos-querier-c5486d4bb-w6ltv\" (UID: \"7317a362-036e-4229-a6c1-3b4a69e83a78\") " pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:36.970236 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:36.970191    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:39.848880 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.848845    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"]
Jul 19 14:41:39.852771 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.852752    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:39.855211 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.855167    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 19 14:41:39.855211 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.855200    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 19 14:41:39.855211 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.855212    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-q2pnb\""
Jul 19 14:41:39.855607 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.855592    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 19 14:41:39.855678 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.855592    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 19 14:41:39.856349 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.856263    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 19 14:41:39.860401 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.860381    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 19 14:41:39.869025 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.869002    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"]
Jul 19 14:41:39.914797 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.914763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a4113615-e5e0-470e-83e0-bd47ac6c9718-secret-telemeter-client\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:39.914797 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.914803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4113615-e5e0-470e-83e0-bd47ac6c9718-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:39.915045 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.914823    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4113615-e5e0-470e-83e0-bd47ac6c9718-metrics-client-ca\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:39.915045 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.914842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmw7l\" (UniqueName: \"kubernetes.io/projected/a4113615-e5e0-470e-83e0-bd47ac6c9718-kube-api-access-qmw7l\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:39.915045 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.914883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a4113615-e5e0-470e-83e0-bd47ac6c9718-telemeter-client-tls\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:39.915045 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.914923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4113615-e5e0-470e-83e0-bd47ac6c9718-serving-certs-ca-bundle\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:39.915045 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.914952    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4113615-e5e0-470e-83e0-bd47ac6c9718-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:39.915045 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:39.915021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a4113615-e5e0-470e-83e0-bd47ac6c9718-federate-client-tls\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.016194 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.016143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4113615-e5e0-470e-83e0-bd47ac6c9718-serving-certs-ca-bundle\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.016356 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.016203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4113615-e5e0-470e-83e0-bd47ac6c9718-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.016356 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.016280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a4113615-e5e0-470e-83e0-bd47ac6c9718-federate-client-tls\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.016356 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.016329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a4113615-e5e0-470e-83e0-bd47ac6c9718-secret-telemeter-client\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.016356 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.016353    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4113615-e5e0-470e-83e0-bd47ac6c9718-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.016626 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.016375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4113615-e5e0-470e-83e0-bd47ac6c9718-metrics-client-ca\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.016626 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.016400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmw7l\" (UniqueName: \"kubernetes.io/projected/a4113615-e5e0-470e-83e0-bd47ac6c9718-kube-api-access-qmw7l\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.016626 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.016456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a4113615-e5e0-470e-83e0-bd47ac6c9718-telemeter-client-tls\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.016988 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.016958    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4113615-e5e0-470e-83e0-bd47ac6c9718-serving-certs-ca-bundle\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.017291 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.017265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4113615-e5e0-470e-83e0-bd47ac6c9718-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.017444 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.017401    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4113615-e5e0-470e-83e0-bd47ac6c9718-metrics-client-ca\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.022573 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.019609    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a4113615-e5e0-470e-83e0-bd47ac6c9718-telemeter-client-tls\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.022573 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.019674    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a4113615-e5e0-470e-83e0-bd47ac6c9718-federate-client-tls\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.022573 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.019741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4113615-e5e0-470e-83e0-bd47ac6c9718-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.024245 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.023911    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a4113615-e5e0-470e-83e0-bd47ac6c9718-secret-telemeter-client\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.025320 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.025300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmw7l\" (UniqueName: \"kubernetes.io/projected/a4113615-e5e0-470e-83e0-bd47ac6c9718-kube-api-access-qmw7l\") pod \"telemeter-client-5c9584bcc-wzxnz\" (UID: \"a4113615-e5e0-470e-83e0-bd47ac6c9718\") " pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.163653 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.163571    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"
Jul 19 14:41:40.618831 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.618797    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77795bf9c-2wj5r"]
Jul 19 14:41:40.964224 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:40.964148    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:41:41.232268 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.231590    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 14:41:41.359657 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.359631    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c9584bcc-wzxnz"]
Jul 19 14:41:41.368317 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:41:41.368135    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4113615_e5e0_470e_83e0_bd47ac6c9718.slice/crio-285e0d6eb2d6ac416d12ec1f4e7b55afa0398fbee1539c32d131acd342a1dd0c WatchSource:0}: Error finding container 285e0d6eb2d6ac416d12ec1f4e7b55afa0398fbee1539c32d131acd342a1dd0c: Status 404 returned error can't find the container with id 285e0d6eb2d6ac416d12ec1f4e7b55afa0398fbee1539c32d131acd342a1dd0c
Jul 19 14:41:41.402425 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.402390    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"]
Jul 19 14:41:41.407391 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:41:41.407367    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7317a362_036e_4229_a6c1_3b4a69e83a78.slice/crio-6ccc8103f72f3194db10039bee524b00b40b581670ebcdabda0bb9788be2f5e4 WatchSource:0}: Error finding container 6ccc8103f72f3194db10039bee524b00b40b581670ebcdabda0bb9788be2f5e4: Status 404 returned error can't find the container with id 6ccc8103f72f3194db10039bee524b00b40b581670ebcdabda0bb9788be2f5e4
Jul 19 14:41:41.576232 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.576140    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77795bf9c-2wj5r"]
Jul 19 14:41:41.578457 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.578421    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx"]
Jul 19 14:41:41.587374 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:41:41.587132    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafedeaed_4628_490e_99f5_ddb2b291665b.slice/crio-abb49fdf8fcd9922f4251c3cc137bb7ca3e1de1af78c49e0eac0a711851e3d6f WatchSource:0}: Error finding container abb49fdf8fcd9922f4251c3cc137bb7ca3e1de1af78c49e0eac0a711851e3d6f: Status 404 returned error can't find the container with id abb49fdf8fcd9922f4251c3cc137bb7ca3e1de1af78c49e0eac0a711851e3d6f
Jul 19 14:41:41.908200 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.908099    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77795bf9c-2wj5r" event={"ID":"afedeaed-4628-490e-99f5-ddb2b291665b","Type":"ContainerStarted","Data":"abb49fdf8fcd9922f4251c3cc137bb7ca3e1de1af78c49e0eac0a711851e3d6f"}
Jul 19 14:41:41.909991 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.909925    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-fc6lx" event={"ID":"4f08afff-1a6e-4d89-9a38-aaae8d5c7877","Type":"ContainerStarted","Data":"9c7e94d452ec5ded39e1ae91e4e225746b9958383417e4f3d67b5a2c027150b0"}
Jul 19 14:41:41.910329 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.910271    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-fc6lx"
Jul 19 14:41:41.911572 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.911510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz" event={"ID":"a4113615-e5e0-470e-83e0-bd47ac6c9718","Type":"ContainerStarted","Data":"285e0d6eb2d6ac416d12ec1f4e7b55afa0398fbee1539c32d131acd342a1dd0c"}
Jul 19 14:41:41.913465 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.913427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sflgh" event={"ID":"d35b32d7-a273-4ab9-b3c3-51a246672fb2","Type":"ContainerStarted","Data":"b4a06e65d8ba1b1e6e022c6883b17cb67a60fef066b9c138f12d44694ffecda8"}
Jul 19 14:41:41.914886 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.914824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv" event={"ID":"7317a362-036e-4229-a6c1-3b4a69e83a78","Type":"ContainerStarted","Data":"6ccc8103f72f3194db10039bee524b00b40b581670ebcdabda0bb9788be2f5e4"}
Jul 19 14:41:41.917123 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.917056    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx" event={"ID":"d16b3033-1593-4d5b-8e4b-a63289b75b7b","Type":"ContainerStarted","Data":"da60d3adcd778b079f7256d239a23070aeff67b528ec7e53982621012838e9be"}
Jul 19 14:41:41.917123 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.917109    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx" event={"ID":"d16b3033-1593-4d5b-8e4b-a63289b75b7b","Type":"ContainerStarted","Data":"038c6ee1073dcbe43d2ba7441c352543bd7f033f76e0c5ac1c1bab8b430750ea"}
Jul 19 14:41:41.917315 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.917138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx" event={"ID":"d16b3033-1593-4d5b-8e4b-a63289b75b7b","Type":"ContainerStarted","Data":"a54122824726ab8823454121283d3bdb8caec49b08b3286c21ec8533b8c92912"}
Jul 19 14:41:41.921318 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.921296    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-fc6lx"
Jul 19 14:41:41.926362 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:41.926325    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-fc6lx" podStartSLOduration=1.592624164 podStartE2EDuration="17.926308136s" totalImagesPullingTime="16.333683972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:41:41.925749246 +0000 UTC m=+312.318311632" watchObservedRunningTime="2026-07-19 14:41:41.926308136 +0000 UTC m=+312.318870521"
Jul 19 14:41:42.928067 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:42.926618    2581 generic.go:356] "Generic (PLEG): container finished" podID="d35b32d7-a273-4ab9-b3c3-51a246672fb2" containerID="596ce57aa77fee280e80cf6641524202b40d72806fe13716fae0db9b4b70437b" exitCode=0
Jul 19 14:41:42.928067 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:42.927763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sflgh" event={"ID":"d35b32d7-a273-4ab9-b3c3-51a246672fb2","Type":"ContainerDied","Data":"596ce57aa77fee280e80cf6641524202b40d72806fe13716fae0db9b4b70437b"}
Jul 19 14:41:47.965011 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:47.964650    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sflgh" event={"ID":"d35b32d7-a273-4ab9-b3c3-51a246672fb2","Type":"ContainerStarted","Data":"de5b13140a6dae2b74f44d059d77789a488e7644f04acd566154169a4abcaaf2"}
Jul 19 14:41:47.965011 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:47.964721    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sflgh" event={"ID":"d35b32d7-a273-4ab9-b3c3-51a246672fb2","Type":"ContainerStarted","Data":"a23835dcf86ff018fcb65e691aef15c9999f3ed75641aee3f33d7d2f05b936df"}
Jul 19 14:41:47.969088 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:47.969052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv" event={"ID":"7317a362-036e-4229-a6c1-3b4a69e83a78","Type":"ContainerStarted","Data":"e89ccc25d1b80d13dccb7258b14bb5300e657d06070419b383c552294fc1d960"}
Jul 19 14:41:47.969462 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:47.969126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv" event={"ID":"7317a362-036e-4229-a6c1-3b4a69e83a78","Type":"ContainerStarted","Data":"cc9857e73d0b6e297ba7cea1eaa46efa3a51eb03135b823ac6a772a221f91015"}
Jul 19 14:41:47.969462 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:47.969164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv" event={"ID":"7317a362-036e-4229-a6c1-3b4a69e83a78","Type":"ContainerStarted","Data":"728a5d61d3b2ddb4f8007664ddde0167cfda147d01bfe38fef1e29521b1ae1e0"}
Jul 19 14:41:47.972206 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:47.972152    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx" event={"ID":"d16b3033-1593-4d5b-8e4b-a63289b75b7b","Type":"ContainerStarted","Data":"a3ce566005fc35c566124cec2cf75d335ced951b121a186e4b03c2981a63bf92"}
Jul 19 14:41:47.974629 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:47.974595    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77795bf9c-2wj5r" event={"ID":"afedeaed-4628-490e-99f5-ddb2b291665b","Type":"ContainerStarted","Data":"4946fffcdb23bf3b116373be555a31e6b06dbd07859f6031b844bf9265b050ab"}
Jul 19 14:41:47.978401 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:47.978322    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz" event={"ID":"a4113615-e5e0-470e-83e0-bd47ac6c9718","Type":"ContainerStarted","Data":"80d9f9126dd8a8f65c2028300e28db2bce4f4ed992fb5c68369eea158962dca8"}
Jul 19 14:41:47.987290 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:47.987192    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sflgh" podStartSLOduration=12.834829185 podStartE2EDuration="13.987159909s" totalImagesPullingTime="1.0412131s" totalInitContainerRuntime="111.117624ms" isStatefulPod=true podCreationTimestamp="2026-07-19 14:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:41:47.985635193 +0000 UTC m=+318.378197572" watchObservedRunningTime="2026-07-19 14:41:47.987159909 +0000 UTC m=+318.379722293"
Jul 19 14:41:48.003351 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:48.003283    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77795bf9c-2wj5r" podStartSLOduration=7.486834331 podStartE2EDuration="13.003263392s" totalImagesPullingTime="5.516429061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:41:48.001800216 +0000 UTC m=+318.394362601" watchObservedRunningTime="2026-07-19 14:41:48.003263392 +0000 UTC m=+318.395825779"
Jul 19 14:41:48.018675 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:48.018578    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-5zpkx" podStartSLOduration=8.672709459 podStartE2EDuration="14.01855891s" totalImagesPullingTime="5.345849451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:41:48.017808842 +0000 UTC m=+318.410371228" watchObservedRunningTime="2026-07-19 14:41:48.01855891 +0000 UTC m=+318.411121297"
Jul 19 14:41:49.552748 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.552706    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh" podUID="d76814d5-2688-48b2-8374-9ae7ac8a5e1e" containerName="registry" containerID="cri-o://cac7db0f6a0535eb7a36f06ae09b9d5d26ae666c67d04a6afc3cafaa15cfcd2c" gracePeriod=30
Jul 19 14:41:49.851917 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.851883    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:41:49.909100 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.909059    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-installation-pull-secrets\") pod \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") "
Jul 19 14:41:49.909286 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.909110    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q956f\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-kube-api-access-q956f\") pod \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") "
Jul 19 14:41:49.909286 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.909145    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-trusted-ca\") pod \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") "
Jul 19 14:41:49.909286 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.909233    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-image-registry-private-configuration\") pod \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") "
Jul 19 14:41:49.909286 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.909275    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-bound-sa-token\") pod \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") "
Jul 19 14:41:49.909525 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.909306    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") pod \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") "
Jul 19 14:41:49.909525 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.909351    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-certificates\") pod \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") "
Jul 19 14:41:49.909525 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.909414    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-ca-trust-extracted\") pod \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\" (UID: \"d76814d5-2688-48b2-8374-9ae7ac8a5e1e\") "
Jul 19 14:41:49.909679 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.909527    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d76814d5-2688-48b2-8374-9ae7ac8a5e1e" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:41:49.909738 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.909706    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-trusted-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:41:49.909991 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.909967    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d76814d5-2688-48b2-8374-9ae7ac8a5e1e" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:41:49.912469 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.912304    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d76814d5-2688-48b2-8374-9ae7ac8a5e1e" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:41:49.912469 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.912341    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d76814d5-2688-48b2-8374-9ae7ac8a5e1e" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:41:49.912469 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.912381    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d76814d5-2688-48b2-8374-9ae7ac8a5e1e" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:41:49.912693 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.912574    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d76814d5-2688-48b2-8374-9ae7ac8a5e1e" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:41:49.913291 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.913264    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-kube-api-access-q956f" (OuterVolumeSpecName: "kube-api-access-q956f") pod "d76814d5-2688-48b2-8374-9ae7ac8a5e1e" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e"). InnerVolumeSpecName "kube-api-access-q956f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:41:49.922450 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.922427    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d76814d5-2688-48b2-8374-9ae7ac8a5e1e" (UID: "d76814d5-2688-48b2-8374-9ae7ac8a5e1e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:41:49.990492 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.990444    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz" event={"ID":"a4113615-e5e0-470e-83e0-bd47ac6c9718","Type":"ContainerStarted","Data":"e3e27e38c9834becd77feb6f595e8c3d892845294c5ca30f92e93a5dd3ce99ab"}
Jul 19 14:41:49.990671 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.990524    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz" event={"ID":"a4113615-e5e0-470e-83e0-bd47ac6c9718","Type":"ContainerStarted","Data":"fb2b2cb97810919b51ad58b4ac36484cf8a3ab83c8838bf206687be1e766e68c"}
Jul 19 14:41:49.994203 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.994159    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv" event={"ID":"7317a362-036e-4229-a6c1-3b4a69e83a78","Type":"ContainerStarted","Data":"efad642ef6102ecf26ace3e71a4ec7a6d56d511f6b314b9ac8dd70865946fb37"}
Jul 19 14:41:49.994348 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.994248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv" event={"ID":"7317a362-036e-4229-a6c1-3b4a69e83a78","Type":"ContainerStarted","Data":"bb797ef371f16ed45640e036f564df67d8bc15f3a40f6d2643b0d6e94572c1d0"}
Jul 19 14:41:49.994348 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.994291    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv" event={"ID":"7317a362-036e-4229-a6c1-3b4a69e83a78","Type":"ContainerStarted","Data":"8a68aacea1dc1743602e930312f4a83659668c1b46eb1407913144b9377beed6"}
Jul 19 14:41:49.994348 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.994336    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:41:49.995688 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.995656    2581 generic.go:356] "Generic (PLEG): container finished" podID="d76814d5-2688-48b2-8374-9ae7ac8a5e1e" containerID="cac7db0f6a0535eb7a36f06ae09b9d5d26ae666c67d04a6afc3cafaa15cfcd2c" exitCode=0
Jul 19 14:41:49.995805 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.995701    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh" event={"ID":"d76814d5-2688-48b2-8374-9ae7ac8a5e1e","Type":"ContainerDied","Data":"cac7db0f6a0535eb7a36f06ae09b9d5d26ae666c67d04a6afc3cafaa15cfcd2c"}
Jul 19 14:41:49.995805 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.995737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh" event={"ID":"d76814d5-2688-48b2-8374-9ae7ac8a5e1e","Type":"ContainerDied","Data":"99e678f7c30d9b53149a44fcc03148b06629b7ba64308aebcc0679f2465baec0"}
Jul 19 14:41:49.995805 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.995778    2581 scope.go:117] "RemoveContainer" containerID="cac7db0f6a0535eb7a36f06ae09b9d5d26ae666c67d04a6afc3cafaa15cfcd2c"
Jul 19 14:41:49.996170 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:49.995851    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86d4c85d56-km8dh"
Jul 19 14:41:50.010352 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.010317    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-ca-trust-extracted\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:41:50.010352 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.010348    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-installation-pull-secrets\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:41:50.010352 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.010363    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q956f\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-kube-api-access-q956f\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:41:50.010352 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.010377    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-image-registry-private-configuration\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:41:50.010352 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.010391    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-bound-sa-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:41:50.010731 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.010403    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:41:50.010731 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.010415    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d76814d5-2688-48b2-8374-9ae7ac8a5e1e-registry-certificates\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:41:50.010924 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.010763    2581 scope.go:117] "RemoveContainer" containerID="cac7db0f6a0535eb7a36f06ae09b9d5d26ae666c67d04a6afc3cafaa15cfcd2c"
Jul 19 14:41:50.011140 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:41:50.011102    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cac7db0f6a0535eb7a36f06ae09b9d5d26ae666c67d04a6afc3cafaa15cfcd2c\": container with ID starting with cac7db0f6a0535eb7a36f06ae09b9d5d26ae666c67d04a6afc3cafaa15cfcd2c not found: ID does not exist" containerID="cac7db0f6a0535eb7a36f06ae09b9d5d26ae666c67d04a6afc3cafaa15cfcd2c"
Jul 19 14:41:50.011252 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.011146    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cac7db0f6a0535eb7a36f06ae09b9d5d26ae666c67d04a6afc3cafaa15cfcd2c"} err="failed to get container status \"cac7db0f6a0535eb7a36f06ae09b9d5d26ae666c67d04a6afc3cafaa15cfcd2c\": rpc error: code = NotFound desc = could not find container \"cac7db0f6a0535eb7a36f06ae09b9d5d26ae666c67d04a6afc3cafaa15cfcd2c\": container with ID starting with cac7db0f6a0535eb7a36f06ae09b9d5d26ae666c67d04a6afc3cafaa15cfcd2c not found: ID does not exist"
Jul 19 14:41:50.012588 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.012537    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c9584bcc-wzxnz" podStartSLOduration=3.437183025 podStartE2EDuration="11.01252137s" totalImagesPullingTime="7.575338345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:41:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:41:50.010483648 +0000 UTC m=+320.403046274" watchObservedRunningTime="2026-07-19 14:41:50.01252137 +0000 UTC m=+320.405083732"
Jul 19 14:41:50.025037 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.025014    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86d4c85d56-km8dh"]
Jul 19 14:41:50.032117 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.032098    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86d4c85d56-km8dh"]
Jul 19 14:41:50.051421 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.051374    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv" podStartSLOduration=6.737626915 podStartE2EDuration="14.051355449s" totalImagesPullingTime="7.313728534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:41:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:41:50.050096542 +0000 UTC m=+320.442658928" watchObservedRunningTime="2026-07-19 14:41:50.051355449 +0000 UTC m=+320.443917834"
Jul 19 14:41:50.950513 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.950478    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85576bc84b-8k6sk"]
Jul 19 14:41:50.950875 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.950741    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d76814d5-2688-48b2-8374-9ae7ac8a5e1e" containerName="registry"
Jul 19 14:41:50.950875 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.950751    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76814d5-2688-48b2-8374-9ae7ac8a5e1e" containerName="registry"
Jul 19 14:41:50.950875 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:50.950798    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d76814d5-2688-48b2-8374-9ae7ac8a5e1e" containerName="registry"
Jul 19 14:41:51.001572 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.001542    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.005917 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.005890    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d76814d5-2688-48b2-8374-9ae7ac8a5e1e" path="/var/lib/kubelet/pods/d76814d5-2688-48b2-8374-9ae7ac8a5e1e/volumes"
Jul 19 14:41:51.006131 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.006118    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85576bc84b-8k6sk"]
Jul 19 14:41:51.118831 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.118798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-oauth-config\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.119026 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.118877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-config\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.119026 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.118902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-oauth-serving-cert\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.119150 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.119093    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-service-ca\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.119234 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.119157    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n7sn\" (UniqueName: \"kubernetes.io/projected/7d510b0c-1967-4e26-a24b-ae0ebd59472c-kube-api-access-7n7sn\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.119544 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.119523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-trusted-ca-bundle\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.119671 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.119647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-serving-cert\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.220827 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.220800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-oauth-config\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.221005 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.220839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-config\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.221005 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.220862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-oauth-serving-cert\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.221005 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.220895    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-service-ca\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.221005 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.220921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7sn\" (UniqueName: \"kubernetes.io/projected/7d510b0c-1967-4e26-a24b-ae0ebd59472c-kube-api-access-7n7sn\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.221005 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.220951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-trusted-ca-bundle\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.221005 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.220988    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-serving-cert\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.221709 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.221662    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-config\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.221709 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.221688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-oauth-serving-cert\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.221835 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.221788    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-service-ca\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.221871 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.221844    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-trusted-ca-bundle\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.223320 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.223300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-oauth-config\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.223506 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.223489    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-serving-cert\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.228103 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.228073    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n7sn\" (UniqueName: \"kubernetes.io/projected/7d510b0c-1967-4e26-a24b-ae0ebd59472c-kube-api-access-7n7sn\") pod \"console-85576bc84b-8k6sk\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") " pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.310728 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.310684    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:41:51.457412 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:51.457383    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85576bc84b-8k6sk"]
Jul 19 14:41:51.460566 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:41:51.460532    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d510b0c_1967_4e26_a24b_ae0ebd59472c.slice/crio-e5bf6e00d772fe671b049190f0ffb4a8745d47a092b7e8ca6085f9336dee595b WatchSource:0}: Error finding container e5bf6e00d772fe671b049190f0ffb4a8745d47a092b7e8ca6085f9336dee595b: Status 404 returned error can't find the container with id e5bf6e00d772fe671b049190f0ffb4a8745d47a092b7e8ca6085f9336dee595b
Jul 19 14:41:52.007079 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:52.007044    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85576bc84b-8k6sk" event={"ID":"7d510b0c-1967-4e26-a24b-ae0ebd59472c","Type":"ContainerStarted","Data":"33bc24c6ec787110b8dda8acd7aa8407000a4a3f9a87e10c3e058f305e03c6ed"}
Jul 19 14:41:52.007542 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:52.007123    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85576bc84b-8k6sk" event={"ID":"7d510b0c-1967-4e26-a24b-ae0ebd59472c","Type":"ContainerStarted","Data":"e5bf6e00d772fe671b049190f0ffb4a8745d47a092b7e8ca6085f9336dee595b"}
Jul 19 14:41:52.023791 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:52.023744    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85576bc84b-8k6sk" podStartSLOduration=2.023728365 podStartE2EDuration="2.023728365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:41:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:41:52.022071596 +0000 UTC m=+322.414633972" watchObservedRunningTime="2026-07-19 14:41:52.023728365 +0000 UTC m=+322.416290830"
Jul 19 14:41:55.513336 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:55.513299    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:41:56.007563 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:41:56.007536    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-c5486d4bb-w6ltv"
Jul 19 14:42:01.311172 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:01.311119    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:42:01.311742 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:01.311216    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:42:01.315921 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:01.315901    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:42:02.045371 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:02.045346    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:42:13.004566 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.004519    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77795bf9c-2wj5r" podUID="afedeaed-4628-490e-99f5-ddb2b291665b" containerName="console" containerID="cri-o://4946fffcdb23bf3b116373be555a31e6b06dbd07859f6031b844bf9265b050ab" gracePeriod=15
Jul 19 14:42:13.278376 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.278310    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:42:13.410785 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.410745    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afedeaed-4628-490e-99f5-ddb2b291665b-console-oauth-config\") pod \"afedeaed-4628-490e-99f5-ddb2b291665b\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") "
Jul 19 14:42:13.410978 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.410826    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afedeaed-4628-490e-99f5-ddb2b291665b-console-serving-cert\") pod \"afedeaed-4628-490e-99f5-ddb2b291665b\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") "
Jul 19 14:42:13.410978 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.410860    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6wfh\" (UniqueName: \"kubernetes.io/projected/afedeaed-4628-490e-99f5-ddb2b291665b-kube-api-access-d6wfh\") pod \"afedeaed-4628-490e-99f5-ddb2b291665b\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") "
Jul 19 14:42:13.410978 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.410894    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-service-ca\") pod \"afedeaed-4628-490e-99f5-ddb2b291665b\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") "
Jul 19 14:42:13.410978 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.410921    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-console-config\") pod \"afedeaed-4628-490e-99f5-ddb2b291665b\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") "
Jul 19 14:42:13.410978 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.410949    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-oauth-serving-cert\") pod \"afedeaed-4628-490e-99f5-ddb2b291665b\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") "
Jul 19 14:42:13.411988 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.411711    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-service-ca" (OuterVolumeSpecName: "service-ca") pod "afedeaed-4628-490e-99f5-ddb2b291665b" (UID: "afedeaed-4628-490e-99f5-ddb2b291665b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:42:13.411988 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.411719    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-console-config" (OuterVolumeSpecName: "console-config") pod "afedeaed-4628-490e-99f5-ddb2b291665b" (UID: "afedeaed-4628-490e-99f5-ddb2b291665b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:42:13.411988 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.411776    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-trusted-ca-bundle\") pod \"afedeaed-4628-490e-99f5-ddb2b291665b\" (UID: \"afedeaed-4628-490e-99f5-ddb2b291665b\") "
Jul 19 14:42:13.412822 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.412471    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-console-config\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:42:13.412822 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.412499    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:42:13.412822 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.412569    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "afedeaed-4628-490e-99f5-ddb2b291665b" (UID: "afedeaed-4628-490e-99f5-ddb2b291665b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:42:13.413587 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.413221    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "afedeaed-4628-490e-99f5-ddb2b291665b" (UID: "afedeaed-4628-490e-99f5-ddb2b291665b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:42:13.415223 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.413940    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afedeaed-4628-490e-99f5-ddb2b291665b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "afedeaed-4628-490e-99f5-ddb2b291665b" (UID: "afedeaed-4628-490e-99f5-ddb2b291665b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:42:13.415223 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.414074    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afedeaed-4628-490e-99f5-ddb2b291665b-kube-api-access-d6wfh" (OuterVolumeSpecName: "kube-api-access-d6wfh") pod "afedeaed-4628-490e-99f5-ddb2b291665b" (UID: "afedeaed-4628-490e-99f5-ddb2b291665b"). InnerVolumeSpecName "kube-api-access-d6wfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:42:13.415223 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.414169    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afedeaed-4628-490e-99f5-ddb2b291665b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "afedeaed-4628-490e-99f5-ddb2b291665b" (UID: "afedeaed-4628-490e-99f5-ddb2b291665b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:42:13.513600 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.513561    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afedeaed-4628-490e-99f5-ddb2b291665b-console-oauth-config\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:42:13.513600 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.513594    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afedeaed-4628-490e-99f5-ddb2b291665b-console-serving-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:42:13.513600 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.513604    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6wfh\" (UniqueName: \"kubernetes.io/projected/afedeaed-4628-490e-99f5-ddb2b291665b-kube-api-access-d6wfh\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:42:13.513828 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.513613    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-oauth-serving-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:42:13.513828 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:13.513622    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afedeaed-4628-490e-99f5-ddb2b291665b-trusted-ca-bundle\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:42:14.082289 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:14.082253    2581 generic.go:356] "Generic (PLEG): container finished" podID="afedeaed-4628-490e-99f5-ddb2b291665b" containerID="4946fffcdb23bf3b116373be555a31e6b06dbd07859f6031b844bf9265b050ab" exitCode=0
Jul 19 14:42:14.082733 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:14.082310    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77795bf9c-2wj5r"
Jul 19 14:42:14.082733 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:14.082323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77795bf9c-2wj5r" event={"ID":"afedeaed-4628-490e-99f5-ddb2b291665b","Type":"ContainerDied","Data":"4946fffcdb23bf3b116373be555a31e6b06dbd07859f6031b844bf9265b050ab"}
Jul 19 14:42:14.082733 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:14.082363    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77795bf9c-2wj5r" event={"ID":"afedeaed-4628-490e-99f5-ddb2b291665b","Type":"ContainerDied","Data":"abb49fdf8fcd9922f4251c3cc137bb7ca3e1de1af78c49e0eac0a711851e3d6f"}
Jul 19 14:42:14.082733 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:14.082382    2581 scope.go:117] "RemoveContainer" containerID="4946fffcdb23bf3b116373be555a31e6b06dbd07859f6031b844bf9265b050ab"
Jul 19 14:42:14.091048 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:14.091029    2581 scope.go:117] "RemoveContainer" containerID="4946fffcdb23bf3b116373be555a31e6b06dbd07859f6031b844bf9265b050ab"
Jul 19 14:42:14.091326 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:42:14.091307    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4946fffcdb23bf3b116373be555a31e6b06dbd07859f6031b844bf9265b050ab\": container with ID starting with 4946fffcdb23bf3b116373be555a31e6b06dbd07859f6031b844bf9265b050ab not found: ID does not exist" containerID="4946fffcdb23bf3b116373be555a31e6b06dbd07859f6031b844bf9265b050ab"
Jul 19 14:42:14.091400 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:14.091338    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4946fffcdb23bf3b116373be555a31e6b06dbd07859f6031b844bf9265b050ab"} err="failed to get container status \"4946fffcdb23bf3b116373be555a31e6b06dbd07859f6031b844bf9265b050ab\": rpc error: code = NotFound desc = could not find container \"4946fffcdb23bf3b116373be555a31e6b06dbd07859f6031b844bf9265b050ab\": container with ID starting with 4946fffcdb23bf3b116373be555a31e6b06dbd07859f6031b844bf9265b050ab not found: ID does not exist"
Jul 19 14:42:14.102477 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:14.102444    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77795bf9c-2wj5r"]
Jul 19 14:42:14.108491 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:14.108469    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77795bf9c-2wj5r"]
Jul 19 14:42:14.966354 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:14.966320    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afedeaed-4628-490e-99f5-ddb2b291665b" path="/var/lib/kubelet/pods/afedeaed-4628-490e-99f5-ddb2b291665b/volumes"
Jul 19 14:42:28.467304 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:28.467212    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs" podUID="7b13f469-8f88-4b47-84e8-13a4a5433a10" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 19 14:42:38.467046 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:38.467008    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs" podUID="7b13f469-8f88-4b47-84e8-13a4a5433a10" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 19 14:42:44.964429 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:44.964399    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:42:44.970899 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:44.970869    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0529a9f4-7d49-47f5-9c5f-e61102a365d9-metrics-certs\") pod \"network-metrics-daemon-52jmh\" (UID: \"0529a9f4-7d49-47f5-9c5f-e61102a365d9\") " pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:42:45.167732 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:45.167700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f5r6f\""
Jul 19 14:42:45.175511 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:45.175492    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-52jmh"
Jul 19 14:42:45.300234 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:45.300203    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-52jmh"]
Jul 19 14:42:45.303613 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:42:45.303583    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0529a9f4_7d49_47f5_9c5f_e61102a365d9.slice/crio-caa5996b6a63dfa6d266ef3a3187b04edccb02bea9bc70ee37db7ba8f3b50e7a WatchSource:0}: Error finding container caa5996b6a63dfa6d266ef3a3187b04edccb02bea9bc70ee37db7ba8f3b50e7a: Status 404 returned error can't find the container with id caa5996b6a63dfa6d266ef3a3187b04edccb02bea9bc70ee37db7ba8f3b50e7a
Jul 19 14:42:46.199243 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:46.199207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-52jmh" event={"ID":"0529a9f4-7d49-47f5-9c5f-e61102a365d9","Type":"ContainerStarted","Data":"4b6fe2d434c212fa6f60c8256cda33cbcd3f1d45e8742a7439cdf356282cb480"}
Jul 19 14:42:46.199629 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:46.199266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-52jmh" event={"ID":"0529a9f4-7d49-47f5-9c5f-e61102a365d9","Type":"ContainerStarted","Data":"caa5996b6a63dfa6d266ef3a3187b04edccb02bea9bc70ee37db7ba8f3b50e7a"}
Jul 19 14:42:47.205299 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:47.205260    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-52jmh" event={"ID":"0529a9f4-7d49-47f5-9c5f-e61102a365d9","Type":"ContainerStarted","Data":"1c8de8fb4ffecf43c7c00378dd92c131b3082a6c1951c286995d706bbfedbac1"}
Jul 19 14:42:47.222046 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:47.221984    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-52jmh" podStartSLOduration=375.422784177 podStartE2EDuration="6m16.221964598s" totalImagesPullingTime="799.180421ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:42:47.22094651 +0000 UTC m=+377.613508896" watchObservedRunningTime="2026-07-19 14:42:47.221964598 +0000 UTC m=+377.614526985"
Jul 19 14:42:48.467169 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:48.467129    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs" podUID="7b13f469-8f88-4b47-84e8-13a4a5433a10" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 19 14:42:48.467633 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:48.467221    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs"
Jul 19 14:42:48.467813 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:48.467790    2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"caa63ff725c2272e98409a5a75978c687417b3004b7a20d213ad759305a9192d"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 19 14:42:48.467881 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:48.467841    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs" podUID="7b13f469-8f88-4b47-84e8-13a4a5433a10" containerName="service-proxy" containerID="cri-o://caa63ff725c2272e98409a5a75978c687417b3004b7a20d213ad759305a9192d" gracePeriod=30
Jul 19 14:42:49.214381 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:49.214345    2581 generic.go:356] "Generic (PLEG): container finished" podID="7b13f469-8f88-4b47-84e8-13a4a5433a10" containerID="caa63ff725c2272e98409a5a75978c687417b3004b7a20d213ad759305a9192d" exitCode=2
Jul 19 14:42:49.214575 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:49.214422    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs" event={"ID":"7b13f469-8f88-4b47-84e8-13a4a5433a10","Type":"ContainerDied","Data":"caa63ff725c2272e98409a5a75978c687417b3004b7a20d213ad759305a9192d"}
Jul 19 14:42:49.214575 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:42:49.214475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-667d545484-t6cjs" event={"ID":"7b13f469-8f88-4b47-84e8-13a4a5433a10","Type":"ContainerStarted","Data":"4d39b774d4f85ea811aefade44b41a35cceada64e78a531faacf00686b6c9b58"}
Jul 19 14:43:07.461695 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.461659    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f45f49b9d-4tfk5"]
Jul 19 14:43:07.462143 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.461910    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afedeaed-4628-490e-99f5-ddb2b291665b" containerName="console"
Jul 19 14:43:07.462143 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.461922    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="afedeaed-4628-490e-99f5-ddb2b291665b" containerName="console"
Jul 19 14:43:07.462143 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.461976    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="afedeaed-4628-490e-99f5-ddb2b291665b" containerName="console"
Jul 19 14:43:07.463870 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.463849    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.475320 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.475296    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f45f49b9d-4tfk5"]
Jul 19 14:43:07.548274 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.548236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-oauth-serving-cert\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.548458 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.548289    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-trusted-ca-bundle\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.548458 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.548356    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn5vl\" (UniqueName: \"kubernetes.io/projected/bf0e8fba-fe5b-4364-ad9c-2d281f436347-kube-api-access-mn5vl\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.548458 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.548378    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-serving-cert\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.548585 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.548447    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-service-ca\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.548585 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.548479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-config\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.548585 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.548497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-oauth-config\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.649589 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.649553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-service-ca\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.649589 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.649591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-config\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.649837 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.649618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-oauth-config\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.649837 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.649647    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-oauth-serving-cert\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.649837 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.649677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-trusted-ca-bundle\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.649837 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.649708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn5vl\" (UniqueName: \"kubernetes.io/projected/bf0e8fba-fe5b-4364-ad9c-2d281f436347-kube-api-access-mn5vl\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.649837 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.649726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-serving-cert\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.650502 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.650471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-config\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.650661 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.650632    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-trusted-ca-bundle\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.650661 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.650471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-oauth-serving-cert\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.650839 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.650470    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-service-ca\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.652220 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.652195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-oauth-config\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.652306 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.652280    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-serving-cert\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.656876 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.656853    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn5vl\" (UniqueName: \"kubernetes.io/projected/bf0e8fba-fe5b-4364-ad9c-2d281f436347-kube-api-access-mn5vl\") pod \"console-6f45f49b9d-4tfk5\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") " pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.773222 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.773168    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:07.900427 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:07.900394    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f45f49b9d-4tfk5"]
Jul 19 14:43:07.903280 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:43:07.903253    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf0e8fba_fe5b_4364_ad9c_2d281f436347.slice/crio-da8119fedd3c72d35da0e43807cb6c90abbe02d5d42f477c3f249cfadefa74fb WatchSource:0}: Error finding container da8119fedd3c72d35da0e43807cb6c90abbe02d5d42f477c3f249cfadefa74fb: Status 404 returned error can't find the container with id da8119fedd3c72d35da0e43807cb6c90abbe02d5d42f477c3f249cfadefa74fb
Jul 19 14:43:08.281003 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:08.280968    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f45f49b9d-4tfk5" event={"ID":"bf0e8fba-fe5b-4364-ad9c-2d281f436347","Type":"ContainerStarted","Data":"ea4288ac85f6132dae20c8e9363430ed3eadd98bcab5af74737ecd81f0b59890"}
Jul 19 14:43:08.281226 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:08.281023    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f45f49b9d-4tfk5" event={"ID":"bf0e8fba-fe5b-4364-ad9c-2d281f436347","Type":"ContainerStarted","Data":"da8119fedd3c72d35da0e43807cb6c90abbe02d5d42f477c3f249cfadefa74fb"}
Jul 19 14:43:08.301163 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:08.301108    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f45f49b9d-4tfk5" podStartSLOduration=1.301091512 podStartE2EDuration="1.301091512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:43:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:43:08.29899399 +0000 UTC m=+398.691556376" watchObservedRunningTime="2026-07-19 14:43:08.301091512 +0000 UTC m=+398.693653897"
Jul 19 14:43:17.773425 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:17.773393    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:17.773967 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:17.773472    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:17.778146 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:17.778120    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:18.319744 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:18.319715    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:43:18.356080 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:18.356040    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85576bc84b-8k6sk"]
Jul 19 14:43:43.375862 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.375803    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85576bc84b-8k6sk" podUID="7d510b0c-1967-4e26-a24b-ae0ebd59472c" containerName="console" containerID="cri-o://33bc24c6ec787110b8dda8acd7aa8407000a4a3f9a87e10c3e058f305e03c6ed" gracePeriod=15
Jul 19 14:43:43.616222 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.616192    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:43:43.722083 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.722049    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-oauth-serving-cert\") pod \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") "
Jul 19 14:43:43.722294 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.722099    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-config\") pod \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") "
Jul 19 14:43:43.722294 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.722125    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-serving-cert\") pod \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") "
Jul 19 14:43:43.722294 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.722202    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n7sn\" (UniqueName: \"kubernetes.io/projected/7d510b0c-1967-4e26-a24b-ae0ebd59472c-kube-api-access-7n7sn\") pod \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") "
Jul 19 14:43:43.722438 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.722338    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-oauth-config\") pod \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") "
Jul 19 14:43:43.722438 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.722395    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-trusted-ca-bundle\") pod \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") "
Jul 19 14:43:43.722438 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.722428    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-service-ca\") pod \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\" (UID: \"7d510b0c-1967-4e26-a24b-ae0ebd59472c\") "
Jul 19 14:43:43.722592 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.722443    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7d510b0c-1967-4e26-a24b-ae0ebd59472c" (UID: "7d510b0c-1967-4e26-a24b-ae0ebd59472c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:43:43.722658 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.722638    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-oauth-serving-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:43:43.722850 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.722811    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7d510b0c-1967-4e26-a24b-ae0ebd59472c" (UID: "7d510b0c-1967-4e26-a24b-ae0ebd59472c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:43:43.722948 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.722909    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-service-ca" (OuterVolumeSpecName: "service-ca") pod "7d510b0c-1967-4e26-a24b-ae0ebd59472c" (UID: "7d510b0c-1967-4e26-a24b-ae0ebd59472c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:43:43.722948 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.722914    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-config" (OuterVolumeSpecName: "console-config") pod "7d510b0c-1967-4e26-a24b-ae0ebd59472c" (UID: "7d510b0c-1967-4e26-a24b-ae0ebd59472c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:43:43.724397 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.724361    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7d510b0c-1967-4e26-a24b-ae0ebd59472c" (UID: "7d510b0c-1967-4e26-a24b-ae0ebd59472c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:43:43.724505 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.724398    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7d510b0c-1967-4e26-a24b-ae0ebd59472c" (UID: "7d510b0c-1967-4e26-a24b-ae0ebd59472c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:43:43.724505 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.724443    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d510b0c-1967-4e26-a24b-ae0ebd59472c-kube-api-access-7n7sn" (OuterVolumeSpecName: "kube-api-access-7n7sn") pod "7d510b0c-1967-4e26-a24b-ae0ebd59472c" (UID: "7d510b0c-1967-4e26-a24b-ae0ebd59472c"). InnerVolumeSpecName "kube-api-access-7n7sn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:43:43.823968 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.823911    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n7sn\" (UniqueName: \"kubernetes.io/projected/7d510b0c-1967-4e26-a24b-ae0ebd59472c-kube-api-access-7n7sn\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:43:43.823968 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.823964    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-oauth-config\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:43:43.823968 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.823977    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-trusted-ca-bundle\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:43:43.824216 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.823986    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:43:43.824216 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.823995    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-config\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:43:43.824216 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:43.824003    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d510b0c-1967-4e26-a24b-ae0ebd59472c-console-serving-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:43:44.411237 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:44.411201    2581 generic.go:356] "Generic (PLEG): container finished" podID="7d510b0c-1967-4e26-a24b-ae0ebd59472c" containerID="33bc24c6ec787110b8dda8acd7aa8407000a4a3f9a87e10c3e058f305e03c6ed" exitCode=0
Jul 19 14:43:44.411237 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:44.411241    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85576bc84b-8k6sk"
Jul 19 14:43:44.411760 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:44.411247    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85576bc84b-8k6sk" event={"ID":"7d510b0c-1967-4e26-a24b-ae0ebd59472c","Type":"ContainerDied","Data":"33bc24c6ec787110b8dda8acd7aa8407000a4a3f9a87e10c3e058f305e03c6ed"}
Jul 19 14:43:44.411760 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:44.411294    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85576bc84b-8k6sk" event={"ID":"7d510b0c-1967-4e26-a24b-ae0ebd59472c","Type":"ContainerDied","Data":"e5bf6e00d772fe671b049190f0ffb4a8745d47a092b7e8ca6085f9336dee595b"}
Jul 19 14:43:44.411760 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:44.411316    2581 scope.go:117] "RemoveContainer" containerID="33bc24c6ec787110b8dda8acd7aa8407000a4a3f9a87e10c3e058f305e03c6ed"
Jul 19 14:43:44.419902 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:44.419883    2581 scope.go:117] "RemoveContainer" containerID="33bc24c6ec787110b8dda8acd7aa8407000a4a3f9a87e10c3e058f305e03c6ed"
Jul 19 14:43:44.420166 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:43:44.420149    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33bc24c6ec787110b8dda8acd7aa8407000a4a3f9a87e10c3e058f305e03c6ed\": container with ID starting with 33bc24c6ec787110b8dda8acd7aa8407000a4a3f9a87e10c3e058f305e03c6ed not found: ID does not exist" containerID="33bc24c6ec787110b8dda8acd7aa8407000a4a3f9a87e10c3e058f305e03c6ed"
Jul 19 14:43:44.420256 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:44.420173    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33bc24c6ec787110b8dda8acd7aa8407000a4a3f9a87e10c3e058f305e03c6ed"} err="failed to get container status \"33bc24c6ec787110b8dda8acd7aa8407000a4a3f9a87e10c3e058f305e03c6ed\": rpc error: code = NotFound desc = could not find container \"33bc24c6ec787110b8dda8acd7aa8407000a4a3f9a87e10c3e058f305e03c6ed\": container with ID starting with 33bc24c6ec787110b8dda8acd7aa8407000a4a3f9a87e10c3e058f305e03c6ed not found: ID does not exist"
Jul 19 14:43:44.430594 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:44.430568    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85576bc84b-8k6sk"]
Jul 19 14:43:44.434143 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:44.434123    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85576bc84b-8k6sk"]
Jul 19 14:43:44.966303 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:43:44.966272    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d510b0c-1967-4e26-a24b-ae0ebd59472c" path="/var/lib/kubelet/pods/7d510b0c-1967-4e26-a24b-ae0ebd59472c/volumes"
Jul 19 14:44:55.777197 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.777158    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lmf86"]
Jul 19 14:44:55.777771 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.777555    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d510b0c-1967-4e26-a24b-ae0ebd59472c" containerName="console"
Jul 19 14:44:55.777771 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.777571    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d510b0c-1967-4e26-a24b-ae0ebd59472c" containerName="console"
Jul 19 14:44:55.777771 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.777645    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d510b0c-1967-4e26-a24b-ae0ebd59472c" containerName="console"
Jul 19 14:44:55.780454 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.780435    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmf86"
Jul 19 14:44:55.784080 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.784051    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 19 14:44:55.784407 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.784392    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 19 14:44:55.784508 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.784394    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-n7r26\""
Jul 19 14:44:55.795623 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.795597    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lmf86"]
Jul 19 14:44:55.868623 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.868585    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp58h\" (UniqueName: \"kubernetes.io/projected/befcbf8b-980d-43ae-83da-bcfef768f8db-kube-api-access-jp58h\") pod \"cert-manager-cainjector-559cdd8c87-lmf86\" (UID: \"befcbf8b-980d-43ae-83da-bcfef768f8db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmf86"
Jul 19 14:44:55.868793 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.868654    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/befcbf8b-980d-43ae-83da-bcfef768f8db-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lmf86\" (UID: \"befcbf8b-980d-43ae-83da-bcfef768f8db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmf86"
Jul 19 14:44:55.969149 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.969122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp58h\" (UniqueName: \"kubernetes.io/projected/befcbf8b-980d-43ae-83da-bcfef768f8db-kube-api-access-jp58h\") pod \"cert-manager-cainjector-559cdd8c87-lmf86\" (UID: \"befcbf8b-980d-43ae-83da-bcfef768f8db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmf86"
Jul 19 14:44:55.969271 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.969167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/befcbf8b-980d-43ae-83da-bcfef768f8db-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lmf86\" (UID: \"befcbf8b-980d-43ae-83da-bcfef768f8db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmf86"
Jul 19 14:44:55.977200 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.977156    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/befcbf8b-980d-43ae-83da-bcfef768f8db-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lmf86\" (UID: \"befcbf8b-980d-43ae-83da-bcfef768f8db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmf86"
Jul 19 14:44:55.977309 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:55.977233    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp58h\" (UniqueName: \"kubernetes.io/projected/befcbf8b-980d-43ae-83da-bcfef768f8db-kube-api-access-jp58h\") pod \"cert-manager-cainjector-559cdd8c87-lmf86\" (UID: \"befcbf8b-980d-43ae-83da-bcfef768f8db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmf86"
Jul 19 14:44:56.093410 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:56.093329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmf86"
Jul 19 14:44:56.218763 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:56.218619    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lmf86"]
Jul 19 14:44:56.221667 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:44:56.221641    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbefcbf8b_980d_43ae_83da_bcfef768f8db.slice/crio-02283a3ad3170b0866b06514da7ea873b8343185342888ae5dfe73b2b94bd5e7 WatchSource:0}: Error finding container 02283a3ad3170b0866b06514da7ea873b8343185342888ae5dfe73b2b94bd5e7: Status 404 returned error can't find the container with id 02283a3ad3170b0866b06514da7ea873b8343185342888ae5dfe73b2b94bd5e7
Jul 19 14:44:56.667946 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:56.667880    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmf86" event={"ID":"befcbf8b-980d-43ae-83da-bcfef768f8db","Type":"ContainerStarted","Data":"02283a3ad3170b0866b06514da7ea873b8343185342888ae5dfe73b2b94bd5e7"}
Jul 19 14:44:58.836766 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:58.836733    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jxxcn"]
Jul 19 14:44:58.840409 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:58.840384    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jxxcn"
Jul 19 14:44:58.842960 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:58.842940    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zld62\""
Jul 19 14:44:58.850870 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:58.850843    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jxxcn"]
Jul 19 14:44:58.894103 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:58.894067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/262a40f6-b81f-4b51-89d6-f85d6be2a6ef-bound-sa-token\") pod \"cert-manager-55b4d954d5-jxxcn\" (UID: \"262a40f6-b81f-4b51-89d6-f85d6be2a6ef\") " pod="cert-manager/cert-manager-55b4d954d5-jxxcn"
Jul 19 14:44:58.894292 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:58.894113    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq95j\" (UniqueName: \"kubernetes.io/projected/262a40f6-b81f-4b51-89d6-f85d6be2a6ef-kube-api-access-jq95j\") pod \"cert-manager-55b4d954d5-jxxcn\" (UID: \"262a40f6-b81f-4b51-89d6-f85d6be2a6ef\") " pod="cert-manager/cert-manager-55b4d954d5-jxxcn"
Jul 19 14:44:58.995215 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:58.995160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/262a40f6-b81f-4b51-89d6-f85d6be2a6ef-bound-sa-token\") pod \"cert-manager-55b4d954d5-jxxcn\" (UID: \"262a40f6-b81f-4b51-89d6-f85d6be2a6ef\") " pod="cert-manager/cert-manager-55b4d954d5-jxxcn"
Jul 19 14:44:58.995215 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:58.995223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq95j\" (UniqueName: \"kubernetes.io/projected/262a40f6-b81f-4b51-89d6-f85d6be2a6ef-kube-api-access-jq95j\") pod \"cert-manager-55b4d954d5-jxxcn\" (UID: \"262a40f6-b81f-4b51-89d6-f85d6be2a6ef\") " pod="cert-manager/cert-manager-55b4d954d5-jxxcn"
Jul 19 14:44:59.004029 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:59.003993    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/262a40f6-b81f-4b51-89d6-f85d6be2a6ef-bound-sa-token\") pod \"cert-manager-55b4d954d5-jxxcn\" (UID: \"262a40f6-b81f-4b51-89d6-f85d6be2a6ef\") " pod="cert-manager/cert-manager-55b4d954d5-jxxcn"
Jul 19 14:44:59.004155 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:59.004140    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq95j\" (UniqueName: \"kubernetes.io/projected/262a40f6-b81f-4b51-89d6-f85d6be2a6ef-kube-api-access-jq95j\") pod \"cert-manager-55b4d954d5-jxxcn\" (UID: \"262a40f6-b81f-4b51-89d6-f85d6be2a6ef\") " pod="cert-manager/cert-manager-55b4d954d5-jxxcn"
Jul 19 14:44:59.152164 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:59.152072    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jxxcn"
Jul 19 14:44:59.286880 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:59.286843    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jxxcn"]
Jul 19 14:44:59.290095 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:44:59.290069    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod262a40f6_b81f_4b51_89d6_f85d6be2a6ef.slice/crio-7d2001e6f1367b74572e8e70efe73f6e8d9ea3bdb1cb24d0e0cdecb2ecfac2d8 WatchSource:0}: Error finding container 7d2001e6f1367b74572e8e70efe73f6e8d9ea3bdb1cb24d0e0cdecb2ecfac2d8: Status 404 returned error can't find the container with id 7d2001e6f1367b74572e8e70efe73f6e8d9ea3bdb1cb24d0e0cdecb2ecfac2d8
Jul 19 14:44:59.686402 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:59.686363    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmf86" event={"ID":"befcbf8b-980d-43ae-83da-bcfef768f8db","Type":"ContainerStarted","Data":"daf569deb906919557510d392706fb7d67980ee0f36bd9381cde12dd4dd27a68"}
Jul 19 14:44:59.687849 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:59.687825    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jxxcn" event={"ID":"262a40f6-b81f-4b51-89d6-f85d6be2a6ef","Type":"ContainerStarted","Data":"96a052598256f71aacf429cd5c9f2ee8fa3fe9b161b4acc54d2725e4bd25f640"}
Jul 19 14:44:59.687954 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:59.687859    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jxxcn" event={"ID":"262a40f6-b81f-4b51-89d6-f85d6be2a6ef","Type":"ContainerStarted","Data":"7d2001e6f1367b74572e8e70efe73f6e8d9ea3bdb1cb24d0e0cdecb2ecfac2d8"}
Jul 19 14:44:59.701678 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:59.701632    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lmf86" podStartSLOduration=1.911474864 podStartE2EDuration="4.70161869s" totalImagesPullingTime="2.790143826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:44:59.699924773 +0000 UTC m=+510.092487158" watchObservedRunningTime="2026-07-19 14:44:59.70161869 +0000 UTC m=+510.094181075"
Jul 19 14:44:59.716349 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:44:59.716304    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-jxxcn" podStartSLOduration=1.716286648 podStartE2EDuration="1.716286648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:44:59.715242225 +0000 UTC m=+510.107804820" watchObservedRunningTime="2026-07-19 14:44:59.716286648 +0000 UTC m=+510.108849032"
Jul 19 14:45:22.971623 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:22.971557    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"]
Jul 19 14:45:22.974858 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:22.974841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:22.977562 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:22.977536    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 19 14:45:22.978659 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:22.978633    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 19 14:45:22.978773 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:22.978679    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nkcpj\""
Jul 19 14:45:22.978836 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:22.978813    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 19 14:45:22.978960 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:22.978942    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 19 14:45:22.979028 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:22.978981    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:45:22.998224 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:22.998166    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"]
Jul 19 14:45:23.078145 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.078106    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b974c06-7272-4f04-a908-c0205384a805-metrics-cert\") pod \"lws-controller-manager-7499d794d8-7tbl6\" (UID: \"5b974c06-7272-4f04-a908-c0205384a805\") " pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:23.078356 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.078159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5b974c06-7272-4f04-a908-c0205384a805-manager-config\") pod \"lws-controller-manager-7499d794d8-7tbl6\" (UID: \"5b974c06-7272-4f04-a908-c0205384a805\") " pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:23.078356 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.078205    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpwth\" (UniqueName: \"kubernetes.io/projected/5b974c06-7272-4f04-a908-c0205384a805-kube-api-access-fpwth\") pod \"lws-controller-manager-7499d794d8-7tbl6\" (UID: \"5b974c06-7272-4f04-a908-c0205384a805\") " pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:23.078356 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.078319    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b974c06-7272-4f04-a908-c0205384a805-cert\") pod \"lws-controller-manager-7499d794d8-7tbl6\" (UID: \"5b974c06-7272-4f04-a908-c0205384a805\") " pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:23.179557 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.179516    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpwth\" (UniqueName: \"kubernetes.io/projected/5b974c06-7272-4f04-a908-c0205384a805-kube-api-access-fpwth\") pod \"lws-controller-manager-7499d794d8-7tbl6\" (UID: \"5b974c06-7272-4f04-a908-c0205384a805\") " pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:23.179719 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.179572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b974c06-7272-4f04-a908-c0205384a805-cert\") pod \"lws-controller-manager-7499d794d8-7tbl6\" (UID: \"5b974c06-7272-4f04-a908-c0205384a805\") " pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:23.179719 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.179612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b974c06-7272-4f04-a908-c0205384a805-metrics-cert\") pod \"lws-controller-manager-7499d794d8-7tbl6\" (UID: \"5b974c06-7272-4f04-a908-c0205384a805\") " pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:23.179719 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.179644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5b974c06-7272-4f04-a908-c0205384a805-manager-config\") pod \"lws-controller-manager-7499d794d8-7tbl6\" (UID: \"5b974c06-7272-4f04-a908-c0205384a805\") " pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:23.180388 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.180367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5b974c06-7272-4f04-a908-c0205384a805-manager-config\") pod \"lws-controller-manager-7499d794d8-7tbl6\" (UID: \"5b974c06-7272-4f04-a908-c0205384a805\") " pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:23.182130 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.182103    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b974c06-7272-4f04-a908-c0205384a805-metrics-cert\") pod \"lws-controller-manager-7499d794d8-7tbl6\" (UID: \"5b974c06-7272-4f04-a908-c0205384a805\") " pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:23.182251 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.182193    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b974c06-7272-4f04-a908-c0205384a805-cert\") pod \"lws-controller-manager-7499d794d8-7tbl6\" (UID: \"5b974c06-7272-4f04-a908-c0205384a805\") " pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:23.187861 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.187837    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpwth\" (UniqueName: \"kubernetes.io/projected/5b974c06-7272-4f04-a908-c0205384a805-kube-api-access-fpwth\") pod \"lws-controller-manager-7499d794d8-7tbl6\" (UID: \"5b974c06-7272-4f04-a908-c0205384a805\") " pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:23.284745 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.284664    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:23.424999 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.424976    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"]
Jul 19 14:45:23.427574 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:45:23.427550    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b974c06_7272_4f04_a908_c0205384a805.slice/crio-189d45412f555e6a3b9a255367f0f15ffce0f40fc77a8564ab7e36aa15b66ed1 WatchSource:0}: Error finding container 189d45412f555e6a3b9a255367f0f15ffce0f40fc77a8564ab7e36aa15b66ed1: Status 404 returned error can't find the container with id 189d45412f555e6a3b9a255367f0f15ffce0f40fc77a8564ab7e36aa15b66ed1
Jul 19 14:45:23.772153 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:23.772117    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6" event={"ID":"5b974c06-7272-4f04-a908-c0205384a805","Type":"ContainerStarted","Data":"189d45412f555e6a3b9a255367f0f15ffce0f40fc77a8564ab7e36aa15b66ed1"}
Jul 19 14:45:24.605483 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.605375    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"]
Jul 19 14:45:24.608748 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.608720    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.611191 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.611147    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 19 14:45:24.611315 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.611265    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vts5g\""
Jul 19 14:45:24.611842 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.611587    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 19 14:45:24.611842 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.611595    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 19 14:45:24.611842 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.611634    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 19 14:45:24.621524 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.621481    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"]
Jul 19 14:45:24.695943 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.695911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff291121-4918-4f15-aae3-97388db1ee6a-tmp\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.696114 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.695958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ff291121-4918-4f15-aae3-97388db1ee6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.696114 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.696067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff291121-4918-4f15-aae3-97388db1ee6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.696114 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.696105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klpqv\" (UniqueName: \"kubernetes.io/projected/ff291121-4918-4f15-aae3-97388db1ee6a-kube-api-access-klpqv\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.696266 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.696199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ff291121-4918-4f15-aae3-97388db1ee6a-manifests\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.797061 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.797020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff291121-4918-4f15-aae3-97388db1ee6a-tmp\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.797281 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.797072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ff291121-4918-4f15-aae3-97388db1ee6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.797281 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.797111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff291121-4918-4f15-aae3-97388db1ee6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.797281 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.797145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klpqv\" (UniqueName: \"kubernetes.io/projected/ff291121-4918-4f15-aae3-97388db1ee6a-kube-api-access-klpqv\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.797281 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.797202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ff291121-4918-4f15-aae3-97388db1ee6a-manifests\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.797618 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.797599    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ff291121-4918-4f15-aae3-97388db1ee6a-manifests\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.799495 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.799469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff291121-4918-4f15-aae3-97388db1ee6a-tmp\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.800034 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.800015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff291121-4918-4f15-aae3-97388db1ee6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.800144 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.800061    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ff291121-4918-4f15-aae3-97388db1ee6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.807439 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.807413    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klpqv\" (UniqueName: \"kubernetes.io/projected/ff291121-4918-4f15-aae3-97388db1ee6a-kube-api-access-klpqv\") pod \"opendatahub-operator-controller-manager-5c4b5b7c5f-98v29\" (UID: \"ff291121-4918-4f15-aae3-97388db1ee6a\") " pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:24.924211 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:24.924117    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:25.977257 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:25.977234    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"]
Jul 19 14:45:25.979602 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:45:25.979547    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff291121_4918_4f15_aae3_97388db1ee6a.slice/crio-421caf814b23a30cd33bebf26d70db5b97eb9cf28b907edbf20103a91925ebed WatchSource:0}: Error finding container 421caf814b23a30cd33bebf26d70db5b97eb9cf28b907edbf20103a91925ebed: Status 404 returned error can't find the container with id 421caf814b23a30cd33bebf26d70db5b97eb9cf28b907edbf20103a91925ebed
Jul 19 14:45:26.788243 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:26.788200    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6" event={"ID":"5b974c06-7272-4f04-a908-c0205384a805","Type":"ContainerStarted","Data":"ae6fb1a59a88b192bac9f3815e879ca62599603d654e0d501f072d234af0b8ec"}
Jul 19 14:45:26.788521 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:26.788351    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:26.789962 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:26.789937    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29" event={"ID":"ff291121-4918-4f15-aae3-97388db1ee6a","Type":"ContainerStarted","Data":"421caf814b23a30cd33bebf26d70db5b97eb9cf28b907edbf20103a91925ebed"}
Jul 19 14:45:26.818271 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:26.818216    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6" podStartSLOduration=2.332557796 podStartE2EDuration="4.818194776s" totalImagesPullingTime="2.48563698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:45:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:45:26.816914815 +0000 UTC m=+537.209477202" watchObservedRunningTime="2026-07-19 14:45:26.818194776 +0000 UTC m=+537.210757158"
Jul 19 14:45:29.803775 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:29.803734    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29" event={"ID":"ff291121-4918-4f15-aae3-97388db1ee6a","Type":"ContainerStarted","Data":"c12e0af22be785a946c825649cffba6c8e8436c0a778e79c759f5c7cd69a1841"}
Jul 19 14:45:30.809168 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:30.809134    2581 generic.go:356] "Generic (PLEG): container finished" podID="ff291121-4918-4f15-aae3-97388db1ee6a" containerID="c12e0af22be785a946c825649cffba6c8e8436c0a778e79c759f5c7cd69a1841" exitCode=0
Jul 19 14:45:30.809582 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:30.809209    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29" event={"ID":"ff291121-4918-4f15-aae3-97388db1ee6a","Type":"ContainerDied","Data":"c12e0af22be785a946c825649cffba6c8e8436c0a778e79c759f5c7cd69a1841"}
Jul 19 14:45:31.815131 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:31.815093    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29" event={"ID":"ff291121-4918-4f15-aae3-97388db1ee6a","Type":"ContainerStarted","Data":"f28d86ff228af44cbc1f20ae464e37f056f0a9aa58b6bbbe272e62c0322a9b55"}
Jul 19 14:45:31.815543 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:31.815227    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:31.839267 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:31.839206    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29" podStartSLOduration=3.6308375699999997 podStartE2EDuration="7.839168434s" totalImagesPullingTime="3.199027285s" totalInitContainerRuntime="1.009303579s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:45:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:45:31.83875089 +0000 UTC m=+542.231313276" watchObservedRunningTime="2026-07-19 14:45:31.839168434 +0000 UTC m=+542.231730820"
Jul 19 14:45:37.797365 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:37.797338    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7499d794d8-7tbl6"
Jul 19 14:45:42.821665 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:42.821631    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c4b5b7c5f-98v29"
Jul 19 14:45:46.098354 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:46.098317    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8nqv9"]
Jul 19 14:45:46.108897 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:46.108869    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8nqv9"
Jul 19 14:45:46.111518 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:46.111246    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 19 14:45:46.113391 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:46.113368    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8nqv9"]
Jul 19 14:45:46.280394 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:46.280345    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwjht\" (UniqueName: \"kubernetes.io/projected/fba0b774-fd0b-4a7d-bb73-9280fbf870e9-kube-api-access-gwjht\") pod \"model-serving-api-54d89bd5fc-8nqv9\" (UID: \"fba0b774-fd0b-4a7d-bb73-9280fbf870e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-8nqv9"
Jul 19 14:45:46.280394 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:46.280405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fba0b774-fd0b-4a7d-bb73-9280fbf870e9-tls-certs\") pod \"model-serving-api-54d89bd5fc-8nqv9\" (UID: \"fba0b774-fd0b-4a7d-bb73-9280fbf870e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-8nqv9"
Jul 19 14:45:46.381642 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:46.381562    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwjht\" (UniqueName: \"kubernetes.io/projected/fba0b774-fd0b-4a7d-bb73-9280fbf870e9-kube-api-access-gwjht\") pod \"model-serving-api-54d89bd5fc-8nqv9\" (UID: \"fba0b774-fd0b-4a7d-bb73-9280fbf870e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-8nqv9"
Jul 19 14:45:46.381642 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:46.381603    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fba0b774-fd0b-4a7d-bb73-9280fbf870e9-tls-certs\") pod \"model-serving-api-54d89bd5fc-8nqv9\" (UID: \"fba0b774-fd0b-4a7d-bb73-9280fbf870e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-8nqv9"
Jul 19 14:45:46.383960 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:46.383937    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fba0b774-fd0b-4a7d-bb73-9280fbf870e9-tls-certs\") pod \"model-serving-api-54d89bd5fc-8nqv9\" (UID: \"fba0b774-fd0b-4a7d-bb73-9280fbf870e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-8nqv9"
Jul 19 14:45:46.392479 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:46.392456    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwjht\" (UniqueName: \"kubernetes.io/projected/fba0b774-fd0b-4a7d-bb73-9280fbf870e9-kube-api-access-gwjht\") pod \"model-serving-api-54d89bd5fc-8nqv9\" (UID: \"fba0b774-fd0b-4a7d-bb73-9280fbf870e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-8nqv9"
Jul 19 14:45:46.421443 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:46.421409    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8nqv9"
Jul 19 14:45:46.555593 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:46.555562    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8nqv9"]
Jul 19 14:45:46.557878 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:45:46.557846    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba0b774_fd0b_4a7d_bb73_9280fbf870e9.slice/crio-3a7a30cdc3a0a1bcfe79281ec0c9faf2c0ae46373461bc135a227a75f22ca95f WatchSource:0}: Error finding container 3a7a30cdc3a0a1bcfe79281ec0c9faf2c0ae46373461bc135a227a75f22ca95f: Status 404 returned error can't find the container with id 3a7a30cdc3a0a1bcfe79281ec0c9faf2c0ae46373461bc135a227a75f22ca95f
Jul 19 14:45:46.879199 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:46.879151    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8nqv9" event={"ID":"fba0b774-fd0b-4a7d-bb73-9280fbf870e9","Type":"ContainerStarted","Data":"3a7a30cdc3a0a1bcfe79281ec0c9faf2c0ae46373461bc135a227a75f22ca95f"}
Jul 19 14:45:48.889543 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:48.889504    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8nqv9" event={"ID":"fba0b774-fd0b-4a7d-bb73-9280fbf870e9","Type":"ContainerStarted","Data":"bafd7606f05f400af8e25db4e626c0083b83823def41ab13f469dda57816781e"}
Jul 19 14:45:48.889998 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:48.889604    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-8nqv9"
Jul 19 14:45:48.904705 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:48.904655    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-8nqv9" podStartSLOduration=1.407081558 podStartE2EDuration="2.904639702s" totalImagesPullingTime="1.497558144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:45:48.90389712 +0000 UTC m=+559.296459510" watchObservedRunningTime="2026-07-19 14:45:48.904639702 +0000 UTC m=+559.297202086"
Jul 19 14:45:51.103821 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.103791    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"]
Jul 19 14:45:51.106993 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.106964    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.109364 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.109341    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 19 14:45:51.109515 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.109418    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 19 14:45:51.109515 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.109421    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 19 14:45:51.109515 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.109447    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jdlsg\""
Jul 19 14:45:51.120380 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.120356    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"]
Jul 19 14:45:51.122426 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.122402    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.122520 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.122445    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.122520 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.122467    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.122590 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.122520    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.122590 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.122558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.122590 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.122577    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4tvz\" (UniqueName: \"kubernetes.io/projected/11869ba2-af5e-4c43-9c4d-27dd672afe1a-kube-api-access-d4tvz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.122685 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.122607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.122685 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.122635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.122748 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.122692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.223881 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.223848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.224026 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.223892    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.224026 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.223909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.224026 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.223934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.224026 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.223963    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.224026 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.223979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4tvz\" (UniqueName: \"kubernetes.io/projected/11869ba2-af5e-4c43-9c4d-27dd672afe1a-kube-api-access-d4tvz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.224026 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.224006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.224026 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.224025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.224427 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.224051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.224427 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.224346    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.224427 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.224385    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.224584 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.224541    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.224633 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.224612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.224846 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.224825    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.226192 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.226157    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.226489 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.226473    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.231240 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.231212    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4tvz\" (UniqueName: \"kubernetes.io/projected/11869ba2-af5e-4c43-9c4d-27dd672afe1a-kube-api-access-d4tvz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.231326 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.231234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11869ba2-af5e-4c43-9c4d-27dd672afe1a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mst7w\" (UID: \"11869ba2-af5e-4c43-9c4d-27dd672afe1a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.416577 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.416489    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:51.547347 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.547318    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"]
Jul 19 14:45:51.549717 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:45:51.549688    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11869ba2_af5e_4c43_9c4d_27dd672afe1a.slice/crio-f490eb73bb232bfead6df472df8f18b40bdb649cb62bc9c3b3f0bd89e33a7b71 WatchSource:0}: Error finding container f490eb73bb232bfead6df472df8f18b40bdb649cb62bc9c3b3f0bd89e33a7b71: Status 404 returned error can't find the container with id f490eb73bb232bfead6df472df8f18b40bdb649cb62bc9c3b3f0bd89e33a7b71
Jul 19 14:45:51.903931 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:51.903896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w" event={"ID":"11869ba2-af5e-4c43-9c4d-27dd672afe1a","Type":"ContainerStarted","Data":"f490eb73bb232bfead6df472df8f18b40bdb649cb62bc9c3b3f0bd89e33a7b71"}
Jul 19 14:45:54.059080 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.059038    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 14:45:54.059465 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.059127    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 14:45:54.059465 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.059172    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 14:45:54.102392 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.102365    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"]
Jul 19 14:45:54.106928 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.106908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.109474 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.109447    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 19 14:45:54.109579 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.109448    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 19 14:45:54.109579 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.109448    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 19 14:45:54.109579 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.109507    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kxhb7\""
Jul 19 14:45:54.121074 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.121010    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"]
Jul 19 14:45:54.148693 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.148661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/792dc167-1a25-45df-88dd-dcc82a5f141b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.148865 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.148704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/792dc167-1a25-45df-88dd-dcc82a5f141b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.148865 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.148767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/792dc167-1a25-45df-88dd-dcc82a5f141b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.148865 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.148843    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/792dc167-1a25-45df-88dd-dcc82a5f141b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.148865 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.148861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/792dc167-1a25-45df-88dd-dcc82a5f141b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.149055 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.148886    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/792dc167-1a25-45df-88dd-dcc82a5f141b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.149055 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.148912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrcb5\" (UniqueName: \"kubernetes.io/projected/792dc167-1a25-45df-88dd-dcc82a5f141b-kube-api-access-vrcb5\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.250128 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.250096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/792dc167-1a25-45df-88dd-dcc82a5f141b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.250128 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.250129    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/792dc167-1a25-45df-88dd-dcc82a5f141b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.250412 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.250155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/792dc167-1a25-45df-88dd-dcc82a5f141b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.250412 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.250173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrcb5\" (UniqueName: \"kubernetes.io/projected/792dc167-1a25-45df-88dd-dcc82a5f141b-kube-api-access-vrcb5\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.250412 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.250245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/792dc167-1a25-45df-88dd-dcc82a5f141b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.250412 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.250279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/792dc167-1a25-45df-88dd-dcc82a5f141b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.250412 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.250317    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/792dc167-1a25-45df-88dd-dcc82a5f141b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.251408 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.251378    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/792dc167-1a25-45df-88dd-dcc82a5f141b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.252761 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.252712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/792dc167-1a25-45df-88dd-dcc82a5f141b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.252943 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.252923    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/792dc167-1a25-45df-88dd-dcc82a5f141b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.253058 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.253038    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/792dc167-1a25-45df-88dd-dcc82a5f141b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.253282 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.253256    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/792dc167-1a25-45df-88dd-dcc82a5f141b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.257735 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.257708    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/792dc167-1a25-45df-88dd-dcc82a5f141b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.258100 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.258082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrcb5\" (UniqueName: \"kubernetes.io/projected/792dc167-1a25-45df-88dd-dcc82a5f141b-kube-api-access-vrcb5\") pod \"istiod-openshift-gateway-94bb8fbfd-r98r8\" (UID: \"792dc167-1a25-45df-88dd-dcc82a5f141b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.425678 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.425590    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:54.594517 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.594486    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"]
Jul 19 14:45:54.596956 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:45:54.596927    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792dc167_1a25_45df_88dd_dcc82a5f141b.slice/crio-f6b391b0b51307147fe300647d38ddc25477199a138ea7f3a2e7937b051a33fe WatchSource:0}: Error finding container f6b391b0b51307147fe300647d38ddc25477199a138ea7f3a2e7937b051a33fe: Status 404 returned error can't find the container with id f6b391b0b51307147fe300647d38ddc25477199a138ea7f3a2e7937b051a33fe
Jul 19 14:45:54.920654 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.920614    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w" event={"ID":"11869ba2-af5e-4c43-9c4d-27dd672afe1a","Type":"ContainerStarted","Data":"0cc97d8f164c0bf7cbc023654c5b3320ec72a955b83bcdab1b2275c378a80997"}
Jul 19 14:45:54.921815 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.921792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8" event={"ID":"792dc167-1a25-45df-88dd-dcc82a5f141b","Type":"ContainerStarted","Data":"f6b391b0b51307147fe300647d38ddc25477199a138ea7f3a2e7937b051a33fe"}
Jul 19 14:45:54.943371 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:54.943324    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w" podStartSLOduration=1.4362403879999999 podStartE2EDuration="3.943310136s" totalImagesPullingTime="2.507069748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:45:54.94226904 +0000 UTC m=+565.334831444" watchObservedRunningTime="2026-07-19 14:45:54.943310136 +0000 UTC m=+565.335872521"
Jul 19 14:45:55.417262 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:55.417228    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:55.422397 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:55.422369    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:55.926952 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:55.926924    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:55.928156 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:55.928133    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mst7w"
Jul 19 14:45:56.757510 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:56.757476    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 14:45:56.757785 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:56.757538    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 14:45:56.932631 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:56.932599    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8" event={"ID":"792dc167-1a25-45df-88dd-dcc82a5f141b","Type":"ContainerStarted","Data":"e85408c5e0d0f8d835a256ceb6f11e32ddbc86cc20c069778e5a9b2998e4e180"}
Jul 19 14:45:56.932913 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:56.932895    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:56.958127 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:56.957982    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8" podStartSLOduration=0.799811791 podStartE2EDuration="2.957962136s" totalImagesPullingTime="2.158150345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:45:56.956675343 +0000 UTC m=+567.349237727" watchObservedRunningTime="2026-07-19 14:45:56.957962136 +0000 UTC m=+567.350524524"
Jul 19 14:45:57.943521 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:57.943496    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r98r8"
Jul 19 14:45:59.900125 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:45:59.900092    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-8nqv9"
Jul 19 14:47:23.120491 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:23.120454    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f45f49b9d-4tfk5"]
Jul 19 14:47:48.140450 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.140407    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f45f49b9d-4tfk5" podUID="bf0e8fba-fe5b-4364-ad9c-2d281f436347" containerName="console" containerID="cri-o://ea4288ac85f6132dae20c8e9363430ed3eadd98bcab5af74737ecd81f0b59890" gracePeriod=15
Jul 19 14:47:48.389977 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.389952    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:47:48.404800 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.404719    2581 generic.go:356] "Generic (PLEG): container finished" podID="bf0e8fba-fe5b-4364-ad9c-2d281f436347" containerID="ea4288ac85f6132dae20c8e9363430ed3eadd98bcab5af74737ecd81f0b59890" exitCode=0
Jul 19 14:47:48.404800 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.404764    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f45f49b9d-4tfk5"
Jul 19 14:47:48.404800 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.404768    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f45f49b9d-4tfk5" event={"ID":"bf0e8fba-fe5b-4364-ad9c-2d281f436347","Type":"ContainerDied","Data":"ea4288ac85f6132dae20c8e9363430ed3eadd98bcab5af74737ecd81f0b59890"}
Jul 19 14:47:48.405008 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.404814    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f45f49b9d-4tfk5" event={"ID":"bf0e8fba-fe5b-4364-ad9c-2d281f436347","Type":"ContainerDied","Data":"da8119fedd3c72d35da0e43807cb6c90abbe02d5d42f477c3f249cfadefa74fb"}
Jul 19 14:47:48.405008 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.404841    2581 scope.go:117] "RemoveContainer" containerID="ea4288ac85f6132dae20c8e9363430ed3eadd98bcab5af74737ecd81f0b59890"
Jul 19 14:47:48.412017 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.411986    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-trusted-ca-bundle\") pod \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") "
Jul 19 14:47:48.412135 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.412052    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-serving-cert\") pod \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") "
Jul 19 14:47:48.412135 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.412080    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-service-ca\") pod \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") "
Jul 19 14:47:48.412257 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.412156    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-config\") pod \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") "
Jul 19 14:47:48.412257 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.412210    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-oauth-serving-cert\") pod \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") "
Jul 19 14:47:48.412387 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.412371    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mn5vl\" (UniqueName: \"kubernetes.io/projected/bf0e8fba-fe5b-4364-ad9c-2d281f436347-kube-api-access-mn5vl\") pod \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") "
Jul 19 14:47:48.412465 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.412403    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-oauth-config\") pod \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\" (UID: \"bf0e8fba-fe5b-4364-ad9c-2d281f436347\") "
Jul 19 14:47:48.412465 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.412422    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bf0e8fba-fe5b-4364-ad9c-2d281f436347" (UID: "bf0e8fba-fe5b-4364-ad9c-2d281f436347"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:47:48.412786 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.412678    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-trusted-ca-bundle\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:47:48.412786 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.412742    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bf0e8fba-fe5b-4364-ad9c-2d281f436347" (UID: "bf0e8fba-fe5b-4364-ad9c-2d281f436347"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:47:48.413064 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.412809    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-config" (OuterVolumeSpecName: "console-config") pod "bf0e8fba-fe5b-4364-ad9c-2d281f436347" (UID: "bf0e8fba-fe5b-4364-ad9c-2d281f436347"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:47:48.413216 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.413186    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-service-ca" (OuterVolumeSpecName: "service-ca") pod "bf0e8fba-fe5b-4364-ad9c-2d281f436347" (UID: "bf0e8fba-fe5b-4364-ad9c-2d281f436347"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:47:48.413360 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.413324    2581 scope.go:117] "RemoveContainer" containerID="ea4288ac85f6132dae20c8e9363430ed3eadd98bcab5af74737ecd81f0b59890"
Jul 19 14:47:48.413656 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:47:48.413635    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea4288ac85f6132dae20c8e9363430ed3eadd98bcab5af74737ecd81f0b59890\": container with ID starting with ea4288ac85f6132dae20c8e9363430ed3eadd98bcab5af74737ecd81f0b59890 not found: ID does not exist" containerID="ea4288ac85f6132dae20c8e9363430ed3eadd98bcab5af74737ecd81f0b59890"
Jul 19 14:47:48.413735 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.413663    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea4288ac85f6132dae20c8e9363430ed3eadd98bcab5af74737ecd81f0b59890"} err="failed to get container status \"ea4288ac85f6132dae20c8e9363430ed3eadd98bcab5af74737ecd81f0b59890\": rpc error: code = NotFound desc = could not find container \"ea4288ac85f6132dae20c8e9363430ed3eadd98bcab5af74737ecd81f0b59890\": container with ID starting with ea4288ac85f6132dae20c8e9363430ed3eadd98bcab5af74737ecd81f0b59890 not found: ID does not exist"
Jul 19 14:47:48.415004 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.414986    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bf0e8fba-fe5b-4364-ad9c-2d281f436347" (UID: "bf0e8fba-fe5b-4364-ad9c-2d281f436347"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:47:48.415082 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.415064    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf0e8fba-fe5b-4364-ad9c-2d281f436347-kube-api-access-mn5vl" (OuterVolumeSpecName: "kube-api-access-mn5vl") pod "bf0e8fba-fe5b-4364-ad9c-2d281f436347" (UID: "bf0e8fba-fe5b-4364-ad9c-2d281f436347"). InnerVolumeSpecName "kube-api-access-mn5vl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:47:48.415148 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.415128    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bf0e8fba-fe5b-4364-ad9c-2d281f436347" (UID: "bf0e8fba-fe5b-4364-ad9c-2d281f436347"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:47:48.513490 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.513454    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-config\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:47:48.513490 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.513487    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-oauth-serving-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:47:48.513490 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.513497    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn5vl\" (UniqueName: \"kubernetes.io/projected/bf0e8fba-fe5b-4364-ad9c-2d281f436347-kube-api-access-mn5vl\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:47:48.513727 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.513506    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-oauth-config\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:47:48.513727 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.513515    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf0e8fba-fe5b-4364-ad9c-2d281f436347-console-serving-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:47:48.513727 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.513523    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf0e8fba-fe5b-4364-ad9c-2d281f436347-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:47:48.729280 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.729236    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f45f49b9d-4tfk5"]
Jul 19 14:47:48.734865 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.734840    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f45f49b9d-4tfk5"]
Jul 19 14:47:48.967263 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:48.967239    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf0e8fba-fe5b-4364-ad9c-2d281f436347" path="/var/lib/kubelet/pods/bf0e8fba-fe5b-4364-ad9c-2d281f436347/volumes"
Jul 19 14:47:49.317428 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:49.317319    2581 patch_prober.go:28] interesting pod/console-6f45f49b9d-4tfk5 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.17:8443/health\": context deadline exceeded" start-of-body=
Jul 19 14:47:49.317428 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:47:49.317398    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6f45f49b9d-4tfk5" podUID="bf0e8fba-fe5b-4364-ad9c-2d281f436347" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": context deadline exceeded"
Jul 19 14:48:50.411293 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.411257    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5bf9d65887-4p9x7"]
Jul 19 14:48:50.411757 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.411552    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf0e8fba-fe5b-4364-ad9c-2d281f436347" containerName="console"
Jul 19 14:48:50.411757 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.411563    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf0e8fba-fe5b-4364-ad9c-2d281f436347" containerName="console"
Jul 19 14:48:50.411757 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.411627    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf0e8fba-fe5b-4364-ad9c-2d281f436347" containerName="console"
Jul 19 14:48:50.414732 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.414716    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bf9d65887-4p9x7"
Jul 19 14:48:50.417288 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.417266    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 19 14:48:50.417288 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.417279    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dlsmn\""
Jul 19 14:48:50.417288 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.417298    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 19 14:48:50.424283 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.424258    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bf9d65887-4p9x7"]
Jul 19 14:48:50.540410 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.540372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69abf54b-a7c2-4657-8251-da9dc97b4957-webhook-cert\") pod \"maas-controller-5bf9d65887-4p9x7\" (UID: \"69abf54b-a7c2-4657-8251-da9dc97b4957\") " pod="opendatahub/maas-controller-5bf9d65887-4p9x7"
Jul 19 14:48:50.540410 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.540416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kczm5\" (UniqueName: \"kubernetes.io/projected/69abf54b-a7c2-4657-8251-da9dc97b4957-kube-api-access-kczm5\") pod \"maas-controller-5bf9d65887-4p9x7\" (UID: \"69abf54b-a7c2-4657-8251-da9dc97b4957\") " pod="opendatahub/maas-controller-5bf9d65887-4p9x7"
Jul 19 14:48:50.582997 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.582963    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59c569b9f5-xqnb5"]
Jul 19 14:48:50.586087 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.586070    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c569b9f5-xqnb5"
Jul 19 14:48:50.596664 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.596641    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59c569b9f5-xqnb5"]
Jul 19 14:48:50.641549 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.641507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69abf54b-a7c2-4657-8251-da9dc97b4957-webhook-cert\") pod \"maas-controller-5bf9d65887-4p9x7\" (UID: \"69abf54b-a7c2-4657-8251-da9dc97b4957\") " pod="opendatahub/maas-controller-5bf9d65887-4p9x7"
Jul 19 14:48:50.641549 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.641553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kczm5\" (UniqueName: \"kubernetes.io/projected/69abf54b-a7c2-4657-8251-da9dc97b4957-kube-api-access-kczm5\") pod \"maas-controller-5bf9d65887-4p9x7\" (UID: \"69abf54b-a7c2-4657-8251-da9dc97b4957\") " pod="opendatahub/maas-controller-5bf9d65887-4p9x7"
Jul 19 14:48:50.641785 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.641598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcq5r\" (UniqueName: \"kubernetes.io/projected/00370636-821d-45fd-89d4-54232ef8656a-kube-api-access-hcq5r\") pod \"maas-controller-59c569b9f5-xqnb5\" (UID: \"00370636-821d-45fd-89d4-54232ef8656a\") " pod="opendatahub/maas-controller-59c569b9f5-xqnb5"
Jul 19 14:48:50.641785 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.641677    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00370636-821d-45fd-89d4-54232ef8656a-webhook-cert\") pod \"maas-controller-59c569b9f5-xqnb5\" (UID: \"00370636-821d-45fd-89d4-54232ef8656a\") " pod="opendatahub/maas-controller-59c569b9f5-xqnb5"
Jul 19 14:48:50.641785 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:48:50.641686    2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 19 14:48:50.641785 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:48:50.641768    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69abf54b-a7c2-4657-8251-da9dc97b4957-webhook-cert podName:69abf54b-a7c2-4657-8251-da9dc97b4957 nodeName:}" failed. No retries permitted until 2026-07-19 14:48:51.14174733 +0000 UTC m=+741.534309696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/69abf54b-a7c2-4657-8251-da9dc97b4957-webhook-cert") pod "maas-controller-5bf9d65887-4p9x7" (UID: "69abf54b-a7c2-4657-8251-da9dc97b4957") : secret "maas-controller-webhook-cert" not found
Jul 19 14:48:50.652212 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.652160    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kczm5\" (UniqueName: \"kubernetes.io/projected/69abf54b-a7c2-4657-8251-da9dc97b4957-kube-api-access-kczm5\") pod \"maas-controller-5bf9d65887-4p9x7\" (UID: \"69abf54b-a7c2-4657-8251-da9dc97b4957\") " pod="opendatahub/maas-controller-5bf9d65887-4p9x7"
Jul 19 14:48:50.742376 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.742348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcq5r\" (UniqueName: \"kubernetes.io/projected/00370636-821d-45fd-89d4-54232ef8656a-kube-api-access-hcq5r\") pod \"maas-controller-59c569b9f5-xqnb5\" (UID: \"00370636-821d-45fd-89d4-54232ef8656a\") " pod="opendatahub/maas-controller-59c569b9f5-xqnb5"
Jul 19 14:48:50.742564 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.742408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00370636-821d-45fd-89d4-54232ef8656a-webhook-cert\") pod \"maas-controller-59c569b9f5-xqnb5\" (UID: \"00370636-821d-45fd-89d4-54232ef8656a\") " pod="opendatahub/maas-controller-59c569b9f5-xqnb5"
Jul 19 14:48:50.745149 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.745124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00370636-821d-45fd-89d4-54232ef8656a-webhook-cert\") pod \"maas-controller-59c569b9f5-xqnb5\" (UID: \"00370636-821d-45fd-89d4-54232ef8656a\") " pod="opendatahub/maas-controller-59c569b9f5-xqnb5"
Jul 19 14:48:50.749592 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.749569    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcq5r\" (UniqueName: \"kubernetes.io/projected/00370636-821d-45fd-89d4-54232ef8656a-kube-api-access-hcq5r\") pod \"maas-controller-59c569b9f5-xqnb5\" (UID: \"00370636-821d-45fd-89d4-54232ef8656a\") " pod="opendatahub/maas-controller-59c569b9f5-xqnb5"
Jul 19 14:48:50.896354 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:50.896306    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c569b9f5-xqnb5"
Jul 19 14:48:51.026883 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:51.026858    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59c569b9f5-xqnb5"]
Jul 19 14:48:51.029161 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:48:51.029137    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00370636_821d_45fd_89d4_54232ef8656a.slice/crio-3fc33129f1d6e1a96efed5213c393961dbccf5dbada65a82c5a2442e523504fd WatchSource:0}: Error finding container 3fc33129f1d6e1a96efed5213c393961dbccf5dbada65a82c5a2442e523504fd: Status 404 returned error can't find the container with id 3fc33129f1d6e1a96efed5213c393961dbccf5dbada65a82c5a2442e523504fd
Jul 19 14:48:51.030721 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:51.030703    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 14:48:51.146657 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:51.146623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69abf54b-a7c2-4657-8251-da9dc97b4957-webhook-cert\") pod \"maas-controller-5bf9d65887-4p9x7\" (UID: \"69abf54b-a7c2-4657-8251-da9dc97b4957\") " pod="opendatahub/maas-controller-5bf9d65887-4p9x7"
Jul 19 14:48:51.148954 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:51.148930    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69abf54b-a7c2-4657-8251-da9dc97b4957-webhook-cert\") pod \"maas-controller-5bf9d65887-4p9x7\" (UID: \"69abf54b-a7c2-4657-8251-da9dc97b4957\") " pod="opendatahub/maas-controller-5bf9d65887-4p9x7"
Jul 19 14:48:51.326154 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:51.326059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bf9d65887-4p9x7"
Jul 19 14:48:51.453708 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:51.453593    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bf9d65887-4p9x7"]
Jul 19 14:48:51.455697 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:48:51.455662    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69abf54b_a7c2_4657_8251_da9dc97b4957.slice/crio-31051e07679ad32e9600cb132d8729e94fa62acdcc43d37821071a09049b9e4e WatchSource:0}: Error finding container 31051e07679ad32e9600cb132d8729e94fa62acdcc43d37821071a09049b9e4e: Status 404 returned error can't find the container with id 31051e07679ad32e9600cb132d8729e94fa62acdcc43d37821071a09049b9e4e
Jul 19 14:48:51.676553 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:51.676295    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c569b9f5-xqnb5" event={"ID":"00370636-821d-45fd-89d4-54232ef8656a","Type":"ContainerStarted","Data":"3fc33129f1d6e1a96efed5213c393961dbccf5dbada65a82c5a2442e523504fd"}
Jul 19 14:48:51.677683 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:51.677653    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bf9d65887-4p9x7" event={"ID":"69abf54b-a7c2-4657-8251-da9dc97b4957","Type":"ContainerStarted","Data":"31051e07679ad32e9600cb132d8729e94fa62acdcc43d37821071a09049b9e4e"}
Jul 19 14:48:53.689263 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:53.689136    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c569b9f5-xqnb5" event={"ID":"00370636-821d-45fd-89d4-54232ef8656a","Type":"ContainerStarted","Data":"69f22608e4530d0b83287c7c54fa8a67e0838318d883c9df45b91b70b1d914b5"}
Jul 19 14:48:53.689263 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:53.689221    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59c569b9f5-xqnb5"
Jul 19 14:48:53.690664 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:53.690640    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bf9d65887-4p9x7" event={"ID":"69abf54b-a7c2-4657-8251-da9dc97b4957","Type":"ContainerStarted","Data":"c948e0adce6279fc96d93564d5346af9b92bb042bedfab8cdda6bc7e62747cb8"}
Jul 19 14:48:53.690760 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:53.690695    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5bf9d65887-4p9x7"
Jul 19 14:48:53.707226 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:53.707159    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59c569b9f5-xqnb5" podStartSLOduration=1.320052601 podStartE2EDuration="3.707141721s" totalImagesPullingTime="2.38708912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:48:53.70591958 +0000 UTC m=+744.098481988" watchObservedRunningTime="2026-07-19 14:48:53.707141721 +0000 UTC m=+744.099704153"
Jul 19 14:48:53.722752 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:48:53.722692    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5bf9d65887-4p9x7" podStartSLOduration=1.755293575 podStartE2EDuration="3.72267189s" totalImagesPullingTime="1.967378315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:48:53.721929226 +0000 UTC m=+744.114491610" watchObservedRunningTime="2026-07-19 14:48:53.72267189 +0000 UTC m=+744.115234276"
Jul 19 14:49:04.696370 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:04.696340    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59c569b9f5-xqnb5"
Jul 19 14:49:04.696848 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:04.696406    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5bf9d65887-4p9x7"
Jul 19 14:49:04.737049 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:04.737018    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bf9d65887-4p9x7"]
Jul 19 14:49:04.737288 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:04.737251    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5bf9d65887-4p9x7" podUID="69abf54b-a7c2-4657-8251-da9dc97b4957" containerName="manager" containerID="cri-o://c948e0adce6279fc96d93564d5346af9b92bb042bedfab8cdda6bc7e62747cb8" gracePeriod=30
Jul 19 14:49:04.982053 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:04.982023    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bf9d65887-4p9x7"
Jul 19 14:49:05.069518 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.069479    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kczm5\" (UniqueName: \"kubernetes.io/projected/69abf54b-a7c2-4657-8251-da9dc97b4957-kube-api-access-kczm5\") pod \"69abf54b-a7c2-4657-8251-da9dc97b4957\" (UID: \"69abf54b-a7c2-4657-8251-da9dc97b4957\") "
Jul 19 14:49:05.069705 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.069529    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69abf54b-a7c2-4657-8251-da9dc97b4957-webhook-cert\") pod \"69abf54b-a7c2-4657-8251-da9dc97b4957\" (UID: \"69abf54b-a7c2-4657-8251-da9dc97b4957\") "
Jul 19 14:49:05.071787 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.071755    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69abf54b-a7c2-4657-8251-da9dc97b4957-kube-api-access-kczm5" (OuterVolumeSpecName: "kube-api-access-kczm5") pod "69abf54b-a7c2-4657-8251-da9dc97b4957" (UID: "69abf54b-a7c2-4657-8251-da9dc97b4957"). InnerVolumeSpecName "kube-api-access-kczm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:49:05.071787 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.071762    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69abf54b-a7c2-4657-8251-da9dc97b4957-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "69abf54b-a7c2-4657-8251-da9dc97b4957" (UID: "69abf54b-a7c2-4657-8251-da9dc97b4957"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:49:05.170392 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.170351    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kczm5\" (UniqueName: \"kubernetes.io/projected/69abf54b-a7c2-4657-8251-da9dc97b4957-kube-api-access-kczm5\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:49:05.170392 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.170385    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69abf54b-a7c2-4657-8251-da9dc97b4957-webhook-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:49:05.739436 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.739401    2581 generic.go:356] "Generic (PLEG): container finished" podID="69abf54b-a7c2-4657-8251-da9dc97b4957" containerID="c948e0adce6279fc96d93564d5346af9b92bb042bedfab8cdda6bc7e62747cb8" exitCode=0
Jul 19 14:49:05.739436 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.739442    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bf9d65887-4p9x7"
Jul 19 14:49:05.739863 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.739456    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bf9d65887-4p9x7" event={"ID":"69abf54b-a7c2-4657-8251-da9dc97b4957","Type":"ContainerDied","Data":"c948e0adce6279fc96d93564d5346af9b92bb042bedfab8cdda6bc7e62747cb8"}
Jul 19 14:49:05.739863 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.739506    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bf9d65887-4p9x7" event={"ID":"69abf54b-a7c2-4657-8251-da9dc97b4957","Type":"ContainerDied","Data":"31051e07679ad32e9600cb132d8729e94fa62acdcc43d37821071a09049b9e4e"}
Jul 19 14:49:05.739863 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.739530    2581 scope.go:117] "RemoveContainer" containerID="c948e0adce6279fc96d93564d5346af9b92bb042bedfab8cdda6bc7e62747cb8"
Jul 19 14:49:05.748147 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.748128    2581 scope.go:117] "RemoveContainer" containerID="c948e0adce6279fc96d93564d5346af9b92bb042bedfab8cdda6bc7e62747cb8"
Jul 19 14:49:05.748427 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:49:05.748410    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c948e0adce6279fc96d93564d5346af9b92bb042bedfab8cdda6bc7e62747cb8\": container with ID starting with c948e0adce6279fc96d93564d5346af9b92bb042bedfab8cdda6bc7e62747cb8 not found: ID does not exist" containerID="c948e0adce6279fc96d93564d5346af9b92bb042bedfab8cdda6bc7e62747cb8"
Jul 19 14:49:05.748513 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.748438    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c948e0adce6279fc96d93564d5346af9b92bb042bedfab8cdda6bc7e62747cb8"} err="failed to get container status \"c948e0adce6279fc96d93564d5346af9b92bb042bedfab8cdda6bc7e62747cb8\": rpc error: code = NotFound desc = could not find container \"c948e0adce6279fc96d93564d5346af9b92bb042bedfab8cdda6bc7e62747cb8\": container with ID starting with c948e0adce6279fc96d93564d5346af9b92bb042bedfab8cdda6bc7e62747cb8 not found: ID does not exist"
Jul 19 14:49:05.757348 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.757326    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bf9d65887-4p9x7"]
Jul 19 14:49:05.760790 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:05.760768    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5bf9d65887-4p9x7"]
Jul 19 14:49:06.967681 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:06.967649    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69abf54b-a7c2-4657-8251-da9dc97b4957" path="/var/lib/kubelet/pods/69abf54b-a7c2-4657-8251-da9dc97b4957/volumes"
Jul 19 14:49:48.739061 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.739029    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"]
Jul 19 14:49:48.739545 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.739380    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69abf54b-a7c2-4657-8251-da9dc97b4957" containerName="manager"
Jul 19 14:49:48.739545 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.739393    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="69abf54b-a7c2-4657-8251-da9dc97b4957" containerName="manager"
Jul 19 14:49:48.739545 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.739462    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="69abf54b-a7c2-4657-8251-da9dc97b4957" containerName="manager"
Jul 19 14:49:48.745522 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.745502    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.748557 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.748533    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 19 14:49:48.748679 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.748559    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 19 14:49:48.748750 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.748688    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kzk9c\""
Jul 19 14:49:48.750648 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.750627    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 19 14:49:48.758246 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.758228    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"]
Jul 19 14:49:48.831889 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.831858    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18067051-b765-4946-9f2a-1ff0f5a947b5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.832045 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.831895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18067051-b765-4946-9f2a-1ff0f5a947b5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.832045 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.831935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18067051-b765-4946-9f2a-1ff0f5a947b5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.832045 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.831963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18067051-b765-4946-9f2a-1ff0f5a947b5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.832045 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.831988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18067051-b765-4946-9f2a-1ff0f5a947b5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.832193 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.832060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f9xd\" (UniqueName: \"kubernetes.io/projected/18067051-b765-4946-9f2a-1ff0f5a947b5-kube-api-access-9f9xd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.932996 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.932964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18067051-b765-4946-9f2a-1ff0f5a947b5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.933164 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.933008    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18067051-b765-4946-9f2a-1ff0f5a947b5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.933164 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.933045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18067051-b765-4946-9f2a-1ff0f5a947b5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.933164 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.933104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f9xd\" (UniqueName: \"kubernetes.io/projected/18067051-b765-4946-9f2a-1ff0f5a947b5-kube-api-access-9f9xd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.933164 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.933143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18067051-b765-4946-9f2a-1ff0f5a947b5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.933431 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.933172    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18067051-b765-4946-9f2a-1ff0f5a947b5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.933590 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.933559    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18067051-b765-4946-9f2a-1ff0f5a947b5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.933699 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.933591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18067051-b765-4946-9f2a-1ff0f5a947b5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.933699 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.933611    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18067051-b765-4946-9f2a-1ff0f5a947b5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.935297 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.935279    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18067051-b765-4946-9f2a-1ff0f5a947b5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.935467 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.935452    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18067051-b765-4946-9f2a-1ff0f5a947b5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:48.940463 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:48.940445    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f9xd\" (UniqueName: \"kubernetes.io/projected/18067051-b765-4946-9f2a-1ff0f5a947b5-kube-api-access-9f9xd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xxl44\" (UID: \"18067051-b765-4946-9f2a-1ff0f5a947b5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:49.055674 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:49.055576    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:49.184332 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:49.184308    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"]
Jul 19 14:49:49.187102 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:49:49.187072    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18067051_b765_4946_9f2a_1ff0f5a947b5.slice/crio-1e8224ebc91f55241c5b37d99addc170a74b5888680fa32e5f97aa5619dc769d WatchSource:0}: Error finding container 1e8224ebc91f55241c5b37d99addc170a74b5888680fa32e5f97aa5619dc769d: Status 404 returned error can't find the container with id 1e8224ebc91f55241c5b37d99addc170a74b5888680fa32e5f97aa5619dc769d
Jul 19 14:49:49.930377 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:49.930344    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44" event={"ID":"18067051-b765-4946-9f2a-1ff0f5a947b5","Type":"ContainerStarted","Data":"1e8224ebc91f55241c5b37d99addc170a74b5888680fa32e5f97aa5619dc769d"}
Jul 19 14:49:50.936228 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:50.936191    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44" event={"ID":"18067051-b765-4946-9f2a-1ff0f5a947b5","Type":"ContainerStarted","Data":"aa6d0142e9c6405686677e23fafd4ecc445cfdf4249afc1bbef544957487bfc7"}
Jul 19 14:49:50.953374 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:50.953325    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44" podStartSLOduration=1.964947905 podStartE2EDuration="2.953311205s" totalImagesPullingTime="988.3633ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:49:50.952296236 +0000 UTC m=+801.344858622" watchObservedRunningTime="2026-07-19 14:49:50.953311205 +0000 UTC m=+801.345873589"
Jul 19 14:49:59.056535 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:59.056456    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:59.056535 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:59.056517    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:59.068856 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:59.068830    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:49:59.984323 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:49:59.984294    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xxl44"
Jul 19 14:50:20.693339 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.693250    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"]
Jul 19 14:50:20.699259 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.699238    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.701482 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.701463    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 19 14:50:20.705907 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.705880    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"]
Jul 19 14:50:20.807796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.807754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e92a2c70-d159-4853-864d-3fac0dba51f5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.807796 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.807806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e92a2c70-d159-4853-864d-3fac0dba51f5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.808022 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.807825    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e92a2c70-d159-4853-864d-3fac0dba51f5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.808022 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.807844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxrll\" (UniqueName: \"kubernetes.io/projected/e92a2c70-d159-4853-864d-3fac0dba51f5-kube-api-access-cxrll\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.808022 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.807900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e92a2c70-d159-4853-864d-3fac0dba51f5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.808120 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.808072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e92a2c70-d159-4853-864d-3fac0dba51f5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.908608 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.908565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e92a2c70-d159-4853-864d-3fac0dba51f5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.908608 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.908607    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e92a2c70-d159-4853-864d-3fac0dba51f5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.908853 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.908636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e92a2c70-d159-4853-864d-3fac0dba51f5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.908853 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.908661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e92a2c70-d159-4853-864d-3fac0dba51f5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.908853 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.908688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxrll\" (UniqueName: \"kubernetes.io/projected/e92a2c70-d159-4853-864d-3fac0dba51f5-kube-api-access-cxrll\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.908853 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.908739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e92a2c70-d159-4853-864d-3fac0dba51f5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.909061 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.909034    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e92a2c70-d159-4853-864d-3fac0dba51f5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.909123 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.909091    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e92a2c70-d159-4853-864d-3fac0dba51f5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.909123 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.909109    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e92a2c70-d159-4853-864d-3fac0dba51f5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.910883 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.910858    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e92a2c70-d159-4853-864d-3fac0dba51f5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.911142 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.911125    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e92a2c70-d159-4853-864d-3fac0dba51f5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:20.916410 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:20.916393    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxrll\" (UniqueName: \"kubernetes.io/projected/e92a2c70-d159-4853-864d-3fac0dba51f5-kube-api-access-cxrll\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2\" (UID: \"e92a2c70-d159-4853-864d-3fac0dba51f5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:21.011021 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:21.010990    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:21.146894 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:21.141366    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"]
Jul 19 14:50:22.067883 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:22.067848    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2" event={"ID":"e92a2c70-d159-4853-864d-3fac0dba51f5","Type":"ContainerStarted","Data":"c1df064b2d3da5c4fa5b0479115a3bb1aa342f3a15c432f263d957742ed998ce"}
Jul 19 14:50:22.068331 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:22.067899    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2" event={"ID":"e92a2c70-d159-4853-864d-3fac0dba51f5","Type":"ContainerStarted","Data":"f9c534a38aadcabe67eee8fb229dc1de84be4cfeb733657a9f1f9f838704fa11"}
Jul 19 14:50:22.085038 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:22.084992    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2" podStartSLOduration=1.914082302 podStartE2EDuration="2.084978033s" totalImagesPullingTime="170.895731ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:50:22.083425762 +0000 UTC m=+832.475988147" watchObservedRunningTime="2026-07-19 14:50:22.084978033 +0000 UTC m=+832.477540417"
Jul 19 14:50:31.012051 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:31.012018    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:31.012546 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:31.012077    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:31.024434 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:31.024410    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:50:31.118130 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:50:31.118105    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2"
Jul 19 14:52:56.538193 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:56.538090    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59c569b9f5-xqnb5"]
Jul 19 14:52:56.727311 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:56.727274    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-59c569b9f5-xqnb5" podUID="00370636-821d-45fd-89d4-54232ef8656a" containerName="manager" containerID="cri-o://69f22608e4530d0b83287c7c54fa8a67e0838318d883c9df45b91b70b1d914b5" gracePeriod=30
Jul 19 14:52:56.964910 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:56.964885    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c569b9f5-xqnb5"
Jul 19 14:52:57.066516 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.066477    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcq5r\" (UniqueName: \"kubernetes.io/projected/00370636-821d-45fd-89d4-54232ef8656a-kube-api-access-hcq5r\") pod \"00370636-821d-45fd-89d4-54232ef8656a\" (UID: \"00370636-821d-45fd-89d4-54232ef8656a\") "
Jul 19 14:52:57.066684 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.066525    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00370636-821d-45fd-89d4-54232ef8656a-webhook-cert\") pod \"00370636-821d-45fd-89d4-54232ef8656a\" (UID: \"00370636-821d-45fd-89d4-54232ef8656a\") "
Jul 19 14:52:57.068597 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.068564    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00370636-821d-45fd-89d4-54232ef8656a-kube-api-access-hcq5r" (OuterVolumeSpecName: "kube-api-access-hcq5r") pod "00370636-821d-45fd-89d4-54232ef8656a" (UID: "00370636-821d-45fd-89d4-54232ef8656a"). InnerVolumeSpecName "kube-api-access-hcq5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:52:57.068597 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.068583    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00370636-821d-45fd-89d4-54232ef8656a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "00370636-821d-45fd-89d4-54232ef8656a" (UID: "00370636-821d-45fd-89d4-54232ef8656a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:52:57.167522 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.167441    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcq5r\" (UniqueName: \"kubernetes.io/projected/00370636-821d-45fd-89d4-54232ef8656a-kube-api-access-hcq5r\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:52:57.167522 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.167470    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00370636-821d-45fd-89d4-54232ef8656a-webhook-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:52:57.732724 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.732691    2581 generic.go:356] "Generic (PLEG): container finished" podID="00370636-821d-45fd-89d4-54232ef8656a" containerID="69f22608e4530d0b83287c7c54fa8a67e0838318d883c9df45b91b70b1d914b5" exitCode=0
Jul 19 14:52:57.733137 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.732732    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c569b9f5-xqnb5"
Jul 19 14:52:57.733137 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.732770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c569b9f5-xqnb5" event={"ID":"00370636-821d-45fd-89d4-54232ef8656a","Type":"ContainerDied","Data":"69f22608e4530d0b83287c7c54fa8a67e0838318d883c9df45b91b70b1d914b5"}
Jul 19 14:52:57.733137 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.732819    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c569b9f5-xqnb5" event={"ID":"00370636-821d-45fd-89d4-54232ef8656a","Type":"ContainerDied","Data":"3fc33129f1d6e1a96efed5213c393961dbccf5dbada65a82c5a2442e523504fd"}
Jul 19 14:52:57.733137 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.732842    2581 scope.go:117] "RemoveContainer" containerID="69f22608e4530d0b83287c7c54fa8a67e0838318d883c9df45b91b70b1d914b5"
Jul 19 14:52:57.741373 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.741319    2581 scope.go:117] "RemoveContainer" containerID="69f22608e4530d0b83287c7c54fa8a67e0838318d883c9df45b91b70b1d914b5"
Jul 19 14:52:57.741603 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:52:57.741584    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69f22608e4530d0b83287c7c54fa8a67e0838318d883c9df45b91b70b1d914b5\": container with ID starting with 69f22608e4530d0b83287c7c54fa8a67e0838318d883c9df45b91b70b1d914b5 not found: ID does not exist" containerID="69f22608e4530d0b83287c7c54fa8a67e0838318d883c9df45b91b70b1d914b5"
Jul 19 14:52:57.741663 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.741616    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69f22608e4530d0b83287c7c54fa8a67e0838318d883c9df45b91b70b1d914b5"} err="failed to get container status \"69f22608e4530d0b83287c7c54fa8a67e0838318d883c9df45b91b70b1d914b5\": rpc error: code = NotFound desc = could not find container \"69f22608e4530d0b83287c7c54fa8a67e0838318d883c9df45b91b70b1d914b5\": container with ID starting with 69f22608e4530d0b83287c7c54fa8a67e0838318d883c9df45b91b70b1d914b5 not found: ID does not exist"
Jul 19 14:52:57.753061 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.753033    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59c569b9f5-xqnb5"]
Jul 19 14:52:57.758394 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:57.758360    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59c569b9f5-xqnb5"]
Jul 19 14:52:58.967577 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:52:58.967547    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00370636-821d-45fd-89d4-54232ef8656a" path="/var/lib/kubelet/pods/00370636-821d-45fd-89d4-54232ef8656a/volumes"
Jul 19 14:53:58.578541 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.578506    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59c569b9f5-m9h7v"]
Jul 19 14:53:58.578959 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.578935    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00370636-821d-45fd-89d4-54232ef8656a" containerName="manager"
Jul 19 14:53:58.578959 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.578954    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="00370636-821d-45fd-89d4-54232ef8656a" containerName="manager"
Jul 19 14:53:58.579074 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.579016    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="00370636-821d-45fd-89d4-54232ef8656a" containerName="manager"
Jul 19 14:53:58.582043 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.582017    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c569b9f5-m9h7v"
Jul 19 14:53:58.584571 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.584553    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 19 14:53:58.585798 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.585780    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dlsmn\""
Jul 19 14:53:58.585876 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.585863    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 19 14:53:58.592191 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.592143    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59c569b9f5-m9h7v"]
Jul 19 14:53:58.688386 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.688348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmx5c\" (UniqueName: \"kubernetes.io/projected/b7eb77e4-1f3c-4418-a4be-ece202af4cc5-kube-api-access-kmx5c\") pod \"maas-controller-59c569b9f5-m9h7v\" (UID: \"b7eb77e4-1f3c-4418-a4be-ece202af4cc5\") " pod="opendatahub/maas-controller-59c569b9f5-m9h7v"
Jul 19 14:53:58.688553 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.688431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7eb77e4-1f3c-4418-a4be-ece202af4cc5-webhook-cert\") pod \"maas-controller-59c569b9f5-m9h7v\" (UID: \"b7eb77e4-1f3c-4418-a4be-ece202af4cc5\") " pod="opendatahub/maas-controller-59c569b9f5-m9h7v"
Jul 19 14:53:58.789696 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.789662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmx5c\" (UniqueName: \"kubernetes.io/projected/b7eb77e4-1f3c-4418-a4be-ece202af4cc5-kube-api-access-kmx5c\") pod \"maas-controller-59c569b9f5-m9h7v\" (UID: \"b7eb77e4-1f3c-4418-a4be-ece202af4cc5\") " pod="opendatahub/maas-controller-59c569b9f5-m9h7v"
Jul 19 14:53:58.789817 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.789739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7eb77e4-1f3c-4418-a4be-ece202af4cc5-webhook-cert\") pod \"maas-controller-59c569b9f5-m9h7v\" (UID: \"b7eb77e4-1f3c-4418-a4be-ece202af4cc5\") " pod="opendatahub/maas-controller-59c569b9f5-m9h7v"
Jul 19 14:53:58.792311 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.792286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7eb77e4-1f3c-4418-a4be-ece202af4cc5-webhook-cert\") pod \"maas-controller-59c569b9f5-m9h7v\" (UID: \"b7eb77e4-1f3c-4418-a4be-ece202af4cc5\") " pod="opendatahub/maas-controller-59c569b9f5-m9h7v"
Jul 19 14:53:58.798159 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.798139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmx5c\" (UniqueName: \"kubernetes.io/projected/b7eb77e4-1f3c-4418-a4be-ece202af4cc5-kube-api-access-kmx5c\") pod \"maas-controller-59c569b9f5-m9h7v\" (UID: \"b7eb77e4-1f3c-4418-a4be-ece202af4cc5\") " pod="opendatahub/maas-controller-59c569b9f5-m9h7v"
Jul 19 14:53:58.892891 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:58.892801    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c569b9f5-m9h7v"
Jul 19 14:53:59.025373 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:59.025350    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59c569b9f5-m9h7v"]
Jul 19 14:53:59.027884 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:53:59.027851    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7eb77e4_1f3c_4418_a4be_ece202af4cc5.slice/crio-eabd97a1d5e6d65fc1533ddddf1765b52972097527e90304d13eabdfe7fe6e7a WatchSource:0}: Error finding container eabd97a1d5e6d65fc1533ddddf1765b52972097527e90304d13eabdfe7fe6e7a: Status 404 returned error can't find the container with id eabd97a1d5e6d65fc1533ddddf1765b52972097527e90304d13eabdfe7fe6e7a
Jul 19 14:53:59.029281 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:53:59.029257    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 14:54:00.002866 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:00.002831    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c569b9f5-m9h7v" event={"ID":"b7eb77e4-1f3c-4418-a4be-ece202af4cc5","Type":"ContainerStarted","Data":"eb9829c54ea4a73d0bde346d7eef13c07a9abfaf22e407f106383431ed8a72b0"}
Jul 19 14:54:00.003323 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:00.002887    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c569b9f5-m9h7v" event={"ID":"b7eb77e4-1f3c-4418-a4be-ece202af4cc5","Type":"ContainerStarted","Data":"eabd97a1d5e6d65fc1533ddddf1765b52972097527e90304d13eabdfe7fe6e7a"}
Jul 19 14:54:00.003323 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:00.002911    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59c569b9f5-m9h7v"
Jul 19 14:54:00.018838 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:00.018790    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59c569b9f5-m9h7v" podStartSLOduration=1.501126049 podStartE2EDuration="2.018774968s" totalImagesPullingTime="517.648919ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:54:00.017309484 +0000 UTC m=+1050.409871870" watchObservedRunningTime="2026-07-19 14:54:00.018774968 +0000 UTC m=+1050.411337497"
Jul 19 14:54:11.008776 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:11.008749    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59c569b9f5-m9h7v"
Jul 19 14:54:15.654979 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:15.654935    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59c569b9f5-m9h7v"]
Jul 19 14:54:15.655400 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:15.655171    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-59c569b9f5-m9h7v" podUID="b7eb77e4-1f3c-4418-a4be-ece202af4cc5" containerName="manager" containerID="cri-o://eb9829c54ea4a73d0bde346d7eef13c07a9abfaf22e407f106383431ed8a72b0" gracePeriod=30
Jul 19 14:54:15.890676 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:15.890651    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c569b9f5-m9h7v"
Jul 19 14:54:16.032921 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.032894    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7eb77e4-1f3c-4418-a4be-ece202af4cc5-webhook-cert\") pod \"b7eb77e4-1f3c-4418-a4be-ece202af4cc5\" (UID: \"b7eb77e4-1f3c-4418-a4be-ece202af4cc5\") "
Jul 19 14:54:16.033097 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.032966    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmx5c\" (UniqueName: \"kubernetes.io/projected/b7eb77e4-1f3c-4418-a4be-ece202af4cc5-kube-api-access-kmx5c\") pod \"b7eb77e4-1f3c-4418-a4be-ece202af4cc5\" (UID: \"b7eb77e4-1f3c-4418-a4be-ece202af4cc5\") "
Jul 19 14:54:16.034939 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.034915    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7eb77e4-1f3c-4418-a4be-ece202af4cc5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b7eb77e4-1f3c-4418-a4be-ece202af4cc5" (UID: "b7eb77e4-1f3c-4418-a4be-ece202af4cc5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:54:16.035019 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.034936    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7eb77e4-1f3c-4418-a4be-ece202af4cc5-kube-api-access-kmx5c" (OuterVolumeSpecName: "kube-api-access-kmx5c") pod "b7eb77e4-1f3c-4418-a4be-ece202af4cc5" (UID: "b7eb77e4-1f3c-4418-a4be-ece202af4cc5"). InnerVolumeSpecName "kube-api-access-kmx5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:54:16.069583 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.069551    2581 generic.go:356] "Generic (PLEG): container finished" podID="b7eb77e4-1f3c-4418-a4be-ece202af4cc5" containerID="eb9829c54ea4a73d0bde346d7eef13c07a9abfaf22e407f106383431ed8a72b0" exitCode=0
Jul 19 14:54:16.069699 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.069593    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c569b9f5-m9h7v"
Jul 19 14:54:16.069699 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.069631    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c569b9f5-m9h7v" event={"ID":"b7eb77e4-1f3c-4418-a4be-ece202af4cc5","Type":"ContainerDied","Data":"eb9829c54ea4a73d0bde346d7eef13c07a9abfaf22e407f106383431ed8a72b0"}
Jul 19 14:54:16.069699 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.069681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c569b9f5-m9h7v" event={"ID":"b7eb77e4-1f3c-4418-a4be-ece202af4cc5","Type":"ContainerDied","Data":"eabd97a1d5e6d65fc1533ddddf1765b52972097527e90304d13eabdfe7fe6e7a"}
Jul 19 14:54:16.069842 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.069705    2581 scope.go:117] "RemoveContainer" containerID="eb9829c54ea4a73d0bde346d7eef13c07a9abfaf22e407f106383431ed8a72b0"
Jul 19 14:54:16.078498 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.078484    2581 scope.go:117] "RemoveContainer" containerID="eb9829c54ea4a73d0bde346d7eef13c07a9abfaf22e407f106383431ed8a72b0"
Jul 19 14:54:16.078751 ip-10-0-134-165 kubenswrapper[2581]: E0719 14:54:16.078732    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb9829c54ea4a73d0bde346d7eef13c07a9abfaf22e407f106383431ed8a72b0\": container with ID starting with eb9829c54ea4a73d0bde346d7eef13c07a9abfaf22e407f106383431ed8a72b0 not found: ID does not exist" containerID="eb9829c54ea4a73d0bde346d7eef13c07a9abfaf22e407f106383431ed8a72b0"
Jul 19 14:54:16.078807 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.078758    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb9829c54ea4a73d0bde346d7eef13c07a9abfaf22e407f106383431ed8a72b0"} err="failed to get container status \"eb9829c54ea4a73d0bde346d7eef13c07a9abfaf22e407f106383431ed8a72b0\": rpc error: code = NotFound desc = could not find container \"eb9829c54ea4a73d0bde346d7eef13c07a9abfaf22e407f106383431ed8a72b0\": container with ID starting with eb9829c54ea4a73d0bde346d7eef13c07a9abfaf22e407f106383431ed8a72b0 not found: ID does not exist"
Jul 19 14:54:16.090215 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.090155    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59c569b9f5-m9h7v"]
Jul 19 14:54:16.091970 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.091947    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59c569b9f5-m9h7v"]
Jul 19 14:54:16.134038 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.134010    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmx5c\" (UniqueName: \"kubernetes.io/projected/b7eb77e4-1f3c-4418-a4be-ece202af4cc5-kube-api-access-kmx5c\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:54:16.134038 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.134035    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7eb77e4-1f3c-4418-a4be-ece202af4cc5-webhook-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 14:54:16.899781 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.899744    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59c569b9f5-4ccr9"]
Jul 19 14:54:16.900191 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.900064    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7eb77e4-1f3c-4418-a4be-ece202af4cc5" containerName="manager"
Jul 19 14:54:16.900191 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.900074    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7eb77e4-1f3c-4418-a4be-ece202af4cc5" containerName="manager"
Jul 19 14:54:16.900191 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.900125    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7eb77e4-1f3c-4418-a4be-ece202af4cc5" containerName="manager"
Jul 19 14:54:16.904297 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.904277    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c569b9f5-4ccr9"
Jul 19 14:54:16.907711 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.907690    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dlsmn\""
Jul 19 14:54:16.907806 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.907723    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 19 14:54:16.907806 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.907690    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 19 14:54:16.913564 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.913536    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59c569b9f5-4ccr9"]
Jul 19 14:54:16.967238 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:16.967211    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7eb77e4-1f3c-4418-a4be-ece202af4cc5" path="/var/lib/kubelet/pods/b7eb77e4-1f3c-4418-a4be-ece202af4cc5/volumes"
Jul 19 14:54:17.043211 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:17.043155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d614c31f-ce1d-47ef-8318-2c3516be2fd9-webhook-cert\") pod \"maas-controller-59c569b9f5-4ccr9\" (UID: \"d614c31f-ce1d-47ef-8318-2c3516be2fd9\") " pod="opendatahub/maas-controller-59c569b9f5-4ccr9"
Jul 19 14:54:17.043351 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:17.043254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2l8h\" (UniqueName: \"kubernetes.io/projected/d614c31f-ce1d-47ef-8318-2c3516be2fd9-kube-api-access-z2l8h\") pod \"maas-controller-59c569b9f5-4ccr9\" (UID: \"d614c31f-ce1d-47ef-8318-2c3516be2fd9\") " pod="opendatahub/maas-controller-59c569b9f5-4ccr9"
Jul 19 14:54:17.143891 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:17.143856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2l8h\" (UniqueName: \"kubernetes.io/projected/d614c31f-ce1d-47ef-8318-2c3516be2fd9-kube-api-access-z2l8h\") pod \"maas-controller-59c569b9f5-4ccr9\" (UID: \"d614c31f-ce1d-47ef-8318-2c3516be2fd9\") " pod="opendatahub/maas-controller-59c569b9f5-4ccr9"
Jul 19 14:54:17.144077 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:17.143951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d614c31f-ce1d-47ef-8318-2c3516be2fd9-webhook-cert\") pod \"maas-controller-59c569b9f5-4ccr9\" (UID: \"d614c31f-ce1d-47ef-8318-2c3516be2fd9\") " pod="opendatahub/maas-controller-59c569b9f5-4ccr9"
Jul 19 14:54:17.146441 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:17.146419    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d614c31f-ce1d-47ef-8318-2c3516be2fd9-webhook-cert\") pod \"maas-controller-59c569b9f5-4ccr9\" (UID: \"d614c31f-ce1d-47ef-8318-2c3516be2fd9\") " pod="opendatahub/maas-controller-59c569b9f5-4ccr9"
Jul 19 14:54:17.152394 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:17.152328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2l8h\" (UniqueName: \"kubernetes.io/projected/d614c31f-ce1d-47ef-8318-2c3516be2fd9-kube-api-access-z2l8h\") pod \"maas-controller-59c569b9f5-4ccr9\" (UID: \"d614c31f-ce1d-47ef-8318-2c3516be2fd9\") " pod="opendatahub/maas-controller-59c569b9f5-4ccr9"
Jul 19 14:54:17.215734 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:17.215685    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c569b9f5-4ccr9"
Jul 19 14:54:17.341764 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:17.341739    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59c569b9f5-4ccr9"]
Jul 19 14:54:17.343617 ip-10-0-134-165 kubenswrapper[2581]: W0719 14:54:17.343592    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd614c31f_ce1d_47ef_8318_2c3516be2fd9.slice/crio-aaf22e4ef06960ad79905e9e4bdfda983db2a765eb041b1b37f5413c0315520f WatchSource:0}: Error finding container aaf22e4ef06960ad79905e9e4bdfda983db2a765eb041b1b37f5413c0315520f: Status 404 returned error can't find the container with id aaf22e4ef06960ad79905e9e4bdfda983db2a765eb041b1b37f5413c0315520f
Jul 19 14:54:18.080864 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:18.080831    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c569b9f5-4ccr9" event={"ID":"d614c31f-ce1d-47ef-8318-2c3516be2fd9","Type":"ContainerStarted","Data":"b81ca47af62f9f9ffa28231bd07b6ad3317a084cb44f24b92fd31b292d05030f"}
Jul 19 14:54:18.081277 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:18.080905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c569b9f5-4ccr9" event={"ID":"d614c31f-ce1d-47ef-8318-2c3516be2fd9","Type":"ContainerStarted","Data":"aaf22e4ef06960ad79905e9e4bdfda983db2a765eb041b1b37f5413c0315520f"}
Jul 19 14:54:18.081277 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:18.080952    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59c569b9f5-4ccr9"
Jul 19 14:54:18.099718 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:18.099660    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59c569b9f5-4ccr9" podStartSLOduration=1.785745839 podStartE2EDuration="2.099640891s" totalImagesPullingTime="313.895052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:54:18.098851325 +0000 UTC m=+1068.491413711" watchObservedRunningTime="2026-07-19 14:54:18.099640891 +0000 UTC m=+1068.492203278"
Jul 19 14:54:29.088157 ip-10-0-134-165 kubenswrapper[2581]: I0719 14:54:29.088082    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59c569b9f5-4ccr9"
Jul 19 15:06:52.727038 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.726998    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"]
Jul 19 15:06:52.730645 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.730627    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:06:52.732933 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.732914    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 19 15:06:52.733036 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.732968    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-b4zp5\""
Jul 19 15:06:52.733036 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.732972    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-28590d9c-serving-cert\""
Jul 19 15:06:52.733747 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.733732    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 15:06:52.740034 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.740013    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"]
Jul 19 15:06:52.808728 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.808694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ff1248c-7cb5-4458-8d20-a1314d94feb0-maas-api-tls\") pod \"maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm\" (UID: \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:06:52.808893 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.808748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff1248c-7cb5-4458-8d20-a1314d94feb0-openshift-service-ca\") pod \"maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm\" (UID: \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:06:52.808893 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.808808    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqsvw\" (UniqueName: \"kubernetes.io/projected/0ff1248c-7cb5-4458-8d20-a1314d94feb0-kube-api-access-sqsvw\") pod \"maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm\" (UID: \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:06:52.909721 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.909685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ff1248c-7cb5-4458-8d20-a1314d94feb0-maas-api-tls\") pod \"maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm\" (UID: \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:06:52.909926 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.909751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff1248c-7cb5-4458-8d20-a1314d94feb0-openshift-service-ca\") pod \"maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm\" (UID: \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:06:52.909926 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.909799    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqsvw\" (UniqueName: \"kubernetes.io/projected/0ff1248c-7cb5-4458-8d20-a1314d94feb0-kube-api-access-sqsvw\") pod \"maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm\" (UID: \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:06:52.910629 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.910598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff1248c-7cb5-4458-8d20-a1314d94feb0-openshift-service-ca\") pod \"maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm\" (UID: \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:06:52.912377 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.912355    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ff1248c-7cb5-4458-8d20-a1314d94feb0-maas-api-tls\") pod \"maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm\" (UID: \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:06:52.918971 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:52.918945    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqsvw\" (UniqueName: \"kubernetes.io/projected/0ff1248c-7cb5-4458-8d20-a1314d94feb0-kube-api-access-sqsvw\") pod \"maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm\" (UID: \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:06:53.041281 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:53.041162    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:06:53.175771 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:53.175626    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"]
Jul 19 15:06:53.178192 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:06:53.178157    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff1248c_7cb5_4458_8d20_a1314d94feb0.slice/crio-dc91cb19da19796bcf5df6e14154059061db4e3570478879cf5a9d86b6d9e7c3 WatchSource:0}: Error finding container dc91cb19da19796bcf5df6e14154059061db4e3570478879cf5a9d86b6d9e7c3: Status 404 returned error can't find the container with id dc91cb19da19796bcf5df6e14154059061db4e3570478879cf5a9d86b6d9e7c3
Jul 19 15:06:53.179989 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:53.179969    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 15:06:53.303092 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:53.303003    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm" event={"ID":"0ff1248c-7cb5-4458-8d20-a1314d94feb0","Type":"ContainerStarted","Data":"dc91cb19da19796bcf5df6e14154059061db4e3570478879cf5a9d86b6d9e7c3"}
Jul 19 15:06:55.315005 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:55.314971    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm" event={"ID":"0ff1248c-7cb5-4458-8d20-a1314d94feb0","Type":"ContainerStarted","Data":"4718b161210b7946097274681e0f6a7c80c382dd3904b662d0815181714b29d1"}
Jul 19 15:06:55.315437 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:55.315099    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:06:55.332983 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:06:55.332936    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm" podStartSLOduration=2.046025472 podStartE2EDuration="3.332921856s" totalImagesPullingTime="1.286896384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:06:55.331425123 +0000 UTC m=+1825.723987510" watchObservedRunningTime="2026-07-19 15:06:55.332921856 +0000 UTC m=+1825.725484241"
Jul 19 15:07:01.324946 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:01.324918    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:07:18.286160 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:18.286119    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs"]
Jul 19 15:07:18.289694 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:18.289672    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs"
Jul 19 15:07:18.291990 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:18.291961    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bq7rt\""
Jul 19 15:07:18.296747 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:18.296722    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs"]
Jul 19 15:07:18.445640 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:18.445607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a743da5-4e5b-4ba7-bf24-748927cdbec5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs\" (UID: \"8a743da5-4e5b-4ba7-bf24-748927cdbec5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs"
Jul 19 15:07:18.546149 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:18.546056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a743da5-4e5b-4ba7-bf24-748927cdbec5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs\" (UID: \"8a743da5-4e5b-4ba7-bf24-748927cdbec5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs"
Jul 19 15:07:18.546767 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:18.546743    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a743da5-4e5b-4ba7-bf24-748927cdbec5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs\" (UID: \"8a743da5-4e5b-4ba7-bf24-748927cdbec5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs"
Jul 19 15:07:18.602093 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:18.602056    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs"
Jul 19 15:07:18.732907 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:18.732882    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs"]
Jul 19 15:07:18.735540 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:07:18.735509    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a743da5_4e5b_4ba7_bf24_748927cdbec5.slice/crio-fb71ed448f1d473f456609e4ac406ebd8c436d6b3df083d6e557cfcd46322d60 WatchSource:0}: Error finding container fb71ed448f1d473f456609e4ac406ebd8c436d6b3df083d6e557cfcd46322d60: Status 404 returned error can't find the container with id fb71ed448f1d473f456609e4ac406ebd8c436d6b3df083d6e557cfcd46322d60
Jul 19 15:07:19.419536 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:19.419503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs" event={"ID":"8a743da5-4e5b-4ba7-bf24-748927cdbec5","Type":"ContainerStarted","Data":"fb71ed448f1d473f456609e4ac406ebd8c436d6b3df083d6e557cfcd46322d60"}
Jul 19 15:07:21.431713 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:21.431676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs" event={"ID":"8a743da5-4e5b-4ba7-bf24-748927cdbec5","Type":"ContainerStarted","Data":"7c5b1449cacd659d4d73a94ed698f3f370c80640b04a56033964248f869b30f2"}
Jul 19 15:07:21.448273 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:21.448214    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs" podStartSLOduration=1.290214557 podStartE2EDuration="3.448163021s" totalImagesPullingTime="2.157948464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:07:21.44753378 +0000 UTC m=+1851.840096168" watchObservedRunningTime="2026-07-19 15:07:21.448163021 +0000 UTC m=+1851.840725407"
Jul 19 15:07:22.437323 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:22.437287    2581 generic.go:356] "Generic (PLEG): container finished" podID="8a743da5-4e5b-4ba7-bf24-748927cdbec5" containerID="7c5b1449cacd659d4d73a94ed698f3f370c80640b04a56033964248f869b30f2" exitCode=0
Jul 19 15:07:22.437698 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:22.437351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs" event={"ID":"8a743da5-4e5b-4ba7-bf24-748927cdbec5","Type":"ContainerDied","Data":"7c5b1449cacd659d4d73a94ed698f3f370c80640b04a56033964248f869b30f2"}
Jul 19 15:07:23.569455 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:23.569430    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs"
Jul 19 15:07:23.692467 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:23.692430    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a743da5-4e5b-4ba7-bf24-748927cdbec5-maas-api-service-ca\") pod \"8a743da5-4e5b-4ba7-bf24-748927cdbec5\" (UID: \"8a743da5-4e5b-4ba7-bf24-748927cdbec5\") "
Jul 19 15:07:23.692834 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:23.692783    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a743da5-4e5b-4ba7-bf24-748927cdbec5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a743da5-4e5b-4ba7-bf24-748927cdbec5" (UID: "8a743da5-4e5b-4ba7-bf24-748927cdbec5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:07:23.793968 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:23.793934    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a743da5-4e5b-4ba7-bf24-748927cdbec5-maas-api-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:07:24.448190 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:24.448159    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs"
Jul 19 15:07:24.448363 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:24.448157    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs" event={"ID":"8a743da5-4e5b-4ba7-bf24-748927cdbec5","Type":"ContainerDied","Data":"fb71ed448f1d473f456609e4ac406ebd8c436d6b3df083d6e557cfcd46322d60"}
Jul 19 15:07:24.448363 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:24.448308    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb71ed448f1d473f456609e4ac406ebd8c436d6b3df083d6e557cfcd46322d60"
Jul 19 15:07:28.660535 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:28.660501    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"]
Jul 19 15:07:28.660909 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:28.660703    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm" podUID="0ff1248c-7cb5-4458-8d20-a1314d94feb0" containerName="maas-api" containerID="cri-o://4718b161210b7946097274681e0f6a7c80c382dd3904b662d0815181714b29d1" gracePeriod=30
Jul 19 15:07:28.910690 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:28.910629    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:07:29.040368 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.040336    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqsvw\" (UniqueName: \"kubernetes.io/projected/0ff1248c-7cb5-4458-8d20-a1314d94feb0-kube-api-access-sqsvw\") pod \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\" (UID: \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\") "
Jul 19 15:07:29.040561 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.040388    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff1248c-7cb5-4458-8d20-a1314d94feb0-openshift-service-ca\") pod \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\" (UID: \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\") "
Jul 19 15:07:29.040561 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.040425    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ff1248c-7cb5-4458-8d20-a1314d94feb0-maas-api-tls\") pod \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\" (UID: \"0ff1248c-7cb5-4458-8d20-a1314d94feb0\") "
Jul 19 15:07:29.040790 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.040757    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ff1248c-7cb5-4458-8d20-a1314d94feb0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ff1248c-7cb5-4458-8d20-a1314d94feb0" (UID: "0ff1248c-7cb5-4458-8d20-a1314d94feb0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:07:29.042617 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.042595    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ff1248c-7cb5-4458-8d20-a1314d94feb0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ff1248c-7cb5-4458-8d20-a1314d94feb0" (UID: "0ff1248c-7cb5-4458-8d20-a1314d94feb0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 15:07:29.042724 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.042598    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ff1248c-7cb5-4458-8d20-a1314d94feb0-kube-api-access-sqsvw" (OuterVolumeSpecName: "kube-api-access-sqsvw") pod "0ff1248c-7cb5-4458-8d20-a1314d94feb0" (UID: "0ff1248c-7cb5-4458-8d20-a1314d94feb0"). InnerVolumeSpecName "kube-api-access-sqsvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:07:29.142086 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.142053    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff1248c-7cb5-4458-8d20-a1314d94feb0-openshift-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:07:29.142086 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.142086    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ff1248c-7cb5-4458-8d20-a1314d94feb0-maas-api-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:07:29.142318 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.142096    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqsvw\" (UniqueName: \"kubernetes.io/projected/0ff1248c-7cb5-4458-8d20-a1314d94feb0-kube-api-access-sqsvw\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:07:29.470211 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.470159    2581 generic.go:356] "Generic (PLEG): container finished" podID="0ff1248c-7cb5-4458-8d20-a1314d94feb0" containerID="4718b161210b7946097274681e0f6a7c80c382dd3904b662d0815181714b29d1" exitCode=0
Jul 19 15:07:29.470385 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.470228    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"
Jul 19 15:07:29.470385 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.470250    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm" event={"ID":"0ff1248c-7cb5-4458-8d20-a1314d94feb0","Type":"ContainerDied","Data":"4718b161210b7946097274681e0f6a7c80c382dd3904b662d0815181714b29d1"}
Jul 19 15:07:29.470385 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.470311    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm" event={"ID":"0ff1248c-7cb5-4458-8d20-a1314d94feb0","Type":"ContainerDied","Data":"dc91cb19da19796bcf5df6e14154059061db4e3570478879cf5a9d86b6d9e7c3"}
Jul 19 15:07:29.470385 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.470345    2581 scope.go:117] "RemoveContainer" containerID="4718b161210b7946097274681e0f6a7c80c382dd3904b662d0815181714b29d1"
Jul 19 15:07:29.479236 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.479213    2581 scope.go:117] "RemoveContainer" containerID="4718b161210b7946097274681e0f6a7c80c382dd3904b662d0815181714b29d1"
Jul 19 15:07:29.479485 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:07:29.479465    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4718b161210b7946097274681e0f6a7c80c382dd3904b662d0815181714b29d1\": container with ID starting with 4718b161210b7946097274681e0f6a7c80c382dd3904b662d0815181714b29d1 not found: ID does not exist" containerID="4718b161210b7946097274681e0f6a7c80c382dd3904b662d0815181714b29d1"
Jul 19 15:07:29.479532 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.479494    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4718b161210b7946097274681e0f6a7c80c382dd3904b662d0815181714b29d1"} err="failed to get container status \"4718b161210b7946097274681e0f6a7c80c382dd3904b662d0815181714b29d1\": rpc error: code = NotFound desc = could not find container \"4718b161210b7946097274681e0f6a7c80c382dd3904b662d0815181714b29d1\": container with ID starting with 4718b161210b7946097274681e0f6a7c80c382dd3904b662d0815181714b29d1 not found: ID does not exist"
Jul 19 15:07:29.490282 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.490256    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"]
Jul 19 15:07:29.495665 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:29.495643    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-28590d9c-6d684cf565-5ccwm"]
Jul 19 15:07:30.967760 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:30.967717    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ff1248c-7cb5-4458-8d20-a1314d94feb0" path="/var/lib/kubelet/pods/0ff1248c-7cb5-4458-8d20-a1314d94feb0/volumes"
Jul 19 15:07:33.355153 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:33.355123    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs"]
Jul 19 15:07:33.357380 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:33.357354    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28590d9c-n9wgs"]
Jul 19 15:07:34.525611 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.525583    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"]
Jul 19 15:07:34.526097 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.526078    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff1248c-7cb5-4458-8d20-a1314d94feb0" containerName="maas-api"
Jul 19 15:07:34.526197 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.526099    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff1248c-7cb5-4458-8d20-a1314d94feb0" containerName="maas-api"
Jul 19 15:07:34.526197 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.526132    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a743da5-4e5b-4ba7-bf24-748927cdbec5" containerName="revoke-keys"
Jul 19 15:07:34.526197 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.526141    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a743da5-4e5b-4ba7-bf24-748927cdbec5" containerName="revoke-keys"
Jul 19 15:07:34.526349 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.526235    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a743da5-4e5b-4ba7-bf24-748927cdbec5" containerName="revoke-keys"
Jul 19 15:07:34.526349 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.526250    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ff1248c-7cb5-4458-8d20-a1314d94feb0" containerName="maas-api"
Jul 19 15:07:34.529099 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.529080    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.531701 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.531683    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c1c8ecb5-gw-openshift-default-dockercfg-m8vsl\""
Jul 19 15:07:34.540082 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.540060    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"]
Jul 19 15:07:34.593367 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.593336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-data\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.593510 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.593371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-token\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.593510 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.593394    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzwwb\" (UniqueName: \"kubernetes.io/projected/dfe641d4-5fd2-49f9-aa87-0a80839330d9-kube-api-access-tzwwb\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.593510 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.593487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-workload-certs\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.593661 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.593515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-envoy\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.593661 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.593636    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-credential-socket\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.593767 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.593679    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-workload-socket\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.593767 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.593720    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-podinfo\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.593767 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.593745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istiod-ca-cert\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.694389 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.694344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-credential-socket\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.694389 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.694401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-workload-socket\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.694633 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.694424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-podinfo\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.694633 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.694440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istiod-ca-cert\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.694633 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.694464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-data\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.694633 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.694483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-token\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.694633 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.694512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzwwb\" (UniqueName: \"kubernetes.io/projected/dfe641d4-5fd2-49f9-aa87-0a80839330d9-kube-api-access-tzwwb\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.694633 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.694559    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-workload-certs\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.694633 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.694588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-envoy\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.694968 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.694769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-credential-socket\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.694968 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.694860    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-workload-socket\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.694968 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.694875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-data\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.695088 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.694986    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-workload-certs\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.695265 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.695248    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istiod-ca-cert\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.696825 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.696803    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-envoy\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.697058 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.697040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-podinfo\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.706688 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.706666    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-token\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.706766 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.706750    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzwwb\" (UniqueName: \"kubernetes.io/projected/dfe641d4-5fd2-49f9-aa87-0a80839330d9-kube-api-access-tzwwb\") pod \"e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") " pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.839454 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.839374    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:34.968459 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.968431    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a743da5-4e5b-4ba7-bf24-748927cdbec5" path="/var/lib/kubelet/pods/8a743da5-4e5b-4ba7-bf24-748927cdbec5/volumes"
Jul 19 15:07:34.977565 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.977487    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"]
Jul 19 15:07:34.979743 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:07:34.979719    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe641d4_5fd2_49f9_aa87_0a80839330d9.slice/crio-c25015b59f2f1858687070ae841fc68cfbf8247d22138df55caac25e7a03e0fe WatchSource:0}: Error finding container c25015b59f2f1858687070ae841fc68cfbf8247d22138df55caac25e7a03e0fe: Status 404 returned error can't find the container with id c25015b59f2f1858687070ae841fc68cfbf8247d22138df55caac25e7a03e0fe
Jul 19 15:07:34.981655 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.981627    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:07:34.981709 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.981687    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:07:34.981751 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:34.981714    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:07:35.499977 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:35.499945    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7" event={"ID":"dfe641d4-5fd2-49f9-aa87-0a80839330d9","Type":"ContainerStarted","Data":"5e4d456a6f607235a47543b5792e43245020e96c0b2b8eed925e350da8d3efea"}
Jul 19 15:07:35.500151 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:35.499997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7" event={"ID":"dfe641d4-5fd2-49f9-aa87-0a80839330d9","Type":"ContainerStarted","Data":"c25015b59f2f1858687070ae841fc68cfbf8247d22138df55caac25e7a03e0fe"}
Jul 19 15:07:35.520989 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:35.520946    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7" podStartSLOduration=1.520928507 podStartE2EDuration="1.520928507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:07:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:07:35.519585433 +0000 UTC m=+1865.912147819" watchObservedRunningTime="2026-07-19 15:07:35.520928507 +0000 UTC m=+1865.913490893"
Jul 19 15:07:35.840531 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:35.840454    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:36.844390 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:36.844356    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:37.053165 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.053117    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"]
Jul 19 15:07:37.057028 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.057008    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:07:37.059561 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.059534    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c1c8ecb5-serving-cert\""
Jul 19 15:07:37.059561 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.059559    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 15:07:37.059738 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.059616    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-b4zp5\""
Jul 19 15:07:37.059738 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.059668    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 19 15:07:37.067014 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.066976    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"]
Jul 19 15:07:37.116426 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.116339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc830d3-dfc9-434f-a940-c0a9979c1217-openshift-service-ca\") pod \"maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc\" (UID: \"5bc830d3-dfc9-434f-a940-c0a9979c1217\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:07:37.116426 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.116389    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc830d3-dfc9-434f-a940-c0a9979c1217-maas-api-tls\") pod \"maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc\" (UID: \"5bc830d3-dfc9-434f-a940-c0a9979c1217\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:07:37.116638 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.116493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt6cn\" (UniqueName: \"kubernetes.io/projected/5bc830d3-dfc9-434f-a940-c0a9979c1217-kube-api-access-nt6cn\") pod \"maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc\" (UID: \"5bc830d3-dfc9-434f-a940-c0a9979c1217\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:07:37.216972 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.216940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc830d3-dfc9-434f-a940-c0a9979c1217-maas-api-tls\") pod \"maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc\" (UID: \"5bc830d3-dfc9-434f-a940-c0a9979c1217\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:07:37.217144 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.216995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt6cn\" (UniqueName: \"kubernetes.io/projected/5bc830d3-dfc9-434f-a940-c0a9979c1217-kube-api-access-nt6cn\") pod \"maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc\" (UID: \"5bc830d3-dfc9-434f-a940-c0a9979c1217\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:07:37.217144 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.217047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc830d3-dfc9-434f-a940-c0a9979c1217-openshift-service-ca\") pod \"maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc\" (UID: \"5bc830d3-dfc9-434f-a940-c0a9979c1217\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:07:37.217758 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.217736    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc830d3-dfc9-434f-a940-c0a9979c1217-openshift-service-ca\") pod \"maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc\" (UID: \"5bc830d3-dfc9-434f-a940-c0a9979c1217\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:07:37.219394 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.219374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc830d3-dfc9-434f-a940-c0a9979c1217-maas-api-tls\") pod \"maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc\" (UID: \"5bc830d3-dfc9-434f-a940-c0a9979c1217\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:07:37.225759 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.225728    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt6cn\" (UniqueName: \"kubernetes.io/projected/5bc830d3-dfc9-434f-a940-c0a9979c1217-kube-api-access-nt6cn\") pod \"maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc\" (UID: \"5bc830d3-dfc9-434f-a940-c0a9979c1217\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:07:37.369233 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.369133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:07:37.497861 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.497829    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"]
Jul 19 15:07:37.504537 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:07:37.504509    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc830d3_dfc9_434f_a940_c0a9979c1217.slice/crio-fb1eaacf69cfabfaf7e02b7bdfa741846cc1aa81d544ad865610aae70819ccf3 WatchSource:0}: Error finding container fb1eaacf69cfabfaf7e02b7bdfa741846cc1aa81d544ad865610aae70819ccf3: Status 404 returned error can't find the container with id fb1eaacf69cfabfaf7e02b7bdfa741846cc1aa81d544ad865610aae70819ccf3
Jul 19 15:07:37.514131 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.512551    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:37.514131 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:37.513398    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:38.518280 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:38.518240    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc" event={"ID":"5bc830d3-dfc9-434f-a940-c0a9979c1217","Type":"ContainerStarted","Data":"7958af49378e4874abcc708e3e1a0f84c615c9cd6542b8ebc84dc439512cf2c7"}
Jul 19 15:07:38.518675 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:38.518296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc" event={"ID":"5bc830d3-dfc9-434f-a940-c0a9979c1217","Type":"ContainerStarted","Data":"fb1eaacf69cfabfaf7e02b7bdfa741846cc1aa81d544ad865610aae70819ccf3"}
Jul 19 15:07:38.518675 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:38.518427    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:07:38.534666 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:38.534525    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc" podStartSLOduration=1.215148794 podStartE2EDuration="1.534505317s" totalImagesPullingTime="319.356523ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:07:38.53411279 +0000 UTC m=+1868.926675187" watchObservedRunningTime="2026-07-19 15:07:38.534505317 +0000 UTC m=+1868.927067702"
Jul 19 15:07:44.528165 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:44.528131    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:07:52.513941 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:52.513905    2581 patch_prober.go:28] interesting pod/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 19 15:07:52.514372 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:52.513974    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7" podUID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 19 15:07:52.592065 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:52.592029    2581 generic.go:356] "Generic (PLEG): container finished" podID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerID="5e4d456a6f607235a47543b5792e43245020e96c0b2b8eed925e350da8d3efea" exitCode=0
Jul 19 15:07:52.592245 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:52.592073    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7" event={"ID":"dfe641d4-5fd2-49f9-aa87-0a80839330d9","Type":"ContainerDied","Data":"5e4d456a6f607235a47543b5792e43245020e96c0b2b8eed925e350da8d3efea"}
Jul 19 15:07:52.592472 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:52.592458    2581 scope.go:117] "RemoveContainer" containerID="5e4d456a6f607235a47543b5792e43245020e96c0b2b8eed925e350da8d3efea"
Jul 19 15:07:52.593448 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:52.593420    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:07:52.593506 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:52.593487    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:07:52.593550 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:52.593518    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:07:53.597916 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:53.597884    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7" event={"ID":"dfe641d4-5fd2-49f9-aa87-0a80839330d9","Type":"ContainerStarted","Data":"eeecb808c76497f8553c97a643217de5379314bbaa9152ae166449e94d29fa54"}
Jul 19 15:07:53.839502 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:53.839465    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:53.839745 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:53.839720    2581 patch_prober.go:28] interesting pod/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 19 15:07:53.839796 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:53.839776    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7" podUID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 19 15:07:54.840067 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:54.840026    2581 patch_prober.go:28] interesting pod/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 19 15:07:54.840471 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:54.840087    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7" podUID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 19 15:07:55.840614 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:55.840581    2581 patch_prober.go:28] interesting pod/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 19 15:07:55.841005 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:55.840633    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7" podUID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 19 15:07:56.840308 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:56.840267    2581 patch_prober.go:28] interesting pod/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 19 15:07:56.840491 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:56.840323    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7" podUID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 19 15:07:57.843783 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:57.843754    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:57.844209 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:57.844013    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:07:57.844752 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:07:57.844736    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:08:12.378499 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.378467    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"]
Jul 19 15:08:12.379193 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.378672    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc" podUID="5bc830d3-dfc9-434f-a940-c0a9979c1217" containerName="maas-api" containerID="cri-o://7958af49378e4874abcc708e3e1a0f84c615c9cd6542b8ebc84dc439512cf2c7" gracePeriod=30
Jul 19 15:08:12.627287 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.627253    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:08:12.682160 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.682069    2581 generic.go:356] "Generic (PLEG): container finished" podID="5bc830d3-dfc9-434f-a940-c0a9979c1217" containerID="7958af49378e4874abcc708e3e1a0f84c615c9cd6542b8ebc84dc439512cf2c7" exitCode=0
Jul 19 15:08:12.682160 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.682117    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"
Jul 19 15:08:12.682347 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.682156    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc" event={"ID":"5bc830d3-dfc9-434f-a940-c0a9979c1217","Type":"ContainerDied","Data":"7958af49378e4874abcc708e3e1a0f84c615c9cd6542b8ebc84dc439512cf2c7"}
Jul 19 15:08:12.682347 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.682256    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc" event={"ID":"5bc830d3-dfc9-434f-a940-c0a9979c1217","Type":"ContainerDied","Data":"fb1eaacf69cfabfaf7e02b7bdfa741846cc1aa81d544ad865610aae70819ccf3"}
Jul 19 15:08:12.682347 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.682280    2581 scope.go:117] "RemoveContainer" containerID="7958af49378e4874abcc708e3e1a0f84c615c9cd6542b8ebc84dc439512cf2c7"
Jul 19 15:08:12.690128 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.690111    2581 scope.go:117] "RemoveContainer" containerID="7958af49378e4874abcc708e3e1a0f84c615c9cd6542b8ebc84dc439512cf2c7"
Jul 19 15:08:12.690369 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:08:12.690353    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7958af49378e4874abcc708e3e1a0f84c615c9cd6542b8ebc84dc439512cf2c7\": container with ID starting with 7958af49378e4874abcc708e3e1a0f84c615c9cd6542b8ebc84dc439512cf2c7 not found: ID does not exist" containerID="7958af49378e4874abcc708e3e1a0f84c615c9cd6542b8ebc84dc439512cf2c7"
Jul 19 15:08:12.690418 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.690378    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7958af49378e4874abcc708e3e1a0f84c615c9cd6542b8ebc84dc439512cf2c7"} err="failed to get container status \"7958af49378e4874abcc708e3e1a0f84c615c9cd6542b8ebc84dc439512cf2c7\": rpc error: code = NotFound desc = could not find container \"7958af49378e4874abcc708e3e1a0f84c615c9cd6542b8ebc84dc439512cf2c7\": container with ID starting with 7958af49378e4874abcc708e3e1a0f84c615c9cd6542b8ebc84dc439512cf2c7 not found: ID does not exist"
Jul 19 15:08:12.738714 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.738685    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc830d3-dfc9-434f-a940-c0a9979c1217-maas-api-tls\") pod \"5bc830d3-dfc9-434f-a940-c0a9979c1217\" (UID: \"5bc830d3-dfc9-434f-a940-c0a9979c1217\") "
Jul 19 15:08:12.738887 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.738732    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc830d3-dfc9-434f-a940-c0a9979c1217-openshift-service-ca\") pod \"5bc830d3-dfc9-434f-a940-c0a9979c1217\" (UID: \"5bc830d3-dfc9-434f-a940-c0a9979c1217\") "
Jul 19 15:08:12.738887 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.738763    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt6cn\" (UniqueName: \"kubernetes.io/projected/5bc830d3-dfc9-434f-a940-c0a9979c1217-kube-api-access-nt6cn\") pod \"5bc830d3-dfc9-434f-a940-c0a9979c1217\" (UID: \"5bc830d3-dfc9-434f-a940-c0a9979c1217\") "
Jul 19 15:08:12.739163 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.739131    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bc830d3-dfc9-434f-a940-c0a9979c1217-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5bc830d3-dfc9-434f-a940-c0a9979c1217" (UID: "5bc830d3-dfc9-434f-a940-c0a9979c1217"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:08:12.740866 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.740843    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bc830d3-dfc9-434f-a940-c0a9979c1217-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5bc830d3-dfc9-434f-a940-c0a9979c1217" (UID: "5bc830d3-dfc9-434f-a940-c0a9979c1217"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 15:08:12.740990 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.740964    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc830d3-dfc9-434f-a940-c0a9979c1217-kube-api-access-nt6cn" (OuterVolumeSpecName: "kube-api-access-nt6cn") pod "5bc830d3-dfc9-434f-a940-c0a9979c1217" (UID: "5bc830d3-dfc9-434f-a940-c0a9979c1217"). InnerVolumeSpecName "kube-api-access-nt6cn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:08:12.840515 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.840478    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bc830d3-dfc9-434f-a940-c0a9979c1217-maas-api-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:12.840515 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.840506    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc830d3-dfc9-434f-a940-c0a9979c1217-openshift-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:12.840515 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.840517    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt6cn\" (UniqueName: \"kubernetes.io/projected/5bc830d3-dfc9-434f-a940-c0a9979c1217-kube-api-access-nt6cn\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:12.997638 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:12.997607    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"]
Jul 19 15:08:13.001186 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:13.001152    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c1c8ecb5-567dc85f8-5cvhc"]
Jul 19 15:08:14.967658 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:14.967628    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bc830d3-dfc9-434f-a940-c0a9979c1217" path="/var/lib/kubelet/pods/5bc830d3-dfc9-434f-a940-c0a9979c1217/volumes"
Jul 19 15:08:17.242227 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:17.242166    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"]
Jul 19 15:08:17.242697 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:17.242442    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7" podUID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerName="istio-proxy" containerID="cri-o://eeecb808c76497f8553c97a643217de5379314bbaa9152ae166449e94d29fa54" gracePeriod=30
Jul 19 15:08:20.414092 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.414058    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"]
Jul 19 15:08:20.414467 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.414393    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc830d3-dfc9-434f-a940-c0a9979c1217" containerName="maas-api"
Jul 19 15:08:20.414467 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.414405    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc830d3-dfc9-434f-a940-c0a9979c1217" containerName="maas-api"
Jul 19 15:08:20.414541 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.414472    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bc830d3-dfc9-434f-a940-c0a9979c1217" containerName="maas-api"
Jul 19 15:08:20.418811 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.418790    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:20.421521 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.421501    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 19 15:08:20.422357 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.422342    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-79a97677-serving-cert\""
Jul 19 15:08:20.422425 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.422341    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-b4zp5\""
Jul 19 15:08:20.422425 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.422374    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 15:08:20.429133 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.429108    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"]
Jul 19 15:08:20.498443 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.498408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dddd703e-22d6-44d2-98d2-0b7c1859d440-maas-api-tls\") pod \"maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz\" (UID: \"dddd703e-22d6-44d2-98d2-0b7c1859d440\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:20.498443 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.498442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dddd703e-22d6-44d2-98d2-0b7c1859d440-openshift-service-ca\") pod \"maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz\" (UID: \"dddd703e-22d6-44d2-98d2-0b7c1859d440\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:20.498641 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.498459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5fjw\" (UniqueName: \"kubernetes.io/projected/dddd703e-22d6-44d2-98d2-0b7c1859d440-kube-api-access-x5fjw\") pod \"maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz\" (UID: \"dddd703e-22d6-44d2-98d2-0b7c1859d440\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:20.598934 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.598899    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dddd703e-22d6-44d2-98d2-0b7c1859d440-maas-api-tls\") pod \"maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz\" (UID: \"dddd703e-22d6-44d2-98d2-0b7c1859d440\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:20.598934 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.598933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dddd703e-22d6-44d2-98d2-0b7c1859d440-openshift-service-ca\") pod \"maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz\" (UID: \"dddd703e-22d6-44d2-98d2-0b7c1859d440\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:20.599230 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.598953    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5fjw\" (UniqueName: \"kubernetes.io/projected/dddd703e-22d6-44d2-98d2-0b7c1859d440-kube-api-access-x5fjw\") pod \"maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz\" (UID: \"dddd703e-22d6-44d2-98d2-0b7c1859d440\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:20.599230 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:08:20.599065    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-serving-cert: secret "maas-api-e2e-ait-79a97677-serving-cert" not found
Jul 19 15:08:20.599230 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:08:20.599151    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dddd703e-22d6-44d2-98d2-0b7c1859d440-maas-api-tls podName:dddd703e-22d6-44d2-98d2-0b7c1859d440 nodeName:}" failed. No retries permitted until 2026-07-19 15:08:21.099129115 +0000 UTC m=+1911.491691492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dddd703e-22d6-44d2-98d2-0b7c1859d440-maas-api-tls") pod "maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz" (UID: "dddd703e-22d6-44d2-98d2-0b7c1859d440") : secret "maas-api-e2e-ait-79a97677-serving-cert" not found
Jul 19 15:08:20.599674 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.599654    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dddd703e-22d6-44d2-98d2-0b7c1859d440-openshift-service-ca\") pod \"maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz\" (UID: \"dddd703e-22d6-44d2-98d2-0b7c1859d440\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:20.607939 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:20.607918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5fjw\" (UniqueName: \"kubernetes.io/projected/dddd703e-22d6-44d2-98d2-0b7c1859d440-kube-api-access-x5fjw\") pod \"maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz\" (UID: \"dddd703e-22d6-44d2-98d2-0b7c1859d440\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:21.102971 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:21.102937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dddd703e-22d6-44d2-98d2-0b7c1859d440-maas-api-tls\") pod \"maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz\" (UID: \"dddd703e-22d6-44d2-98d2-0b7c1859d440\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:21.105590 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:21.105556    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dddd703e-22d6-44d2-98d2-0b7c1859d440-maas-api-tls\") pod \"maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz\" (UID: \"dddd703e-22d6-44d2-98d2-0b7c1859d440\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:21.329937 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:21.329896    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:21.467875 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:21.467847    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"]
Jul 19 15:08:21.470229 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:08:21.470199    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddddd703e_22d6_44d2_98d2_0b7c1859d440.slice/crio-ec55010c47d19991e7ab4b77a44052806689ce25d4bf56a7f8802ce135699b3f WatchSource:0}: Error finding container ec55010c47d19991e7ab4b77a44052806689ce25d4bf56a7f8802ce135699b3f: Status 404 returned error can't find the container with id ec55010c47d19991e7ab4b77a44052806689ce25d4bf56a7f8802ce135699b3f
Jul 19 15:08:21.727038 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:21.727001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz" event={"ID":"dddd703e-22d6-44d2-98d2-0b7c1859d440","Type":"ContainerStarted","Data":"ec55010c47d19991e7ab4b77a44052806689ce25d4bf56a7f8802ce135699b3f"}
Jul 19 15:08:22.498580 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.498555    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:08:22.515077 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515009    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-envoy\") pod \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") "
Jul 19 15:08:22.515077 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515044    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-credential-socket\") pod \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") "
Jul 19 15:08:22.515290 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515079    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-workload-socket\") pod \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") "
Jul 19 15:08:22.515290 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515122    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-podinfo\") pod \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") "
Jul 19 15:08:22.515290 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515148    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-token\") pod \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") "
Jul 19 15:08:22.515442 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515312    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-data\") pod \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") "
Jul 19 15:08:22.515442 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515351    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzwwb\" (UniqueName: \"kubernetes.io/projected/dfe641d4-5fd2-49f9-aa87-0a80839330d9-kube-api-access-tzwwb\") pod \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") "
Jul 19 15:08:22.515442 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515420    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istiod-ca-cert\") pod \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") "
Jul 19 15:08:22.515597 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515432    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dfe641d4-5fd2-49f9-aa87-0a80839330d9" (UID: "dfe641d4-5fd2-49f9-aa87-0a80839330d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:08:22.515597 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515448    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-workload-certs\") pod \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\" (UID: \"dfe641d4-5fd2-49f9-aa87-0a80839330d9\") "
Jul 19 15:08:22.515597 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515438    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dfe641d4-5fd2-49f9-aa87-0a80839330d9" (UID: "dfe641d4-5fd2-49f9-aa87-0a80839330d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:08:22.515750 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515633    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dfe641d4-5fd2-49f9-aa87-0a80839330d9" (UID: "dfe641d4-5fd2-49f9-aa87-0a80839330d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:08:22.515824 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515806    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:22.515881 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515831    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:22.515881 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515846    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:22.515881 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.515850    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dfe641d4-5fd2-49f9-aa87-0a80839330d9" (UID: "dfe641d4-5fd2-49f9-aa87-0a80839330d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:08:22.516299 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.516276    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "dfe641d4-5fd2-49f9-aa87-0a80839330d9" (UID: "dfe641d4-5fd2-49f9-aa87-0a80839330d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:08:22.517489 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.517465    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dfe641d4-5fd2-49f9-aa87-0a80839330d9" (UID: "dfe641d4-5fd2-49f9-aa87-0a80839330d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:08:22.517869 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.517801    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe641d4-5fd2-49f9-aa87-0a80839330d9-kube-api-access-tzwwb" (OuterVolumeSpecName: "kube-api-access-tzwwb") pod "dfe641d4-5fd2-49f9-aa87-0a80839330d9" (UID: "dfe641d4-5fd2-49f9-aa87-0a80839330d9"). InnerVolumeSpecName "kube-api-access-tzwwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:08:22.518395 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.517907    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dfe641d4-5fd2-49f9-aa87-0a80839330d9" (UID: "dfe641d4-5fd2-49f9-aa87-0a80839330d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 15:08:22.519160 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.519125    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "dfe641d4-5fd2-49f9-aa87-0a80839330d9" (UID: "dfe641d4-5fd2-49f9-aa87-0a80839330d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:08:22.616898 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.616867    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:22.616898 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.616893    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzwwb\" (UniqueName: \"kubernetes.io/projected/dfe641d4-5fd2-49f9-aa87-0a80839330d9-kube-api-access-tzwwb\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:22.616898 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.616901    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:22.617124 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.616912    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:22.617124 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.616920    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:22.617124 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.616927    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfe641d4-5fd2-49f9-aa87-0a80839330d9-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:22.734331 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.734300    2581 generic.go:356] "Generic (PLEG): container finished" podID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerID="eeecb808c76497f8553c97a643217de5379314bbaa9152ae166449e94d29fa54" exitCode=0
Jul 19 15:08:22.734506 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.734357    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"
Jul 19 15:08:22.734506 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.734385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7" event={"ID":"dfe641d4-5fd2-49f9-aa87-0a80839330d9","Type":"ContainerDied","Data":"eeecb808c76497f8553c97a643217de5379314bbaa9152ae166449e94d29fa54"}
Jul 19 15:08:22.734506 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.734454    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7" event={"ID":"dfe641d4-5fd2-49f9-aa87-0a80839330d9","Type":"ContainerDied","Data":"c25015b59f2f1858687070ae841fc68cfbf8247d22138df55caac25e7a03e0fe"}
Jul 19 15:08:22.734506 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.734490    2581 scope.go:117] "RemoveContainer" containerID="eeecb808c76497f8553c97a643217de5379314bbaa9152ae166449e94d29fa54"
Jul 19 15:08:22.736162 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.736139    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz" event={"ID":"dddd703e-22d6-44d2-98d2-0b7c1859d440","Type":"ContainerStarted","Data":"4f78f72ce0bd80ec5acdf0962c54b6158d43708e0201d62952da8d7f56dd2607"}
Jul 19 15:08:22.745873 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.745850    2581 scope.go:117] "RemoveContainer" containerID="5e4d456a6f607235a47543b5792e43245020e96c0b2b8eed925e350da8d3efea"
Jul 19 15:08:22.754279 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.754234    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz" podStartSLOduration=2.390366291 podStartE2EDuration="2.754217174s" totalImagesPullingTime="363.850883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:08:22.753635774 +0000 UTC m=+1913.146198161" watchObservedRunningTime="2026-07-19 15:08:22.754217174 +0000 UTC m=+1913.146779558"
Jul 19 15:08:22.754363 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.754288    2581 scope.go:117] "RemoveContainer" containerID="eeecb808c76497f8553c97a643217de5379314bbaa9152ae166449e94d29fa54"
Jul 19 15:08:22.754614 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:08:22.754590    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeecb808c76497f8553c97a643217de5379314bbaa9152ae166449e94d29fa54\": container with ID starting with eeecb808c76497f8553c97a643217de5379314bbaa9152ae166449e94d29fa54 not found: ID does not exist" containerID="eeecb808c76497f8553c97a643217de5379314bbaa9152ae166449e94d29fa54"
Jul 19 15:08:22.754729 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.754619    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeecb808c76497f8553c97a643217de5379314bbaa9152ae166449e94d29fa54"} err="failed to get container status \"eeecb808c76497f8553c97a643217de5379314bbaa9152ae166449e94d29fa54\": rpc error: code = NotFound desc = could not find container \"eeecb808c76497f8553c97a643217de5379314bbaa9152ae166449e94d29fa54\": container with ID starting with eeecb808c76497f8553c97a643217de5379314bbaa9152ae166449e94d29fa54 not found: ID does not exist"
Jul 19 15:08:22.754729 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.754642    2581 scope.go:117] "RemoveContainer" containerID="5e4d456a6f607235a47543b5792e43245020e96c0b2b8eed925e350da8d3efea"
Jul 19 15:08:22.755138 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:08:22.754927    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e4d456a6f607235a47543b5792e43245020e96c0b2b8eed925e350da8d3efea\": container with ID starting with 5e4d456a6f607235a47543b5792e43245020e96c0b2b8eed925e350da8d3efea not found: ID does not exist" containerID="5e4d456a6f607235a47543b5792e43245020e96c0b2b8eed925e350da8d3efea"
Jul 19 15:08:22.755138 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.754961    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e4d456a6f607235a47543b5792e43245020e96c0b2b8eed925e350da8d3efea"} err="failed to get container status \"5e4d456a6f607235a47543b5792e43245020e96c0b2b8eed925e350da8d3efea\": rpc error: code = NotFound desc = could not find container \"5e4d456a6f607235a47543b5792e43245020e96c0b2b8eed925e350da8d3efea\": container with ID starting with 5e4d456a6f607235a47543b5792e43245020e96c0b2b8eed925e350da8d3efea not found: ID does not exist"
Jul 19 15:08:22.770111 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.770056    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"]
Jul 19 15:08:22.773770 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.773748    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c1c8ecb5-gw-openshift-default-554d9b898c-pcbn7"]
Jul 19 15:08:22.968032 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:22.968001    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" path="/var/lib/kubelet/pods/dfe641d4-5fd2-49f9-aa87-0a80839330d9/volumes"
Jul 19 15:08:23.741627 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:23.741598    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:29.751018 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:29.750984    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:46.013664 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.013631    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj"]
Jul 19 15:08:46.014126 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.013951    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerName="istio-proxy"
Jul 19 15:08:46.014126 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.013962    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerName="istio-proxy"
Jul 19 15:08:46.014126 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.014026    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerName="istio-proxy"
Jul 19 15:08:46.014126 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.014034    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerName="istio-proxy"
Jul 19 15:08:46.017067 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.017052    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj"
Jul 19 15:08:46.019351 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.019331    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bq7rt\""
Jul 19 15:08:46.024746 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.024643    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj"]
Jul 19 15:08:46.128170 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.128136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd15d5c-8558-4069-ab45-b1d3754e2477-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-79a97677-mt8jj\" (UID: \"8fd15d5c-8558-4069-ab45-b1d3754e2477\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj"
Jul 19 15:08:46.228756 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.228716    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd15d5c-8558-4069-ab45-b1d3754e2477-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-79a97677-mt8jj\" (UID: \"8fd15d5c-8558-4069-ab45-b1d3754e2477\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj"
Jul 19 15:08:46.229551 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.229529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd15d5c-8558-4069-ab45-b1d3754e2477-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-79a97677-mt8jj\" (UID: \"8fd15d5c-8558-4069-ab45-b1d3754e2477\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj"
Jul 19 15:08:46.329334 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.329249    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj"
Jul 19 15:08:46.463701 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.463674    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj"]
Jul 19 15:08:46.465582 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:08:46.465538    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd15d5c_8558_4069_ab45_b1d3754e2477.slice/crio-6c2534c18f8de6e3142e5781f29b53566634f32ce80207d4ab7c4ca41a6119ab WatchSource:0}: Error finding container 6c2534c18f8de6e3142e5781f29b53566634f32ce80207d4ab7c4ca41a6119ab: Status 404 returned error can't find the container with id 6c2534c18f8de6e3142e5781f29b53566634f32ce80207d4ab7c4ca41a6119ab
Jul 19 15:08:46.844814 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.844773    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj" event={"ID":"8fd15d5c-8558-4069-ab45-b1d3754e2477","Type":"ContainerStarted","Data":"14fa33e8c7aecfb0ca1e72b7428323018d317497f9fad53f88955a6ad8097cfa"}
Jul 19 15:08:46.844983 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.844835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj" event={"ID":"8fd15d5c-8558-4069-ab45-b1d3754e2477","Type":"ContainerStarted","Data":"6c2534c18f8de6e3142e5781f29b53566634f32ce80207d4ab7c4ca41a6119ab"}
Jul 19 15:08:46.860389 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:46.860338    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj" podStartSLOduration=1.860323448 podStartE2EDuration="1.860323448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:08:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:08:46.858273685 +0000 UTC m=+1937.250836070" watchObservedRunningTime="2026-07-19 15:08:46.860323448 +0000 UTC m=+1937.252885832"
Jul 19 15:08:47.850452 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:47.850414    2581 generic.go:356] "Generic (PLEG): container finished" podID="8fd15d5c-8558-4069-ab45-b1d3754e2477" containerID="14fa33e8c7aecfb0ca1e72b7428323018d317497f9fad53f88955a6ad8097cfa" exitCode=0
Jul 19 15:08:47.850817 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:47.850497    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj" event={"ID":"8fd15d5c-8558-4069-ab45-b1d3754e2477","Type":"ContainerDied","Data":"14fa33e8c7aecfb0ca1e72b7428323018d317497f9fad53f88955a6ad8097cfa"}
Jul 19 15:08:48.991486 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:48.991457    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj"
Jul 19 15:08:49.153888 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:49.153803    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd15d5c-8558-4069-ab45-b1d3754e2477-maas-api-service-ca\") pod \"8fd15d5c-8558-4069-ab45-b1d3754e2477\" (UID: \"8fd15d5c-8558-4069-ab45-b1d3754e2477\") "
Jul 19 15:08:49.154166 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:49.154143    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fd15d5c-8558-4069-ab45-b1d3754e2477-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8fd15d5c-8558-4069-ab45-b1d3754e2477" (UID: "8fd15d5c-8558-4069-ab45-b1d3754e2477"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:08:49.254707 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:49.254659    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd15d5c-8558-4069-ab45-b1d3754e2477-maas-api-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:49.861373 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:49.861337    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj" event={"ID":"8fd15d5c-8558-4069-ab45-b1d3754e2477","Type":"ContainerDied","Data":"6c2534c18f8de6e3142e5781f29b53566634f32ce80207d4ab7c4ca41a6119ab"}
Jul 19 15:08:49.861373 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:49.861362    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj"
Jul 19 15:08:49.861586 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:49.861385    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c2534c18f8de6e3142e5781f29b53566634f32ce80207d4ab7c4ca41a6119ab"
Jul 19 15:08:56.504605 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.504573    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"]
Jul 19 15:08:56.505008 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.504813    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz" podUID="dddd703e-22d6-44d2-98d2-0b7c1859d440" containerName="maas-api" containerID="cri-o://4f78f72ce0bd80ec5acdf0962c54b6158d43708e0201d62952da8d7f56dd2607" gracePeriod=30
Jul 19 15:08:56.747353 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.747326    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:56.896162 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.896056    2581 generic.go:356] "Generic (PLEG): container finished" podID="dddd703e-22d6-44d2-98d2-0b7c1859d440" containerID="4f78f72ce0bd80ec5acdf0962c54b6158d43708e0201d62952da8d7f56dd2607" exitCode=0
Jul 19 15:08:56.896162 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.896103    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz" event={"ID":"dddd703e-22d6-44d2-98d2-0b7c1859d440","Type":"ContainerDied","Data":"4f78f72ce0bd80ec5acdf0962c54b6158d43708e0201d62952da8d7f56dd2607"}
Jul 19 15:08:56.896162 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.896115    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"
Jul 19 15:08:56.896162 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.896155    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz" event={"ID":"dddd703e-22d6-44d2-98d2-0b7c1859d440","Type":"ContainerDied","Data":"ec55010c47d19991e7ab4b77a44052806689ce25d4bf56a7f8802ce135699b3f"}
Jul 19 15:08:56.896468 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.896205    2581 scope.go:117] "RemoveContainer" containerID="4f78f72ce0bd80ec5acdf0962c54b6158d43708e0201d62952da8d7f56dd2607"
Jul 19 15:08:56.904267 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.904242    2581 scope.go:117] "RemoveContainer" containerID="4f78f72ce0bd80ec5acdf0962c54b6158d43708e0201d62952da8d7f56dd2607"
Jul 19 15:08:56.904575 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:08:56.904548    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f78f72ce0bd80ec5acdf0962c54b6158d43708e0201d62952da8d7f56dd2607\": container with ID starting with 4f78f72ce0bd80ec5acdf0962c54b6158d43708e0201d62952da8d7f56dd2607 not found: ID does not exist" containerID="4f78f72ce0bd80ec5acdf0962c54b6158d43708e0201d62952da8d7f56dd2607"
Jul 19 15:08:56.904628 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.904579    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f78f72ce0bd80ec5acdf0962c54b6158d43708e0201d62952da8d7f56dd2607"} err="failed to get container status \"4f78f72ce0bd80ec5acdf0962c54b6158d43708e0201d62952da8d7f56dd2607\": rpc error: code = NotFound desc = could not find container \"4f78f72ce0bd80ec5acdf0962c54b6158d43708e0201d62952da8d7f56dd2607\": container with ID starting with 4f78f72ce0bd80ec5acdf0962c54b6158d43708e0201d62952da8d7f56dd2607 not found: ID does not exist"
Jul 19 15:08:56.921964 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.921934    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dddd703e-22d6-44d2-98d2-0b7c1859d440-openshift-service-ca\") pod \"dddd703e-22d6-44d2-98d2-0b7c1859d440\" (UID: \"dddd703e-22d6-44d2-98d2-0b7c1859d440\") "
Jul 19 15:08:56.922132 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.922001    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dddd703e-22d6-44d2-98d2-0b7c1859d440-maas-api-tls\") pod \"dddd703e-22d6-44d2-98d2-0b7c1859d440\" (UID: \"dddd703e-22d6-44d2-98d2-0b7c1859d440\") "
Jul 19 15:08:56.922132 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.922064    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5fjw\" (UniqueName: \"kubernetes.io/projected/dddd703e-22d6-44d2-98d2-0b7c1859d440-kube-api-access-x5fjw\") pod \"dddd703e-22d6-44d2-98d2-0b7c1859d440\" (UID: \"dddd703e-22d6-44d2-98d2-0b7c1859d440\") "
Jul 19 15:08:56.922380 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.922359    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dddd703e-22d6-44d2-98d2-0b7c1859d440-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dddd703e-22d6-44d2-98d2-0b7c1859d440" (UID: "dddd703e-22d6-44d2-98d2-0b7c1859d440"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:08:56.924166 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.924137    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dddd703e-22d6-44d2-98d2-0b7c1859d440-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dddd703e-22d6-44d2-98d2-0b7c1859d440" (UID: "dddd703e-22d6-44d2-98d2-0b7c1859d440"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 15:08:56.924295 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:56.924197    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dddd703e-22d6-44d2-98d2-0b7c1859d440-kube-api-access-x5fjw" (OuterVolumeSpecName: "kube-api-access-x5fjw") pod "dddd703e-22d6-44d2-98d2-0b7c1859d440" (UID: "dddd703e-22d6-44d2-98d2-0b7c1859d440"). InnerVolumeSpecName "kube-api-access-x5fjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:08:57.023368 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:57.023328    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dddd703e-22d6-44d2-98d2-0b7c1859d440-openshift-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:57.023368 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:57.023360    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dddd703e-22d6-44d2-98d2-0b7c1859d440-maas-api-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:57.023368 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:57.023369    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5fjw\" (UniqueName: \"kubernetes.io/projected/dddd703e-22d6-44d2-98d2-0b7c1859d440-kube-api-access-x5fjw\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:08:57.211291 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:57.211204    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"]
Jul 19 15:08:57.216554 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:57.216525    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-79a97677-7fdc8bd69b-nt6qz"]
Jul 19 15:08:58.967597 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:08:58.967564    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dddd703e-22d6-44d2-98d2-0b7c1859d440" path="/var/lib/kubelet/pods/dddd703e-22d6-44d2-98d2-0b7c1859d440/volumes"
Jul 19 15:09:01.096898 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:01.096857    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj"]
Jul 19 15:09:01.101784 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:01.101761    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-79a97677-mt8jj"]
Jul 19 15:09:02.967095 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:02.967058    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fd15d5c-8558-4069-ab45-b1d3754e2477" path="/var/lib/kubelet/pods/8fd15d5c-8558-4069-ab45-b1d3754e2477/volumes"
Jul 19 15:09:03.068737 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.068707    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"]
Jul 19 15:09:03.069039 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.069027    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fd15d5c-8558-4069-ab45-b1d3754e2477" containerName="revoke-keys"
Jul 19 15:09:03.069084 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.069041    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fd15d5c-8558-4069-ab45-b1d3754e2477" containerName="revoke-keys"
Jul 19 15:09:03.069084 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.069053    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerName="istio-proxy"
Jul 19 15:09:03.069084 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.069058    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe641d4-5fd2-49f9-aa87-0a80839330d9" containerName="istio-proxy"
Jul 19 15:09:03.069084 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.069076    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dddd703e-22d6-44d2-98d2-0b7c1859d440" containerName="maas-api"
Jul 19 15:09:03.069084 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.069081    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dddd703e-22d6-44d2-98d2-0b7c1859d440" containerName="maas-api"
Jul 19 15:09:03.069263 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.069134    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fd15d5c-8558-4069-ab45-b1d3754e2477" containerName="revoke-keys"
Jul 19 15:09:03.069263 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.069144    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dddd703e-22d6-44d2-98d2-0b7c1859d440" containerName="maas-api"
Jul 19 15:09:03.073323 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.073302    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.075474 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.075456    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f8b5a03b-openshift-default-dockercfg-8z5d4\""
Jul 19 15:09:03.082927 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.082904    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"]
Jul 19 15:09:03.175377 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.175329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-istio-data\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.175566 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.175397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-credential-socket\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.175566 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.175428    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-workload-certs\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.175566 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.175454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b968da8-60ff-43ae-96b5-541108202d68-istio-podinfo\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.175566 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.175552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b968da8-60ff-43ae-96b5-541108202d68-istiod-ca-cert\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.175771 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.175610    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-istio-envoy\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.175771 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.175635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zgsn\" (UniqueName: \"kubernetes.io/projected/9b968da8-60ff-43ae-96b5-541108202d68-kube-api-access-4zgsn\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.175771 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.175660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-workload-socket\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.175771 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.175680    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b968da8-60ff-43ae-96b5-541108202d68-istio-token\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.276967 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.276869    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-istio-data\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.276967 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.276930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-credential-socket\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.277159 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.277048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-workload-certs\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.277159 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.277081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b968da8-60ff-43ae-96b5-541108202d68-istio-podinfo\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.277159 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.277139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b968da8-60ff-43ae-96b5-541108202d68-istiod-ca-cert\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.277337 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.277219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-istio-envoy\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.277337 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.277252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zgsn\" (UniqueName: \"kubernetes.io/projected/9b968da8-60ff-43ae-96b5-541108202d68-kube-api-access-4zgsn\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.277337 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.277289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-workload-socket\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.277337 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.277315    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b968da8-60ff-43ae-96b5-541108202d68-istio-token\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.277532 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.277339    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-credential-socket\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.277532 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.277399    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-istio-data\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.277532 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.277429    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-workload-certs\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.277685 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.277650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-workload-socket\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.277910 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.277881    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b968da8-60ff-43ae-96b5-541108202d68-istiod-ca-cert\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.279555 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.279531    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-istio-envoy\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.279787 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.279771    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b968da8-60ff-43ae-96b5-541108202d68-istio-podinfo\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.285271 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.285246    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zgsn\" (UniqueName: \"kubernetes.io/projected/9b968da8-60ff-43ae-96b5-541108202d68-kube-api-access-4zgsn\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.285367 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.285270    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b968da8-60ff-43ae-96b5-541108202d68-istio-token\") pod \"e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") " pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.384087 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.384050    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:03.519940 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.519914    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"]
Jul 19 15:09:03.522045 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:09:03.522003    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b968da8_60ff_43ae_96b5_541108202d68.slice/crio-d7dc7a2d17cae8d5f90c3641f37b8f3612ae59da8f4ff5957bca20f4d98f5e71 WatchSource:0}: Error finding container d7dc7a2d17cae8d5f90c3641f37b8f3612ae59da8f4ff5957bca20f4d98f5e71: Status 404 returned error can't find the container with id d7dc7a2d17cae8d5f90c3641f37b8f3612ae59da8f4ff5957bca20f4d98f5e71
Jul 19 15:09:03.524369 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.524328    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:09:03.524454 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.524418    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:09:03.524491 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.524460    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:09:03.931041 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.930946    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k" event={"ID":"9b968da8-60ff-43ae-96b5-541108202d68","Type":"ContainerStarted","Data":"6ba77e60913196a42db74bd4476e324e4499c704141912b7a15c889e0b3f45b8"}
Jul 19 15:09:03.931041 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.931008    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k" event={"ID":"9b968da8-60ff-43ae-96b5-541108202d68","Type":"ContainerStarted","Data":"d7dc7a2d17cae8d5f90c3641f37b8f3612ae59da8f4ff5957bca20f4d98f5e71"}
Jul 19 15:09:03.950115 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:03.950065    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k" podStartSLOduration=0.950048884 podStartE2EDuration="950.048884ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:09:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:09:03.947965886 +0000 UTC m=+1954.340528284" watchObservedRunningTime="2026-07-19 15:09:03.950048884 +0000 UTC m=+1954.342611269"
Jul 19 15:09:04.385240 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:04.385198    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:04.389988 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:04.389962    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:04.935499 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:04.935472    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:04.936377 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:04.936360    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:05.352549 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.352516    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"]
Jul 19 15:09:05.356158 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.356131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:05.361511 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.361488    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f8b5a03b-serving-cert\""
Jul 19 15:09:05.361646 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.361522    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 15:09:05.361646 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.361604    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-b4zp5\""
Jul 19 15:09:05.361646 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.361604    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 19 15:09:05.368361 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.368337    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"]
Jul 19 15:09:05.497048 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.497010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29cf19e8-0519-45c7-ad6a-550e0f7b1287-openshift-service-ca\") pod \"maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p\" (UID: \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:05.497476 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.497081    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29cf19e8-0519-45c7-ad6a-550e0f7b1287-maas-api-tls\") pod \"maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p\" (UID: \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:05.497476 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.497164    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j5np\" (UniqueName: \"kubernetes.io/projected/29cf19e8-0519-45c7-ad6a-550e0f7b1287-kube-api-access-9j5np\") pod \"maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p\" (UID: \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:05.598221 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.598165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29cf19e8-0519-45c7-ad6a-550e0f7b1287-maas-api-tls\") pod \"maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p\" (UID: \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:05.598394 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.598234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j5np\" (UniqueName: \"kubernetes.io/projected/29cf19e8-0519-45c7-ad6a-550e0f7b1287-kube-api-access-9j5np\") pod \"maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p\" (UID: \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:05.598394 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.598312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29cf19e8-0519-45c7-ad6a-550e0f7b1287-openshift-service-ca\") pod \"maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p\" (UID: \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:05.598995 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.598971    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29cf19e8-0519-45c7-ad6a-550e0f7b1287-openshift-service-ca\") pod \"maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p\" (UID: \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:05.600585 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.600554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29cf19e8-0519-45c7-ad6a-550e0f7b1287-maas-api-tls\") pod \"maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p\" (UID: \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:05.612163 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.612110    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j5np\" (UniqueName: \"kubernetes.io/projected/29cf19e8-0519-45c7-ad6a-550e0f7b1287-kube-api-access-9j5np\") pod \"maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p\" (UID: \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:05.668639 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.668616    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:05.820961 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.820927    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"]
Jul 19 15:09:05.824889 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:09:05.824857    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29cf19e8_0519_45c7_ad6a_550e0f7b1287.slice/crio-20b846d6249916f7a91c5cc3e15563d7af06ac8cbb5aaf13603fa0a7e6991dbb WatchSource:0}: Error finding container 20b846d6249916f7a91c5cc3e15563d7af06ac8cbb5aaf13603fa0a7e6991dbb: Status 404 returned error can't find the container with id 20b846d6249916f7a91c5cc3e15563d7af06ac8cbb5aaf13603fa0a7e6991dbb
Jul 19 15:09:05.941374 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:05.941300    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p" event={"ID":"29cf19e8-0519-45c7-ad6a-550e0f7b1287","Type":"ContainerStarted","Data":"20b846d6249916f7a91c5cc3e15563d7af06ac8cbb5aaf13603fa0a7e6991dbb"}
Jul 19 15:09:06.947167 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:06.947133    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p" event={"ID":"29cf19e8-0519-45c7-ad6a-550e0f7b1287","Type":"ContainerStarted","Data":"a321050cbe4f24d5b48fd9bd3189daea88a11e616748b193f371148d0b1ba0c3"}
Jul 19 15:09:06.947654 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:06.947392    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:06.964523 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:06.964478    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p" podStartSLOduration=1.5796189040000002 podStartE2EDuration="1.96446479s" totalImagesPullingTime="384.845886ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:09:06.963390306 +0000 UTC m=+1957.355952685" watchObservedRunningTime="2026-07-19 15:09:06.96446479 +0000 UTC m=+1957.357027174"
Jul 19 15:09:12.970283 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:12.970251    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:19.003673 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:19.003638    2581 generic.go:356] "Generic (PLEG): container finished" podID="9b968da8-60ff-43ae-96b5-541108202d68" containerID="6ba77e60913196a42db74bd4476e324e4499c704141912b7a15c889e0b3f45b8" exitCode=0
Jul 19 15:09:19.004082 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:19.003677    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k" event={"ID":"9b968da8-60ff-43ae-96b5-541108202d68","Type":"ContainerDied","Data":"6ba77e60913196a42db74bd4476e324e4499c704141912b7a15c889e0b3f45b8"}
Jul 19 15:09:19.004082 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:19.004067    2581 scope.go:117] "RemoveContainer" containerID="6ba77e60913196a42db74bd4476e324e4499c704141912b7a15c889e0b3f45b8"
Jul 19 15:09:19.005172 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:19.005135    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:09:19.005282 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:19.005260    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:09:19.005321 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:19.005310    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:09:19.936060 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:19.936015    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:20.010923 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:20.010885    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k" event={"ID":"9b968da8-60ff-43ae-96b5-541108202d68","Type":"ContainerStarted","Data":"a979741ed7cdd8a0e1f97f06891ceadd09101fdcd3cc52c07912119ffa042d0b"}
Jul 19 15:09:20.384288 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:20.384250    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:20.385635 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:20.385607    2581 patch_prober.go:28] interesting pod/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 19 15:09:20.385780 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:20.385668    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k" podUID="9b968da8-60ff-43ae-96b5-541108202d68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 19 15:09:21.385058 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:21.385021    2581 patch_prober.go:28] interesting pod/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 19 15:09:21.385455 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:21.385079    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k" podUID="9b968da8-60ff-43ae-96b5-541108202d68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 19 15:09:22.385266 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:22.385137    2581 patch_prober.go:28] interesting pod/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 19 15:09:22.385629 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:22.385267    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k" podUID="9b968da8-60ff-43ae-96b5-541108202d68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 19 15:09:23.385020 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:23.384981    2581 patch_prober.go:28] interesting pod/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 19 15:09:23.385236 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:23.385041    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k" podUID="9b968da8-60ff-43ae-96b5-541108202d68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 19 15:09:24.388748 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:24.388716    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:24.389216 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:24.388985    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:24.389776 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:24.389761    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:41.043038 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:41.042999    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"]
Jul 19 15:09:41.043554 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:41.043289    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p" podUID="29cf19e8-0519-45c7-ad6a-550e0f7b1287" containerName="maas-api" containerID="cri-o://a321050cbe4f24d5b48fd9bd3189daea88a11e616748b193f371148d0b1ba0c3" gracePeriod=30
Jul 19 15:09:41.306841 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:41.306774    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:41.415259 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:41.415228    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j5np\" (UniqueName: \"kubernetes.io/projected/29cf19e8-0519-45c7-ad6a-550e0f7b1287-kube-api-access-9j5np\") pod \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\" (UID: \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\") "
Jul 19 15:09:41.415432 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:41.415287    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29cf19e8-0519-45c7-ad6a-550e0f7b1287-maas-api-tls\") pod \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\" (UID: \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\") "
Jul 19 15:09:41.415432 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:41.415323    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29cf19e8-0519-45c7-ad6a-550e0f7b1287-openshift-service-ca\") pod \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\" (UID: \"29cf19e8-0519-45c7-ad6a-550e0f7b1287\") "
Jul 19 15:09:41.415763 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:41.415735    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29cf19e8-0519-45c7-ad6a-550e0f7b1287-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "29cf19e8-0519-45c7-ad6a-550e0f7b1287" (UID: "29cf19e8-0519-45c7-ad6a-550e0f7b1287"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:09:41.417433 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:41.417400    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29cf19e8-0519-45c7-ad6a-550e0f7b1287-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "29cf19e8-0519-45c7-ad6a-550e0f7b1287" (UID: "29cf19e8-0519-45c7-ad6a-550e0f7b1287"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 15:09:41.417527 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:41.417435    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29cf19e8-0519-45c7-ad6a-550e0f7b1287-kube-api-access-9j5np" (OuterVolumeSpecName: "kube-api-access-9j5np") pod "29cf19e8-0519-45c7-ad6a-550e0f7b1287" (UID: "29cf19e8-0519-45c7-ad6a-550e0f7b1287"). InnerVolumeSpecName "kube-api-access-9j5np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:09:41.515937 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:41.515900    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29cf19e8-0519-45c7-ad6a-550e0f7b1287-openshift-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:09:41.515937 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:41.515933    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j5np\" (UniqueName: \"kubernetes.io/projected/29cf19e8-0519-45c7-ad6a-550e0f7b1287-kube-api-access-9j5np\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:09:41.515937 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:41.515945    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29cf19e8-0519-45c7-ad6a-550e0f7b1287-maas-api-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:09:42.126379 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:42.126340    2581 generic.go:356] "Generic (PLEG): container finished" podID="29cf19e8-0519-45c7-ad6a-550e0f7b1287" containerID="a321050cbe4f24d5b48fd9bd3189daea88a11e616748b193f371148d0b1ba0c3" exitCode=0
Jul 19 15:09:42.126963 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:42.126396    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"
Jul 19 15:09:42.126963 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:42.126414    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p" event={"ID":"29cf19e8-0519-45c7-ad6a-550e0f7b1287","Type":"ContainerDied","Data":"a321050cbe4f24d5b48fd9bd3189daea88a11e616748b193f371148d0b1ba0c3"}
Jul 19 15:09:42.126963 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:42.126458    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p" event={"ID":"29cf19e8-0519-45c7-ad6a-550e0f7b1287","Type":"ContainerDied","Data":"20b846d6249916f7a91c5cc3e15563d7af06ac8cbb5aaf13603fa0a7e6991dbb"}
Jul 19 15:09:42.126963 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:42.126479    2581 scope.go:117] "RemoveContainer" containerID="a321050cbe4f24d5b48fd9bd3189daea88a11e616748b193f371148d0b1ba0c3"
Jul 19 15:09:42.135945 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:42.135921    2581 scope.go:117] "RemoveContainer" containerID="a321050cbe4f24d5b48fd9bd3189daea88a11e616748b193f371148d0b1ba0c3"
Jul 19 15:09:42.136257 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:09:42.136194    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a321050cbe4f24d5b48fd9bd3189daea88a11e616748b193f371148d0b1ba0c3\": container with ID starting with a321050cbe4f24d5b48fd9bd3189daea88a11e616748b193f371148d0b1ba0c3 not found: ID does not exist" containerID="a321050cbe4f24d5b48fd9bd3189daea88a11e616748b193f371148d0b1ba0c3"
Jul 19 15:09:42.136257 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:42.136231    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a321050cbe4f24d5b48fd9bd3189daea88a11e616748b193f371148d0b1ba0c3"} err="failed to get container status \"a321050cbe4f24d5b48fd9bd3189daea88a11e616748b193f371148d0b1ba0c3\": rpc error: code = NotFound desc = could not find container \"a321050cbe4f24d5b48fd9bd3189daea88a11e616748b193f371148d0b1ba0c3\": container with ID starting with a321050cbe4f24d5b48fd9bd3189daea88a11e616748b193f371148d0b1ba0c3 not found: ID does not exist"
Jul 19 15:09:42.147763 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:42.147733    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"]
Jul 19 15:09:42.151476 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:42.151450    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f8b5a03b-65f564b8fc-l872p"]
Jul 19 15:09:42.966971 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:42.966933    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29cf19e8-0519-45c7-ad6a-550e0f7b1287" path="/var/lib/kubelet/pods/29cf19e8-0519-45c7-ad6a-550e0f7b1287/volumes"
Jul 19 15:09:45.397352 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:45.397317    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"]
Jul 19 15:09:45.397802 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:45.397588    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k" podUID="9b968da8-60ff-43ae-96b5-541108202d68" containerName="istio-proxy" containerID="cri-o://a979741ed7cdd8a0e1f97f06891ceadd09101fdcd3cc52c07912119ffa042d0b" gracePeriod=30
Jul 19 15:09:50.655415 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.655393    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:50.801878 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.801837    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zgsn\" (UniqueName: \"kubernetes.io/projected/9b968da8-60ff-43ae-96b5-541108202d68-kube-api-access-4zgsn\") pod \"9b968da8-60ff-43ae-96b5-541108202d68\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") "
Jul 19 15:09:50.801878 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.801877    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-workload-socket\") pod \"9b968da8-60ff-43ae-96b5-541108202d68\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") "
Jul 19 15:09:50.802139 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.801903    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-credential-socket\") pod \"9b968da8-60ff-43ae-96b5-541108202d68\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") "
Jul 19 15:09:50.802139 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.801952    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-istio-envoy\") pod \"9b968da8-60ff-43ae-96b5-541108202d68\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") "
Jul 19 15:09:50.802139 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.801977    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b968da8-60ff-43ae-96b5-541108202d68-istio-token\") pod \"9b968da8-60ff-43ae-96b5-541108202d68\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") "
Jul 19 15:09:50.802139 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.802010    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-istio-data\") pod \"9b968da8-60ff-43ae-96b5-541108202d68\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") "
Jul 19 15:09:50.802139 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.802042    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b968da8-60ff-43ae-96b5-541108202d68-istio-podinfo\") pod \"9b968da8-60ff-43ae-96b5-541108202d68\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") "
Jul 19 15:09:50.802139 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.802065    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-workload-certs\") pod \"9b968da8-60ff-43ae-96b5-541108202d68\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") "
Jul 19 15:09:50.802139 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.802093    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b968da8-60ff-43ae-96b5-541108202d68-istiod-ca-cert\") pod \"9b968da8-60ff-43ae-96b5-541108202d68\" (UID: \"9b968da8-60ff-43ae-96b5-541108202d68\") "
Jul 19 15:09:50.802526 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.802211    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b968da8-60ff-43ae-96b5-541108202d68" (UID: "9b968da8-60ff-43ae-96b5-541108202d68"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:09:50.802526 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.802269    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b968da8-60ff-43ae-96b5-541108202d68" (UID: "9b968da8-60ff-43ae-96b5-541108202d68"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:09:50.802526 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.802454    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b968da8-60ff-43ae-96b5-541108202d68" (UID: "9b968da8-60ff-43ae-96b5-541108202d68"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:09:50.802526 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.802475    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:09:50.802526 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.802496    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:09:50.802707 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.802543    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b968da8-60ff-43ae-96b5-541108202d68-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b968da8-60ff-43ae-96b5-541108202d68" (UID: "9b968da8-60ff-43ae-96b5-541108202d68"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:09:50.803356 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.803332    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b968da8-60ff-43ae-96b5-541108202d68" (UID: "9b968da8-60ff-43ae-96b5-541108202d68"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:09:50.804205 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.804160    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b968da8-60ff-43ae-96b5-541108202d68-kube-api-access-4zgsn" (OuterVolumeSpecName: "kube-api-access-4zgsn") pod "9b968da8-60ff-43ae-96b5-541108202d68" (UID: "9b968da8-60ff-43ae-96b5-541108202d68"). InnerVolumeSpecName "kube-api-access-4zgsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:09:50.804370 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.804350    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b968da8-60ff-43ae-96b5-541108202d68-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b968da8-60ff-43ae-96b5-541108202d68" (UID: "9b968da8-60ff-43ae-96b5-541108202d68"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 15:09:50.804622 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.804597    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b968da8-60ff-43ae-96b5-541108202d68-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b968da8-60ff-43ae-96b5-541108202d68" (UID: "9b968da8-60ff-43ae-96b5-541108202d68"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:09:50.804727 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.804593    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b968da8-60ff-43ae-96b5-541108202d68" (UID: "9b968da8-60ff-43ae-96b5-541108202d68"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:09:50.903599 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.903561    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:09:50.903599 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.903591    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b968da8-60ff-43ae-96b5-541108202d68-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:09:50.903599 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.903600    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:09:50.903599 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.903608    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b968da8-60ff-43ae-96b5-541108202d68-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:09:50.904124 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.903617    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b968da8-60ff-43ae-96b5-541108202d68-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:09:50.904124 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.903624    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b968da8-60ff-43ae-96b5-541108202d68-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:09:50.904124 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:50.903633    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zgsn\" (UniqueName: \"kubernetes.io/projected/9b968da8-60ff-43ae-96b5-541108202d68-kube-api-access-4zgsn\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:09:51.174571 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:51.174479    2581 generic.go:356] "Generic (PLEG): container finished" podID="9b968da8-60ff-43ae-96b5-541108202d68" containerID="a979741ed7cdd8a0e1f97f06891ceadd09101fdcd3cc52c07912119ffa042d0b" exitCode=0
Jul 19 15:09:51.174571 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:51.174549    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"
Jul 19 15:09:51.174744 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:51.174570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k" event={"ID":"9b968da8-60ff-43ae-96b5-541108202d68","Type":"ContainerDied","Data":"a979741ed7cdd8a0e1f97f06891ceadd09101fdcd3cc52c07912119ffa042d0b"}
Jul 19 15:09:51.174744 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:51.174632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k" event={"ID":"9b968da8-60ff-43ae-96b5-541108202d68","Type":"ContainerDied","Data":"d7dc7a2d17cae8d5f90c3641f37b8f3612ae59da8f4ff5957bca20f4d98f5e71"}
Jul 19 15:09:51.174744 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:51.174659    2581 scope.go:117] "RemoveContainer" containerID="a979741ed7cdd8a0e1f97f06891ceadd09101fdcd3cc52c07912119ffa042d0b"
Jul 19 15:09:51.183340 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:51.183320    2581 scope.go:117] "RemoveContainer" containerID="6ba77e60913196a42db74bd4476e324e4499c704141912b7a15c889e0b3f45b8"
Jul 19 15:09:51.190616 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:51.190590    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"]
Jul 19 15:09:51.191542 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:51.191527    2581 scope.go:117] "RemoveContainer" containerID="a979741ed7cdd8a0e1f97f06891ceadd09101fdcd3cc52c07912119ffa042d0b"
Jul 19 15:09:51.191829 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:09:51.191808    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a979741ed7cdd8a0e1f97f06891ceadd09101fdcd3cc52c07912119ffa042d0b\": container with ID starting with a979741ed7cdd8a0e1f97f06891ceadd09101fdcd3cc52c07912119ffa042d0b not found: ID does not exist" containerID="a979741ed7cdd8a0e1f97f06891ceadd09101fdcd3cc52c07912119ffa042d0b"
Jul 19 15:09:51.191914 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:51.191840    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a979741ed7cdd8a0e1f97f06891ceadd09101fdcd3cc52c07912119ffa042d0b"} err="failed to get container status \"a979741ed7cdd8a0e1f97f06891ceadd09101fdcd3cc52c07912119ffa042d0b\": rpc error: code = NotFound desc = could not find container \"a979741ed7cdd8a0e1f97f06891ceadd09101fdcd3cc52c07912119ffa042d0b\": container with ID starting with a979741ed7cdd8a0e1f97f06891ceadd09101fdcd3cc52c07912119ffa042d0b not found: ID does not exist"
Jul 19 15:09:51.191914 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:51.191865    2581 scope.go:117] "RemoveContainer" containerID="6ba77e60913196a42db74bd4476e324e4499c704141912b7a15c889e0b3f45b8"
Jul 19 15:09:51.192169 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:09:51.192153    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ba77e60913196a42db74bd4476e324e4499c704141912b7a15c889e0b3f45b8\": container with ID starting with 6ba77e60913196a42db74bd4476e324e4499c704141912b7a15c889e0b3f45b8 not found: ID does not exist" containerID="6ba77e60913196a42db74bd4476e324e4499c704141912b7a15c889e0b3f45b8"
Jul 19 15:09:51.192230 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:51.192200    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba77e60913196a42db74bd4476e324e4499c704141912b7a15c889e0b3f45b8"} err="failed to get container status \"6ba77e60913196a42db74bd4476e324e4499c704141912b7a15c889e0b3f45b8\": rpc error: code = NotFound desc = could not find container \"6ba77e60913196a42db74bd4476e324e4499c704141912b7a15c889e0b3f45b8\": container with ID starting with 6ba77e60913196a42db74bd4476e324e4499c704141912b7a15c889e0b3f45b8 not found: ID does not exist"
Jul 19 15:09:51.196165 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:51.196139    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f8b5a03b-openshift-default-776bf458c9-lpn6k"]
Jul 19 15:09:52.968200 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:09:52.968146    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b968da8-60ff-43ae-96b5-541108202d68" path="/var/lib/kubelet/pods/9b968da8-60ff-43ae-96b5-541108202d68/volumes"
Jul 19 15:11:24.886221 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:24.886128    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"]
Jul 19 15:11:24.886681 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:24.886485    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b968da8-60ff-43ae-96b5-541108202d68" containerName="istio-proxy"
Jul 19 15:11:24.886681 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:24.886497    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b968da8-60ff-43ae-96b5-541108202d68" containerName="istio-proxy"
Jul 19 15:11:24.886681 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:24.886509    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29cf19e8-0519-45c7-ad6a-550e0f7b1287" containerName="maas-api"
Jul 19 15:11:24.886681 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:24.886517    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="29cf19e8-0519-45c7-ad6a-550e0f7b1287" containerName="maas-api"
Jul 19 15:11:24.886681 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:24.886592    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="29cf19e8-0519-45c7-ad6a-550e0f7b1287" containerName="maas-api"
Jul 19 15:11:24.886681 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:24.886604    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b968da8-60ff-43ae-96b5-541108202d68" containerName="istio-proxy"
Jul 19 15:11:24.889463 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:24.889445    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:24.896242 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:24.895852    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 19 15:11:24.897972 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:24.897950    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-4281d3b3-serving-cert\""
Jul 19 15:11:24.898074 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:24.897953    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 15:11:24.899870 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:24.899856    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-b4zp5\""
Jul 19 15:11:24.933838 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:24.933806    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"]
Jul 19 15:11:25.016266 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:25.016232    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d12e3d0-b961-4789-9da4-1cedb1ac6966-maas-api-tls\") pod \"maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh\" (UID: \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:25.016466 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:25.016299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d12e3d0-b961-4789-9da4-1cedb1ac6966-openshift-service-ca\") pod \"maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh\" (UID: \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:25.016466 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:25.016334    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzvxj\" (UniqueName: \"kubernetes.io/projected/2d12e3d0-b961-4789-9da4-1cedb1ac6966-kube-api-access-vzvxj\") pod \"maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh\" (UID: \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:25.117118 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:25.117072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d12e3d0-b961-4789-9da4-1cedb1ac6966-maas-api-tls\") pod \"maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh\" (UID: \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:25.117371 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:25.117140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d12e3d0-b961-4789-9da4-1cedb1ac6966-openshift-service-ca\") pod \"maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh\" (UID: \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:25.117371 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:25.117165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvxj\" (UniqueName: \"kubernetes.io/projected/2d12e3d0-b961-4789-9da4-1cedb1ac6966-kube-api-access-vzvxj\") pod \"maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh\" (UID: \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:25.117371 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:11:25.117288    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-serving-cert: secret "maas-api-e2e-mt-4281d3b3-serving-cert" not found
Jul 19 15:11:25.117550 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:11:25.117385    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d12e3d0-b961-4789-9da4-1cedb1ac6966-maas-api-tls podName:2d12e3d0-b961-4789-9da4-1cedb1ac6966 nodeName:}" failed. No retries permitted until 2026-07-19 15:11:25.617360835 +0000 UTC m=+2096.009923199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2d12e3d0-b961-4789-9da4-1cedb1ac6966-maas-api-tls") pod "maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh" (UID: "2d12e3d0-b961-4789-9da4-1cedb1ac6966") : secret "maas-api-e2e-mt-4281d3b3-serving-cert" not found
Jul 19 15:11:25.117804 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:25.117784    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d12e3d0-b961-4789-9da4-1cedb1ac6966-openshift-service-ca\") pod \"maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh\" (UID: \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:25.129293 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:25.129267    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzvxj\" (UniqueName: \"kubernetes.io/projected/2d12e3d0-b961-4789-9da4-1cedb1ac6966-kube-api-access-vzvxj\") pod \"maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh\" (UID: \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:25.622652 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:25.622615    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d12e3d0-b961-4789-9da4-1cedb1ac6966-maas-api-tls\") pod \"maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh\" (UID: \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:25.625138 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:25.625115    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d12e3d0-b961-4789-9da4-1cedb1ac6966-maas-api-tls\") pod \"maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh\" (UID: \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:25.799703 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:25.799664    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:25.940770 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:25.940736    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"]
Jul 19 15:11:25.942939 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:11:25.942914    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d12e3d0_b961_4789_9da4_1cedb1ac6966.slice/crio-e681989cdd839afa480eb90678e6a201912f3eb6ff584b6257a6ac77f63f0ac9 WatchSource:0}: Error finding container e681989cdd839afa480eb90678e6a201912f3eb6ff584b6257a6ac77f63f0ac9: Status 404 returned error can't find the container with id e681989cdd839afa480eb90678e6a201912f3eb6ff584b6257a6ac77f63f0ac9
Jul 19 15:11:26.605357 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:26.605316    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh" event={"ID":"2d12e3d0-b961-4789-9da4-1cedb1ac6966","Type":"ContainerStarted","Data":"756df308387a889c06cb2fe74a4079302a14a88c831ccacc5a0df18ba5b0a5c5"}
Jul 19 15:11:26.605577 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:26.605381    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh" event={"ID":"2d12e3d0-b961-4789-9da4-1cedb1ac6966","Type":"ContainerStarted","Data":"e681989cdd839afa480eb90678e6a201912f3eb6ff584b6257a6ac77f63f0ac9"}
Jul 19 15:11:26.605577 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:26.605408    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:26.621906 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:26.621848    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh" podStartSLOduration=2.18387726 podStartE2EDuration="2.621829556s" totalImagesPullingTime="437.952296ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:11:26.620672152 +0000 UTC m=+2097.013234540" watchObservedRunningTime="2026-07-19 15:11:26.621829556 +0000 UTC m=+2097.014391940"
Jul 19 15:11:32.614970 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:32.614943    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:36.255971 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:36.255928    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m"]
Jul 19 15:11:36.256437 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:36.256419    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b968da8-60ff-43ae-96b5-541108202d68" containerName="istio-proxy"
Jul 19 15:11:36.256481 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:36.256441    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b968da8-60ff-43ae-96b5-541108202d68" containerName="istio-proxy"
Jul 19 15:11:36.256556 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:36.256545    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b968da8-60ff-43ae-96b5-541108202d68" containerName="istio-proxy"
Jul 19 15:11:36.259808 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:36.259789    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m"
Jul 19 15:11:36.262325 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:36.262302    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bq7rt\""
Jul 19 15:11:36.266078 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:36.266052    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m"]
Jul 19 15:11:36.417397 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:36.417358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45281ae9-bd3e-4161-b0f1-ef7f6e361592-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m\" (UID: \"45281ae9-bd3e-4161-b0f1-ef7f6e361592\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m"
Jul 19 15:11:36.518073 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:36.517957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45281ae9-bd3e-4161-b0f1-ef7f6e361592-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m\" (UID: \"45281ae9-bd3e-4161-b0f1-ef7f6e361592\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m"
Jul 19 15:11:36.518633 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:36.518605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45281ae9-bd3e-4161-b0f1-ef7f6e361592-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m\" (UID: \"45281ae9-bd3e-4161-b0f1-ef7f6e361592\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m"
Jul 19 15:11:36.572999 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:36.572969    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m"
Jul 19 15:11:36.705514 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:36.705473    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m"]
Jul 19 15:11:36.708599 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:11:36.708571    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45281ae9_bd3e_4161_b0f1_ef7f6e361592.slice/crio-743f495175c22ac6ca0dcb6d55597a56b4126a23bfe698e077b3d0bf4be66c83 WatchSource:0}: Error finding container 743f495175c22ac6ca0dcb6d55597a56b4126a23bfe698e077b3d0bf4be66c83: Status 404 returned error can't find the container with id 743f495175c22ac6ca0dcb6d55597a56b4126a23bfe698e077b3d0bf4be66c83
Jul 19 15:11:37.657487 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:37.657456    2581 generic.go:356] "Generic (PLEG): container finished" podID="45281ae9-bd3e-4161-b0f1-ef7f6e361592" containerID="30152eb6d712e1b3661db5d0b3fab6dd0932079c2ca1a7f44647ea26bade7f09" exitCode=0
Jul 19 15:11:37.657859 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:37.657529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m" event={"ID":"45281ae9-bd3e-4161-b0f1-ef7f6e361592","Type":"ContainerDied","Data":"30152eb6d712e1b3661db5d0b3fab6dd0932079c2ca1a7f44647ea26bade7f09"}
Jul 19 15:11:37.657859 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:37.657565    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m" event={"ID":"45281ae9-bd3e-4161-b0f1-ef7f6e361592","Type":"ContainerStarted","Data":"743f495175c22ac6ca0dcb6d55597a56b4126a23bfe698e077b3d0bf4be66c83"}
Jul 19 15:11:38.790805 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:38.790780    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m"
Jul 19 15:11:38.939171 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:38.939067    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45281ae9-bd3e-4161-b0f1-ef7f6e361592-maas-api-service-ca\") pod \"45281ae9-bd3e-4161-b0f1-ef7f6e361592\" (UID: \"45281ae9-bd3e-4161-b0f1-ef7f6e361592\") "
Jul 19 15:11:38.939464 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:38.939438    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45281ae9-bd3e-4161-b0f1-ef7f6e361592-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "45281ae9-bd3e-4161-b0f1-ef7f6e361592" (UID: "45281ae9-bd3e-4161-b0f1-ef7f6e361592"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:11:39.040325 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:39.040288    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45281ae9-bd3e-4161-b0f1-ef7f6e361592-maas-api-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:11:39.667741 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:39.667713    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m"
Jul 19 15:11:39.673597 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:39.667756    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m" event={"ID":"45281ae9-bd3e-4161-b0f1-ef7f6e361592","Type":"ContainerDied","Data":"743f495175c22ac6ca0dcb6d55597a56b4126a23bfe698e077b3d0bf4be66c83"}
Jul 19 15:11:39.673597 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:39.668959    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="743f495175c22ac6ca0dcb6d55597a56b4126a23bfe698e077b3d0bf4be66c83"
Jul 19 15:11:46.615426 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:46.615387    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"]
Jul 19 15:11:46.615823 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:46.615669    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh" podUID="2d12e3d0-b961-4789-9da4-1cedb1ac6966" containerName="maas-api" containerID="cri-o://756df308387a889c06cb2fe74a4079302a14a88c831ccacc5a0df18ba5b0a5c5" gracePeriod=30
Jul 19 15:11:46.855557 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:46.855535    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:46.908889 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:46.908796    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d12e3d0-b961-4789-9da4-1cedb1ac6966-openshift-service-ca\") pod \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\" (UID: \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\") "
Jul 19 15:11:46.908889 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:46.908853    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzvxj\" (UniqueName: \"kubernetes.io/projected/2d12e3d0-b961-4789-9da4-1cedb1ac6966-kube-api-access-vzvxj\") pod \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\" (UID: \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\") "
Jul 19 15:11:46.909110 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:46.908932    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d12e3d0-b961-4789-9da4-1cedb1ac6966-maas-api-tls\") pod \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\" (UID: \"2d12e3d0-b961-4789-9da4-1cedb1ac6966\") "
Jul 19 15:11:46.909165 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:46.909140    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d12e3d0-b961-4789-9da4-1cedb1ac6966-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2d12e3d0-b961-4789-9da4-1cedb1ac6966" (UID: "2d12e3d0-b961-4789-9da4-1cedb1ac6966"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:11:46.911025 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:46.910997    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d12e3d0-b961-4789-9da4-1cedb1ac6966-kube-api-access-vzvxj" (OuterVolumeSpecName: "kube-api-access-vzvxj") pod "2d12e3d0-b961-4789-9da4-1cedb1ac6966" (UID: "2d12e3d0-b961-4789-9da4-1cedb1ac6966"). InnerVolumeSpecName "kube-api-access-vzvxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:11:46.911129 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:46.911023    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d12e3d0-b961-4789-9da4-1cedb1ac6966-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2d12e3d0-b961-4789-9da4-1cedb1ac6966" (UID: "2d12e3d0-b961-4789-9da4-1cedb1ac6966"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 15:11:47.010248 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:47.010218    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d12e3d0-b961-4789-9da4-1cedb1ac6966-maas-api-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:11:47.010248 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:47.010246    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d12e3d0-b961-4789-9da4-1cedb1ac6966-openshift-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:11:47.010441 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:47.010256    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzvxj\" (UniqueName: \"kubernetes.io/projected/2d12e3d0-b961-4789-9da4-1cedb1ac6966-kube-api-access-vzvxj\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:11:47.704169 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:47.704129    2581 generic.go:356] "Generic (PLEG): container finished" podID="2d12e3d0-b961-4789-9da4-1cedb1ac6966" containerID="756df308387a889c06cb2fe74a4079302a14a88c831ccacc5a0df18ba5b0a5c5" exitCode=0
Jul 19 15:11:47.704580 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:47.704170    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"
Jul 19 15:11:47.704580 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:47.704217    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh" event={"ID":"2d12e3d0-b961-4789-9da4-1cedb1ac6966","Type":"ContainerDied","Data":"756df308387a889c06cb2fe74a4079302a14a88c831ccacc5a0df18ba5b0a5c5"}
Jul 19 15:11:47.704580 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:47.704274    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh" event={"ID":"2d12e3d0-b961-4789-9da4-1cedb1ac6966","Type":"ContainerDied","Data":"e681989cdd839afa480eb90678e6a201912f3eb6ff584b6257a6ac77f63f0ac9"}
Jul 19 15:11:47.704580 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:47.704298    2581 scope.go:117] "RemoveContainer" containerID="756df308387a889c06cb2fe74a4079302a14a88c831ccacc5a0df18ba5b0a5c5"
Jul 19 15:11:47.713056 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:47.713033    2581 scope.go:117] "RemoveContainer" containerID="756df308387a889c06cb2fe74a4079302a14a88c831ccacc5a0df18ba5b0a5c5"
Jul 19 15:11:47.713354 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:11:47.713329    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"756df308387a889c06cb2fe74a4079302a14a88c831ccacc5a0df18ba5b0a5c5\": container with ID starting with 756df308387a889c06cb2fe74a4079302a14a88c831ccacc5a0df18ba5b0a5c5 not found: ID does not exist" containerID="756df308387a889c06cb2fe74a4079302a14a88c831ccacc5a0df18ba5b0a5c5"
Jul 19 15:11:47.713427 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:47.713362    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"756df308387a889c06cb2fe74a4079302a14a88c831ccacc5a0df18ba5b0a5c5"} err="failed to get container status \"756df308387a889c06cb2fe74a4079302a14a88c831ccacc5a0df18ba5b0a5c5\": rpc error: code = NotFound desc = could not find container \"756df308387a889c06cb2fe74a4079302a14a88c831ccacc5a0df18ba5b0a5c5\": container with ID starting with 756df308387a889c06cb2fe74a4079302a14a88c831ccacc5a0df18ba5b0a5c5 not found: ID does not exist"
Jul 19 15:11:47.721647 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:47.721621    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"]
Jul 19 15:11:47.724470 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:47.724449    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4281d3b3-7565f5cd79-nh4fh"]
Jul 19 15:11:48.967627 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:48.967587    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d12e3d0-b961-4789-9da4-1cedb1ac6966" path="/var/lib/kubelet/pods/2d12e3d0-b961-4789-9da4-1cedb1ac6966/volumes"
Jul 19 15:11:51.338002 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:51.337969    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m"]
Jul 19 15:11:51.340151 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:51.340130    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4281d3b3-pp22m"]
Jul 19 15:11:52.967738 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:11:52.967704    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45281ae9-bd3e-4161-b0f1-ef7f6e361592" path="/var/lib/kubelet/pods/45281ae9-bd3e-4161-b0f1-ef7f6e361592/volumes"
Jul 19 15:12:20.201633 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.201590    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"]
Jul 19 15:12:20.202265 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.202052    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d12e3d0-b961-4789-9da4-1cedb1ac6966" containerName="maas-api"
Jul 19 15:12:20.202265 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.202069    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d12e3d0-b961-4789-9da4-1cedb1ac6966" containerName="maas-api"
Jul 19 15:12:20.202265 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.202083    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45281ae9-bd3e-4161-b0f1-ef7f6e361592" containerName="revoke-keys"
Jul 19 15:12:20.202265 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.202089    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45281ae9-bd3e-4161-b0f1-ef7f6e361592" containerName="revoke-keys"
Jul 19 15:12:20.202265 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.202140    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d12e3d0-b961-4789-9da4-1cedb1ac6966" containerName="maas-api"
Jul 19 15:12:20.202265 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.202151    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="45281ae9-bd3e-4161-b0f1-ef7f6e361592" containerName="revoke-keys"
Jul 19 15:12:20.204907 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.204888    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:12:20.207560 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.207537    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-b4zp5\""
Jul 19 15:12:20.207655 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.207537    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-c515b9b9-serving-cert\""
Jul 19 15:12:20.207718 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.207694    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 19 15:12:20.208486 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.208470    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 15:12:20.215857 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.215800    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"]
Jul 19 15:12:20.306413 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.306383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhbxt\" (UniqueName: \"kubernetes.io/projected/828419ec-ce14-4964-9bc3-5bdf5c8dc202-kube-api-access-hhbxt\") pod \"maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx\" (UID: \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:12:20.306413 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.306417    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/828419ec-ce14-4964-9bc3-5bdf5c8dc202-openshift-service-ca\") pod \"maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx\" (UID: \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:12:20.306608 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.306496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/828419ec-ce14-4964-9bc3-5bdf5c8dc202-maas-api-tls\") pod \"maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx\" (UID: \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:12:20.407520 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.407489    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/828419ec-ce14-4964-9bc3-5bdf5c8dc202-maas-api-tls\") pod \"maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx\" (UID: \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:12:20.407680 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.407553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbxt\" (UniqueName: \"kubernetes.io/projected/828419ec-ce14-4964-9bc3-5bdf5c8dc202-kube-api-access-hhbxt\") pod \"maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx\" (UID: \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:12:20.407680 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.407591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/828419ec-ce14-4964-9bc3-5bdf5c8dc202-openshift-service-ca\") pod \"maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx\" (UID: \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:12:20.408292 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.408265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/828419ec-ce14-4964-9bc3-5bdf5c8dc202-openshift-service-ca\") pod \"maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx\" (UID: \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:12:20.409907 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.409888    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/828419ec-ce14-4964-9bc3-5bdf5c8dc202-maas-api-tls\") pod \"maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx\" (UID: \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:12:20.416538 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.416512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhbxt\" (UniqueName: \"kubernetes.io/projected/828419ec-ce14-4964-9bc3-5bdf5c8dc202-kube-api-access-hhbxt\") pod \"maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx\" (UID: \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:12:20.516840 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.516802    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:12:20.655499 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.655474    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"]
Jul 19 15:12:20.658230 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:12:20.658199    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828419ec_ce14_4964_9bc3_5bdf5c8dc202.slice/crio-fe95d8cdf80924ca49345e2038f8bb358b8656ec5f4bb39254b27fe064808810 WatchSource:0}: Error finding container fe95d8cdf80924ca49345e2038f8bb358b8656ec5f4bb39254b27fe064808810: Status 404 returned error can't find the container with id fe95d8cdf80924ca49345e2038f8bb358b8656ec5f4bb39254b27fe064808810
Jul 19 15:12:20.659796 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.659774    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 15:12:20.847605 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:20.847521    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx" event={"ID":"828419ec-ce14-4964-9bc3-5bdf5c8dc202","Type":"ContainerStarted","Data":"fe95d8cdf80924ca49345e2038f8bb358b8656ec5f4bb39254b27fe064808810"}
Jul 19 15:12:21.855135 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:21.855052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx" event={"ID":"828419ec-ce14-4964-9bc3-5bdf5c8dc202","Type":"ContainerStarted","Data":"0ab0ad61e15e3cf43eba85559581e6f89d7f29f9a13cf6607c32180a6bf55d19"}
Jul 19 15:12:21.855532 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:21.855140    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:12:21.870981 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:21.870933    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx" podStartSLOduration=1.4993119080000001 podStartE2EDuration="1.870918921s" totalImagesPullingTime="371.607013ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:12:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:12:21.869734699 +0000 UTC m=+2152.262297085" watchObservedRunningTime="2026-07-19 15:12:21.870918921 +0000 UTC m=+2152.263481306"
Jul 19 15:12:27.866442 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:27.866410    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:12:52.771419 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:52.771381    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5"]
Jul 19 15:12:52.774713 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:52.774692    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5"
Jul 19 15:12:52.777059 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:52.777033    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bq7rt\""
Jul 19 15:12:52.781256 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:52.781191    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5"]
Jul 19 15:12:52.892294 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:52.892260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc8faa4-1d37-4b46-b5ee-91ea7957498f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5\" (UID: \"0bc8faa4-1d37-4b46-b5ee-91ea7957498f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5"
Jul 19 15:12:52.993616 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:52.993584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc8faa4-1d37-4b46-b5ee-91ea7957498f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5\" (UID: \"0bc8faa4-1d37-4b46-b5ee-91ea7957498f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5"
Jul 19 15:12:52.994251 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:52.994230    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc8faa4-1d37-4b46-b5ee-91ea7957498f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5\" (UID: \"0bc8faa4-1d37-4b46-b5ee-91ea7957498f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5"
Jul 19 15:12:53.087203 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:53.087107    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5"
Jul 19 15:12:53.214590 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:53.214569    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5"]
Jul 19 15:12:53.216575 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:12:53.216534    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc8faa4_1d37_4b46_b5ee_91ea7957498f.slice/crio-fd3f8614531be8ef518beeee8e5ddb1fcf4d0aacd4e73f048e060b8da34ecabf WatchSource:0}: Error finding container fd3f8614531be8ef518beeee8e5ddb1fcf4d0aacd4e73f048e060b8da34ecabf: Status 404 returned error can't find the container with id fd3f8614531be8ef518beeee8e5ddb1fcf4d0aacd4e73f048e060b8da34ecabf
Jul 19 15:12:53.995817 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:53.995788    2581 generic.go:356] "Generic (PLEG): container finished" podID="0bc8faa4-1d37-4b46-b5ee-91ea7957498f" containerID="57e599e3f802f5a1effe060d2b27527b7014c7f107c5dd466c37a5a5258fd5b1" exitCode=0
Jul 19 15:12:53.996161 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:53.995838    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5" event={"ID":"0bc8faa4-1d37-4b46-b5ee-91ea7957498f","Type":"ContainerDied","Data":"57e599e3f802f5a1effe060d2b27527b7014c7f107c5dd466c37a5a5258fd5b1"}
Jul 19 15:12:53.996161 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:53.995903    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5" event={"ID":"0bc8faa4-1d37-4b46-b5ee-91ea7957498f","Type":"ContainerStarted","Data":"fd3f8614531be8ef518beeee8e5ddb1fcf4d0aacd4e73f048e060b8da34ecabf"}
Jul 19 15:12:55.122657 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:55.122633    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5"
Jul 19 15:12:55.213933 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:55.213903    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc8faa4-1d37-4b46-b5ee-91ea7957498f-maas-api-service-ca\") pod \"0bc8faa4-1d37-4b46-b5ee-91ea7957498f\" (UID: \"0bc8faa4-1d37-4b46-b5ee-91ea7957498f\") "
Jul 19 15:12:55.214286 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:55.214265    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bc8faa4-1d37-4b46-b5ee-91ea7957498f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0bc8faa4-1d37-4b46-b5ee-91ea7957498f" (UID: "0bc8faa4-1d37-4b46-b5ee-91ea7957498f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:12:55.315196 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:55.315090    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc8faa4-1d37-4b46-b5ee-91ea7957498f-maas-api-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:12:56.005970 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:56.005942    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5"
Jul 19 15:12:56.006118 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:56.005987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5" event={"ID":"0bc8faa4-1d37-4b46-b5ee-91ea7957498f","Type":"ContainerDied","Data":"fd3f8614531be8ef518beeee8e5ddb1fcf4d0aacd4e73f048e060b8da34ecabf"}
Jul 19 15:12:56.006118 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:12:56.006030    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd3f8614531be8ef518beeee8e5ddb1fcf4d0aacd4e73f048e060b8da34ecabf"
Jul 19 15:13:08.242532 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:08.242492    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"]
Jul 19 15:13:08.242983 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:08.242757    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx" podUID="828419ec-ce14-4964-9bc3-5bdf5c8dc202" containerName="maas-api" containerID="cri-o://0ab0ad61e15e3cf43eba85559581e6f89d7f29f9a13cf6607c32180a6bf55d19" gracePeriod=30
Jul 19 15:13:08.483192 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:08.483162    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:13:08.534472 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:08.534383    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/828419ec-ce14-4964-9bc3-5bdf5c8dc202-openshift-service-ca\") pod \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\" (UID: \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\") "
Jul 19 15:13:08.534653 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:08.534494    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/828419ec-ce14-4964-9bc3-5bdf5c8dc202-maas-api-tls\") pod \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\" (UID: \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\") "
Jul 19 15:13:08.534653 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:08.534567    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhbxt\" (UniqueName: \"kubernetes.io/projected/828419ec-ce14-4964-9bc3-5bdf5c8dc202-kube-api-access-hhbxt\") pod \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\" (UID: \"828419ec-ce14-4964-9bc3-5bdf5c8dc202\") "
Jul 19 15:13:08.534797 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:08.534773    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/828419ec-ce14-4964-9bc3-5bdf5c8dc202-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "828419ec-ce14-4964-9bc3-5bdf5c8dc202" (UID: "828419ec-ce14-4964-9bc3-5bdf5c8dc202"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:13:08.536614 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:08.536591    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/828419ec-ce14-4964-9bc3-5bdf5c8dc202-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "828419ec-ce14-4964-9bc3-5bdf5c8dc202" (UID: "828419ec-ce14-4964-9bc3-5bdf5c8dc202"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 15:13:08.536687 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:08.536600    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/828419ec-ce14-4964-9bc3-5bdf5c8dc202-kube-api-access-hhbxt" (OuterVolumeSpecName: "kube-api-access-hhbxt") pod "828419ec-ce14-4964-9bc3-5bdf5c8dc202" (UID: "828419ec-ce14-4964-9bc3-5bdf5c8dc202"). InnerVolumeSpecName "kube-api-access-hhbxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:13:08.635458 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:08.635426    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhbxt\" (UniqueName: \"kubernetes.io/projected/828419ec-ce14-4964-9bc3-5bdf5c8dc202-kube-api-access-hhbxt\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:13:08.635458 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:08.635451    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/828419ec-ce14-4964-9bc3-5bdf5c8dc202-openshift-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:13:08.635458 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:08.635460    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/828419ec-ce14-4964-9bc3-5bdf5c8dc202-maas-api-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:13:09.065491 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:09.065450    2581 generic.go:356] "Generic (PLEG): container finished" podID="828419ec-ce14-4964-9bc3-5bdf5c8dc202" containerID="0ab0ad61e15e3cf43eba85559581e6f89d7f29f9a13cf6607c32180a6bf55d19" exitCode=0
Jul 19 15:13:09.065674 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:09.065501    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"
Jul 19 15:13:09.065674 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:09.065511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx" event={"ID":"828419ec-ce14-4964-9bc3-5bdf5c8dc202","Type":"ContainerDied","Data":"0ab0ad61e15e3cf43eba85559581e6f89d7f29f9a13cf6607c32180a6bf55d19"}
Jul 19 15:13:09.065674 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:09.065566    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx" event={"ID":"828419ec-ce14-4964-9bc3-5bdf5c8dc202","Type":"ContainerDied","Data":"fe95d8cdf80924ca49345e2038f8bb358b8656ec5f4bb39254b27fe064808810"}
Jul 19 15:13:09.065674 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:09.065597    2581 scope.go:117] "RemoveContainer" containerID="0ab0ad61e15e3cf43eba85559581e6f89d7f29f9a13cf6607c32180a6bf55d19"
Jul 19 15:13:09.074919 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:09.074894    2581 scope.go:117] "RemoveContainer" containerID="0ab0ad61e15e3cf43eba85559581e6f89d7f29f9a13cf6607c32180a6bf55d19"
Jul 19 15:13:09.075161 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:13:09.075140    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ab0ad61e15e3cf43eba85559581e6f89d7f29f9a13cf6607c32180a6bf55d19\": container with ID starting with 0ab0ad61e15e3cf43eba85559581e6f89d7f29f9a13cf6607c32180a6bf55d19 not found: ID does not exist" containerID="0ab0ad61e15e3cf43eba85559581e6f89d7f29f9a13cf6607c32180a6bf55d19"
Jul 19 15:13:09.075244 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:09.075191    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab0ad61e15e3cf43eba85559581e6f89d7f29f9a13cf6607c32180a6bf55d19"} err="failed to get container status \"0ab0ad61e15e3cf43eba85559581e6f89d7f29f9a13cf6607c32180a6bf55d19\": rpc error: code = NotFound desc = could not find container \"0ab0ad61e15e3cf43eba85559581e6f89d7f29f9a13cf6607c32180a6bf55d19\": container with ID starting with 0ab0ad61e15e3cf43eba85559581e6f89d7f29f9a13cf6607c32180a6bf55d19 not found: ID does not exist"
Jul 19 15:13:09.081892 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:09.081869    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"]
Jul 19 15:13:09.083316 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:09.083291    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c515b9b9-5f4f5cd94b-czpnx"]
Jul 19 15:13:10.966738 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:10.966703    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="828419ec-ce14-4964-9bc3-5bdf5c8dc202" path="/var/lib/kubelet/pods/828419ec-ce14-4964-9bc3-5bdf5c8dc202/volumes"
Jul 19 15:13:12.842215 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:12.842165    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5"]
Jul 19 15:13:12.844908 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:12.844884    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c515b9b9-65vj5"]
Jul 19 15:13:12.967801 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:12.967769    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc8faa4-1d37-4b46-b5ee-91ea7957498f" path="/var/lib/kubelet/pods/0bc8faa4-1d37-4b46-b5ee-91ea7957498f/volumes"
Jul 19 15:13:31.127676 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:13:31.127645    2581 scope.go:117] "RemoveContainer" containerID="7c5b1449cacd659d4d73a94ed698f3f370c80640b04a56033964248f869b30f2"
Jul 19 15:15:00.128008 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:00.127972    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29741235-8svr4"]
Jul 19 15:15:00.128518 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:00.128360    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="828419ec-ce14-4964-9bc3-5bdf5c8dc202" containerName="maas-api"
Jul 19 15:15:00.128518 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:00.128373    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="828419ec-ce14-4964-9bc3-5bdf5c8dc202" containerName="maas-api"
Jul 19 15:15:00.128518 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:00.128390    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc8faa4-1d37-4b46-b5ee-91ea7957498f" containerName="revoke-keys"
Jul 19 15:15:00.128518 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:00.128397    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc8faa4-1d37-4b46-b5ee-91ea7957498f" containerName="revoke-keys"
Jul 19 15:15:00.128518 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:00.128451    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="828419ec-ce14-4964-9bc3-5bdf5c8dc202" containerName="maas-api"
Jul 19 15:15:00.128518 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:00.128461    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc8faa4-1d37-4b46-b5ee-91ea7957498f" containerName="revoke-keys"
Jul 19 15:15:00.131313 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:00.131298    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741235-8svr4"
Jul 19 15:15:00.133647 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:00.133625    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bq7rt\""
Jul 19 15:15:00.137656 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:00.137635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29741235-8svr4"]
Jul 19 15:15:00.141590 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:00.141569    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741235-8svr4"
Jul 19 15:15:00.272005 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:00.271968    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29741235-8svr4"]
Jul 19 15:15:00.274852 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:15:00.274824    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1249a625_2cec_4a2e_a43f_b74b869bb842.slice/crio-b2a8b22034c200c16da5445eeb41ce519285d80a17d68abb27e01d598b9d9758 WatchSource:0}: Error finding container b2a8b22034c200c16da5445eeb41ce519285d80a17d68abb27e01d598b9d9758: Status 404 returned error can't find the container with id b2a8b22034c200c16da5445eeb41ce519285d80a17d68abb27e01d598b9d9758
Jul 19 15:15:00.558360 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:00.558333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741235-8svr4" event={"ID":"1249a625-2cec-4a2e-a43f-b74b869bb842","Type":"ContainerStarted","Data":"b2a8b22034c200c16da5445eeb41ce519285d80a17d68abb27e01d598b9d9758"}
Jul 19 15:15:01.102975 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.102941    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"]
Jul 19 15:15:01.106362 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.106339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:01.108896 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.108865    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-f72db2-serving-cert\""
Jul 19 15:15:01.109030 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.108922    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 15:15:01.109030 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.108921    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 19 15:15:01.109848 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.109827    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-b4zp5\""
Jul 19 15:15:01.116487 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.116433    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"]
Jul 19 15:15:01.215082 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.215050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6\" (UID: \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:01.215503 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.215096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-maas-api-tls\") pod \"maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6\" (UID: \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:01.215503 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.215212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k44ht\" (UniqueName: \"kubernetes.io/projected/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-kube-api-access-k44ht\") pod \"maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6\" (UID: \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:01.315718 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.315681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6\" (UID: \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:01.315910 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.315730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-maas-api-tls\") pod \"maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6\" (UID: \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:01.315910 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.315763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k44ht\" (UniqueName: \"kubernetes.io/projected/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-kube-api-access-k44ht\") pod \"maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6\" (UID: \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:01.316026 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:15:01.315905    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-serving-cert: secret "maas-api-e2e-inf-a-f72db2-serving-cert" not found
Jul 19 15:15:01.316026 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:15:01.315979    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-maas-api-tls podName:7c0a3de2-f06b-4cdb-9ee2-98b90249dd18 nodeName:}" failed. No retries permitted until 2026-07-19 15:15:01.815958756 +0000 UTC m=+2312.208521119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-maas-api-tls") pod "maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6" (UID: "7c0a3de2-f06b-4cdb-9ee2-98b90249dd18") : secret "maas-api-e2e-inf-a-f72db2-serving-cert" not found
Jul 19 15:15:01.316462 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.316440    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6\" (UID: \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:01.325270 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.325247    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k44ht\" (UniqueName: \"kubernetes.io/projected/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-kube-api-access-k44ht\") pod \"maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6\" (UID: \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:01.565461 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.565423    2581 generic.go:356] "Generic (PLEG): container finished" podID="1249a625-2cec-4a2e-a43f-b74b869bb842" containerID="29dbf2dfe9bca18b5e7f873a6ce620d009c5e515db2cfd0182a1ab59c7bce6d0" exitCode=0
Jul 19 15:15:01.565668 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.565477    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741235-8svr4" event={"ID":"1249a625-2cec-4a2e-a43f-b74b869bb842","Type":"ContainerDied","Data":"29dbf2dfe9bca18b5e7f873a6ce620d009c5e515db2cfd0182a1ab59c7bce6d0"}
Jul 19 15:15:01.819945 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.819862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-maas-api-tls\") pod \"maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6\" (UID: \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:01.822296 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:01.822266    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-maas-api-tls\") pod \"maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6\" (UID: \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:02.019635 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:02.019600    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:02.154554 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:02.154376    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"]
Jul 19 15:15:02.156576 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:15:02.156548    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c0a3de2_f06b_4cdb_9ee2_98b90249dd18.slice/crio-f56a68faeddf63256dedf5d77acea71846673011d728dced83fbf3ac6b4fbcf3 WatchSource:0}: Error finding container f56a68faeddf63256dedf5d77acea71846673011d728dced83fbf3ac6b4fbcf3: Status 404 returned error can't find the container with id f56a68faeddf63256dedf5d77acea71846673011d728dced83fbf3ac6b4fbcf3
Jul 19 15:15:02.572215 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:02.572168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6" event={"ID":"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18","Type":"ContainerStarted","Data":"f56a68faeddf63256dedf5d77acea71846673011d728dced83fbf3ac6b4fbcf3"}
Jul 19 15:15:02.706056 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:02.706031    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741235-8svr4"
Jul 19 15:15:03.577775 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:03.577743    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6" event={"ID":"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18","Type":"ContainerStarted","Data":"4d937d81ede65c95073047ec22972ed46a88f50bf4adcf9a8d5f38da161e3da4"}
Jul 19 15:15:03.578266 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:03.577853    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:03.579036 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:03.579020    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741235-8svr4"
Jul 19 15:15:03.579086 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:03.579057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741235-8svr4" event={"ID":"1249a625-2cec-4a2e-a43f-b74b869bb842","Type":"ContainerDied","Data":"b2a8b22034c200c16da5445eeb41ce519285d80a17d68abb27e01d598b9d9758"}
Jul 19 15:15:03.579120 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:03.579088    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2a8b22034c200c16da5445eeb41ce519285d80a17d68abb27e01d598b9d9758"
Jul 19 15:15:03.593616 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:03.593570    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6" podStartSLOduration=2.198831725 podStartE2EDuration="2.593555276s" totalImagesPullingTime="394.723551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:15:03.592836848 +0000 UTC m=+2313.985399236" watchObservedRunningTime="2026-07-19 15:15:03.593555276 +0000 UTC m=+2313.986117661"
Jul 19 15:15:06.057986 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.057938    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"]
Jul 19 15:15:06.058571 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.058554    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1249a625-2cec-4a2e-a43f-b74b869bb842" containerName="cleanup"
Jul 19 15:15:06.058619 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.058575    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1249a625-2cec-4a2e-a43f-b74b869bb842" containerName="cleanup"
Jul 19 15:15:06.058668 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.058656    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1249a625-2cec-4a2e-a43f-b74b869bb842" containerName="cleanup"
Jul 19 15:15:06.061810 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.061785    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.064194 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.064159    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-36dc1d-openshift-default-dockercfg-mq7mn\""
Jul 19 15:15:06.071466 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.071440    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"]
Jul 19 15:15:06.159970 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.159934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-podinfo\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.159970 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.159975    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-envoy\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.160300 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.160000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-data\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.160300 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.160093    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-token\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.160300 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.160160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-workload-certs\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.160300 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.160234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9c0bcbf-2722-4777-b356-6c2591f2739e-istiod-ca-cert\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.160501 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.160300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-credential-socket\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.160501 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.160397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-workload-socket\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.160501 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.160419    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzgst\" (UniqueName: \"kubernetes.io/projected/c9c0bcbf-2722-4777-b356-6c2591f2739e-kube-api-access-mzgst\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.261283 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.261241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-envoy\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.261283 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.261280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-data\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.261545 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.261317    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-token\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.261545 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.261350    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-workload-certs\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.261545 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.261389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9c0bcbf-2722-4777-b356-6c2591f2739e-istiod-ca-cert\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.261545 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.261436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-credential-socket\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.261545 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.261518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-workload-socket\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.261545 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.261540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzgst\" (UniqueName: \"kubernetes.io/projected/c9c0bcbf-2722-4777-b356-6c2591f2739e-kube-api-access-mzgst\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.261839 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.261755    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-workload-certs\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.261839 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.261779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-podinfo\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.261923 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.261838    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-workload-socket\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.261969 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.261917    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-credential-socket\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.262004 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.261975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-data\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.262237 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.262218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9c0bcbf-2722-4777-b356-6c2591f2739e-istiod-ca-cert\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.263679 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.263654    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-envoy\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.263935 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.263918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-podinfo\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.269570 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.269546    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-token\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.269815 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.269801    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzgst\" (UniqueName: \"kubernetes.io/projected/c9c0bcbf-2722-4777-b356-6c2591f2739e-kube-api-access-mzgst\") pod \"e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") " pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.373527 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.373426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:06.508481 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.508456    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"]
Jul 19 15:15:06.510955 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:15:06.510931    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c0bcbf_2722_4777_b356_6c2591f2739e.slice/crio-6473f9c2921fe9bee6a1b5674b0f2a1cec871dc7ccaedbcd5800359645fa8fad WatchSource:0}: Error finding container 6473f9c2921fe9bee6a1b5674b0f2a1cec871dc7ccaedbcd5800359645fa8fad: Status 404 returned error can't find the container with id 6473f9c2921fe9bee6a1b5674b0f2a1cec871dc7ccaedbcd5800359645fa8fad
Jul 19 15:15:06.513630 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.513584    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:15:06.513723 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.513655    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:15:06.513723 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.513684    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:15:06.596666 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.596594    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv" event={"ID":"c9c0bcbf-2722-4777-b356-6c2591f2739e","Type":"ContainerStarted","Data":"980463b756e918d9e48a11b8606a690e72e5f0a1035e257e8da0fb1f36d69f9f"}
Jul 19 15:15:06.596666 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.596663    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv" event={"ID":"c9c0bcbf-2722-4777-b356-6c2591f2739e","Type":"ContainerStarted","Data":"6473f9c2921fe9bee6a1b5674b0f2a1cec871dc7ccaedbcd5800359645fa8fad"}
Jul 19 15:15:06.619762 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:06.619696    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv" podStartSLOduration=0.619674826 podStartE2EDuration="619.674826ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:15:06.618749508 +0000 UTC m=+2317.011311906" watchObservedRunningTime="2026-07-19 15:15:06.619674826 +0000 UTC m=+2317.012237210"
Jul 19 15:15:07.373976 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:07.373938    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:07.379116 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:07.379090    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:07.601953 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:07.601922    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:07.603382 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:07.603358    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:08.707350 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:08.707318    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"]
Jul 19 15:15:08.710702 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:08.710685    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:08.713144 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:08.713123    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-36dc1d-serving-cert\""
Jul 19 15:15:08.721372 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:08.721347    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"]
Jul 19 15:15:08.785841 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:08.785803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hckmq\" (UniqueName: \"kubernetes.io/projected/e6321e7e-7e8c-486e-a344-dc316a5f76d6-kube-api-access-hckmq\") pod \"maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf\" (UID: \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:08.785998 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:08.785884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6321e7e-7e8c-486e-a344-dc316a5f76d6-maas-api-tls\") pod \"maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf\" (UID: \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:08.785998 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:08.785903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6321e7e-7e8c-486e-a344-dc316a5f76d6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf\" (UID: \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:08.886478 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:08.886444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6321e7e-7e8c-486e-a344-dc316a5f76d6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf\" (UID: \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:08.886661 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:08.886510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hckmq\" (UniqueName: \"kubernetes.io/projected/e6321e7e-7e8c-486e-a344-dc316a5f76d6-kube-api-access-hckmq\") pod \"maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf\" (UID: \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:08.886661 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:08.886596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6321e7e-7e8c-486e-a344-dc316a5f76d6-maas-api-tls\") pod \"maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf\" (UID: \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:08.886816 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:15:08.886676    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-serving-cert: secret "maas-api-e2e-inf-b-36dc1d-serving-cert" not found
Jul 19 15:15:08.886816 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:15:08.886732    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6321e7e-7e8c-486e-a344-dc316a5f76d6-maas-api-tls podName:e6321e7e-7e8c-486e-a344-dc316a5f76d6 nodeName:}" failed. No retries permitted until 2026-07-19 15:15:09.386713927 +0000 UTC m=+2319.779276289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e6321e7e-7e8c-486e-a344-dc316a5f76d6-maas-api-tls") pod "maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf" (UID: "e6321e7e-7e8c-486e-a344-dc316a5f76d6") : secret "maas-api-e2e-inf-b-36dc1d-serving-cert" not found
Jul 19 15:15:08.887096 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:08.887074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6321e7e-7e8c-486e-a344-dc316a5f76d6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf\" (UID: \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:08.896151 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:08.896126    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hckmq\" (UniqueName: \"kubernetes.io/projected/e6321e7e-7e8c-486e-a344-dc316a5f76d6-kube-api-access-hckmq\") pod \"maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf\" (UID: \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:09.391329 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:09.391294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6321e7e-7e8c-486e-a344-dc316a5f76d6-maas-api-tls\") pod \"maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf\" (UID: \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:09.393781 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:09.393752    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6321e7e-7e8c-486e-a344-dc316a5f76d6-maas-api-tls\") pod \"maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf\" (UID: \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:09.595006 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:09.594973    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:15:09.622288 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:09.622255    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:09.766170 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:09.766148    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"]
Jul 19 15:15:09.767980 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:15:09.767952    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6321e7e_7e8c_486e_a344_dc316a5f76d6.slice/crio-f196e4c430691d6d65b6980e46c37762e572d645738197a1149cf352df4d4387 WatchSource:0}: Error finding container f196e4c430691d6d65b6980e46c37762e572d645738197a1149cf352df4d4387: Status 404 returned error can't find the container with id f196e4c430691d6d65b6980e46c37762e572d645738197a1149cf352df4d4387
Jul 19 15:15:10.619237 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:10.619132    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf" event={"ID":"e6321e7e-7e8c-486e-a344-dc316a5f76d6","Type":"ContainerStarted","Data":"79ed93af9e2e8a232554a171d8f27bd717d0a8eb99d67b1575e1afd86a6da953"}
Jul 19 15:15:10.619237 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:10.619209    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf" event={"ID":"e6321e7e-7e8c-486e-a344-dc316a5f76d6","Type":"ContainerStarted","Data":"f196e4c430691d6d65b6980e46c37762e572d645738197a1149cf352df4d4387"}
Jul 19 15:15:10.619237 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:10.619239    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:16.628951 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:16.628922    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:15:16.645887 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:16.645817    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf" podStartSLOduration=8.127625058 podStartE2EDuration="8.645800676s" totalImagesPullingTime="518.175618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:15:10.634355453 +0000 UTC m=+2321.026917841" watchObservedRunningTime="2026-07-19 15:15:16.645800676 +0000 UTC m=+2327.038363063"
Jul 19 15:15:23.643386 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:23.643343    2581 patch_prober.go:28] interesting pod/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 19 15:15:23.643778 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:23.643408    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv" podUID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 19 15:15:25.698622 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:25.698584    2581 generic.go:356] "Generic (PLEG): container finished" podID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerID="980463b756e918d9e48a11b8606a690e72e5f0a1035e257e8da0fb1f36d69f9f" exitCode=0
Jul 19 15:15:25.699078 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:25.698652    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv" event={"ID":"c9c0bcbf-2722-4777-b356-6c2591f2739e","Type":"ContainerDied","Data":"980463b756e918d9e48a11b8606a690e72e5f0a1035e257e8da0fb1f36d69f9f"}
Jul 19 15:15:25.699078 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:25.699032    2581 scope.go:117] "RemoveContainer" containerID="980463b756e918d9e48a11b8606a690e72e5f0a1035e257e8da0fb1f36d69f9f"
Jul 19 15:15:25.700014 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:25.699984    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:15:25.700132 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:25.700066    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:15:25.700132 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:25.700115    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:15:26.705666 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:26.705635    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv" event={"ID":"c9c0bcbf-2722-4777-b356-6c2591f2739e","Type":"ContainerStarted","Data":"f6395431e3fd0018da321bc9668dfc8a7b0e95f41c7ca2371157abadb76dcd58"}
Jul 19 15:15:27.374419 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:27.374369    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:27.374620 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:27.374594    2581 patch_prober.go:28] interesting pod/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 19 15:15:27.374672 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:27.374639    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv" podUID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 19 15:15:28.374849 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:28.374804    2581 patch_prober.go:28] interesting pod/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 19 15:15:28.375303 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:28.374865    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv" podUID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 19 15:15:29.374254 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:29.374215    2581 patch_prober.go:28] interesting pod/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 19 15:15:29.374444 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:29.374271    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv" podUID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 19 15:15:30.374774 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:30.374739    2581 patch_prober.go:28] interesting pod/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 19 15:15:30.375213 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:30.374795    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv" podUID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 19 15:15:31.158068 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:31.158032    2581 scope.go:117] "RemoveContainer" containerID="14fa33e8c7aecfb0ca1e72b7428323018d317497f9fad53f88955a6ad8097cfa"
Jul 19 15:15:31.377763 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:31.377735    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:31.378348 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:31.378109    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:15:31.378805 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:15:31.378787    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:16:44.492720 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:44.492670    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"]
Jul 19 15:16:44.493261 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:44.492941    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6" podUID="7c0a3de2-f06b-4cdb-9ee2-98b90249dd18" containerName="maas-api" containerID="cri-o://4d937d81ede65c95073047ec22972ed46a88f50bf4adcf9a8d5f38da161e3da4" gracePeriod=30
Jul 19 15:16:44.584812 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:44.584764    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6" podUID="7c0a3de2-f06b-4cdb-9ee2-98b90249dd18" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.44:8443/health\": dial tcp 10.133.0.44:8443: connect: connection refused"
Jul 19 15:16:44.936511 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:44.936489    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:16:45.043772 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.043673    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-maas-api-tls\") pod \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\" (UID: \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\") "
Jul 19 15:16:45.043772 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.043741    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-openshift-service-ca\") pod \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\" (UID: \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\") "
Jul 19 15:16:45.043772 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.043769    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k44ht\" (UniqueName: \"kubernetes.io/projected/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-kube-api-access-k44ht\") pod \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\" (UID: \"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18\") "
Jul 19 15:16:45.044123 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.044092    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7c0a3de2-f06b-4cdb-9ee2-98b90249dd18" (UID: "7c0a3de2-f06b-4cdb-9ee2-98b90249dd18"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:16:45.045829 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.045805    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7c0a3de2-f06b-4cdb-9ee2-98b90249dd18" (UID: "7c0a3de2-f06b-4cdb-9ee2-98b90249dd18"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 15:16:45.045926 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.045898    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-kube-api-access-k44ht" (OuterVolumeSpecName: "kube-api-access-k44ht") pod "7c0a3de2-f06b-4cdb-9ee2-98b90249dd18" (UID: "7c0a3de2-f06b-4cdb-9ee2-98b90249dd18"). InnerVolumeSpecName "kube-api-access-k44ht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:16:45.067702 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.067668    2581 generic.go:356] "Generic (PLEG): container finished" podID="7c0a3de2-f06b-4cdb-9ee2-98b90249dd18" containerID="4d937d81ede65c95073047ec22972ed46a88f50bf4adcf9a8d5f38da161e3da4" exitCode=0
Jul 19 15:16:45.067851 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.067716    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"
Jul 19 15:16:45.067851 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.067745    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6" event={"ID":"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18","Type":"ContainerDied","Data":"4d937d81ede65c95073047ec22972ed46a88f50bf4adcf9a8d5f38da161e3da4"}
Jul 19 15:16:45.067851 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.067811    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6" event={"ID":"7c0a3de2-f06b-4cdb-9ee2-98b90249dd18","Type":"ContainerDied","Data":"f56a68faeddf63256dedf5d77acea71846673011d728dced83fbf3ac6b4fbcf3"}
Jul 19 15:16:45.067851 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.067840    2581 scope.go:117] "RemoveContainer" containerID="4d937d81ede65c95073047ec22972ed46a88f50bf4adcf9a8d5f38da161e3da4"
Jul 19 15:16:45.077016 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.077000    2581 scope.go:117] "RemoveContainer" containerID="4d937d81ede65c95073047ec22972ed46a88f50bf4adcf9a8d5f38da161e3da4"
Jul 19 15:16:45.077349 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:16:45.077327    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d937d81ede65c95073047ec22972ed46a88f50bf4adcf9a8d5f38da161e3da4\": container with ID starting with 4d937d81ede65c95073047ec22972ed46a88f50bf4adcf9a8d5f38da161e3da4 not found: ID does not exist" containerID="4d937d81ede65c95073047ec22972ed46a88f50bf4adcf9a8d5f38da161e3da4"
Jul 19 15:16:45.077400 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.077357    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d937d81ede65c95073047ec22972ed46a88f50bf4adcf9a8d5f38da161e3da4"} err="failed to get container status \"4d937d81ede65c95073047ec22972ed46a88f50bf4adcf9a8d5f38da161e3da4\": rpc error: code = NotFound desc = could not find container \"4d937d81ede65c95073047ec22972ed46a88f50bf4adcf9a8d5f38da161e3da4\": container with ID starting with 4d937d81ede65c95073047ec22972ed46a88f50bf4adcf9a8d5f38da161e3da4 not found: ID does not exist"
Jul 19 15:16:45.087794 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.087770    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"]
Jul 19 15:16:45.091583 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.091557    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f72db2-7b5bb8bf8f-7k2v6"]
Jul 19 15:16:45.145461 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.145430    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-maas-api-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:16:45.145461 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.145459    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-openshift-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:16:45.145594 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:45.145470    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k44ht\" (UniqueName: \"kubernetes.io/projected/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18-kube-api-access-k44ht\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:16:46.967162 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:16:46.967130    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c0a3de2-f06b-4cdb-9ee2-98b90249dd18" path="/var/lib/kubelet/pods/7c0a3de2-f06b-4cdb-9ee2-98b90249dd18/volumes"
Jul 19 15:17:06.594595 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:06.594496    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"]
Jul 19 15:17:06.595222 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:06.594753    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf" podUID="e6321e7e-7e8c-486e-a344-dc316a5f76d6" containerName="maas-api" containerID="cri-o://79ed93af9e2e8a232554a171d8f27bd717d0a8eb99d67b1575e1afd86a6da953" gracePeriod=30
Jul 19 15:17:06.624448 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:06.624414    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf" podUID="e6321e7e-7e8c-486e-a344-dc316a5f76d6" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.46:8443/health\": dial tcp 10.133.0.46:8443: connect: connection refused"
Jul 19 15:17:06.840940 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:06.840915    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:17:06.935136 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:06.935056    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6321e7e-7e8c-486e-a344-dc316a5f76d6-maas-api-tls\") pod \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\" (UID: \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\") "
Jul 19 15:17:06.935136 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:06.935131    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6321e7e-7e8c-486e-a344-dc316a5f76d6-openshift-service-ca\") pod \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\" (UID: \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\") "
Jul 19 15:17:06.935348 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:06.935205    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hckmq\" (UniqueName: \"kubernetes.io/projected/e6321e7e-7e8c-486e-a344-dc316a5f76d6-kube-api-access-hckmq\") pod \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\" (UID: \"e6321e7e-7e8c-486e-a344-dc316a5f76d6\") "
Jul 19 15:17:06.935541 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:06.935512    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6321e7e-7e8c-486e-a344-dc316a5f76d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6321e7e-7e8c-486e-a344-dc316a5f76d6" (UID: "e6321e7e-7e8c-486e-a344-dc316a5f76d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:17:06.937116 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:06.937092    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6321e7e-7e8c-486e-a344-dc316a5f76d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6321e7e-7e8c-486e-a344-dc316a5f76d6" (UID: "e6321e7e-7e8c-486e-a344-dc316a5f76d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 15:17:06.937225 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:06.937135    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6321e7e-7e8c-486e-a344-dc316a5f76d6-kube-api-access-hckmq" (OuterVolumeSpecName: "kube-api-access-hckmq") pod "e6321e7e-7e8c-486e-a344-dc316a5f76d6" (UID: "e6321e7e-7e8c-486e-a344-dc316a5f76d6"). InnerVolumeSpecName "kube-api-access-hckmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:17:07.036269 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:07.036228    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6321e7e-7e8c-486e-a344-dc316a5f76d6-maas-api-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:07.036269 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:07.036262    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6321e7e-7e8c-486e-a344-dc316a5f76d6-openshift-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:07.036269 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:07.036272    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hckmq\" (UniqueName: \"kubernetes.io/projected/e6321e7e-7e8c-486e-a344-dc316a5f76d6-kube-api-access-hckmq\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:07.172635 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:07.172597    2581 generic.go:356] "Generic (PLEG): container finished" podID="e6321e7e-7e8c-486e-a344-dc316a5f76d6" containerID="79ed93af9e2e8a232554a171d8f27bd717d0a8eb99d67b1575e1afd86a6da953" exitCode=0
Jul 19 15:17:07.172819 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:07.172650    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"
Jul 19 15:17:07.172819 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:07.172682    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf" event={"ID":"e6321e7e-7e8c-486e-a344-dc316a5f76d6","Type":"ContainerDied","Data":"79ed93af9e2e8a232554a171d8f27bd717d0a8eb99d67b1575e1afd86a6da953"}
Jul 19 15:17:07.172819 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:07.172745    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf" event={"ID":"e6321e7e-7e8c-486e-a344-dc316a5f76d6","Type":"ContainerDied","Data":"f196e4c430691d6d65b6980e46c37762e572d645738197a1149cf352df4d4387"}
Jul 19 15:17:07.172819 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:07.172768    2581 scope.go:117] "RemoveContainer" containerID="79ed93af9e2e8a232554a171d8f27bd717d0a8eb99d67b1575e1afd86a6da953"
Jul 19 15:17:07.181155 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:07.181131    2581 scope.go:117] "RemoveContainer" containerID="79ed93af9e2e8a232554a171d8f27bd717d0a8eb99d67b1575e1afd86a6da953"
Jul 19 15:17:07.181462 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:17:07.181443    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79ed93af9e2e8a232554a171d8f27bd717d0a8eb99d67b1575e1afd86a6da953\": container with ID starting with 79ed93af9e2e8a232554a171d8f27bd717d0a8eb99d67b1575e1afd86a6da953 not found: ID does not exist" containerID="79ed93af9e2e8a232554a171d8f27bd717d0a8eb99d67b1575e1afd86a6da953"
Jul 19 15:17:07.181518 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:07.181473    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79ed93af9e2e8a232554a171d8f27bd717d0a8eb99d67b1575e1afd86a6da953"} err="failed to get container status \"79ed93af9e2e8a232554a171d8f27bd717d0a8eb99d67b1575e1afd86a6da953\": rpc error: code = NotFound desc = could not find container \"79ed93af9e2e8a232554a171d8f27bd717d0a8eb99d67b1575e1afd86a6da953\": container with ID starting with 79ed93af9e2e8a232554a171d8f27bd717d0a8eb99d67b1575e1afd86a6da953 not found: ID does not exist"
Jul 19 15:17:07.189150 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:07.189095    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"]
Jul 19 15:17:07.192307 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:07.192285    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36dc1d-55fd754b9d-zgdkf"]
Jul 19 15:17:08.967239 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:08.967203    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6321e7e-7e8c-486e-a344-dc316a5f76d6" path="/var/lib/kubelet/pods/e6321e7e-7e8c-486e-a344-dc316a5f76d6/volumes"
Jul 19 15:17:17.554157 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:17.554108    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"]
Jul 19 15:17:17.554586 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:17.554397    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv" podUID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerName="istio-proxy" containerID="cri-o://f6395431e3fd0018da321bc9668dfc8a7b0e95f41c7ca2371157abadb76dcd58" gracePeriod=30
Jul 19 15:17:21.746838 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.746803    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"]
Jul 19 15:17:21.747206 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.747127    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c0a3de2-f06b-4cdb-9ee2-98b90249dd18" containerName="maas-api"
Jul 19 15:17:21.747206 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.747137    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c0a3de2-f06b-4cdb-9ee2-98b90249dd18" containerName="maas-api"
Jul 19 15:17:21.747206 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.747154    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6321e7e-7e8c-486e-a344-dc316a5f76d6" containerName="maas-api"
Jul 19 15:17:21.747206 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.747159    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6321e7e-7e8c-486e-a344-dc316a5f76d6" containerName="maas-api"
Jul 19 15:17:21.747374 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.747243    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c0a3de2-f06b-4cdb-9ee2-98b90249dd18" containerName="maas-api"
Jul 19 15:17:21.747374 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.747253    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6321e7e-7e8c-486e-a344-dc316a5f76d6" containerName="maas-api"
Jul 19 15:17:21.751427 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.751405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:21.753864 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.753842    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b6c0bd-serving-cert\""
Jul 19 15:17:21.753995 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.753889    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 15:17:21.754113 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.754099    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 19 15:17:21.755033 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.755018    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-b4zp5\""
Jul 19 15:17:21.758519 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.758492    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"]
Jul 19 15:17:21.863783 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.863751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1889428b-4f89-4be0-ada3-7858da20b241-maas-api-tls\") pod \"maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd\" (UID: \"1889428b-4f89-4be0-ada3-7858da20b241\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:21.863783 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.863785    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xgqv\" (UniqueName: \"kubernetes.io/projected/1889428b-4f89-4be0-ada3-7858da20b241-kube-api-access-7xgqv\") pod \"maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd\" (UID: \"1889428b-4f89-4be0-ada3-7858da20b241\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:21.863995 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.863833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1889428b-4f89-4be0-ada3-7858da20b241-openshift-service-ca\") pod \"maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd\" (UID: \"1889428b-4f89-4be0-ada3-7858da20b241\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:21.965142 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.965101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1889428b-4f89-4be0-ada3-7858da20b241-maas-api-tls\") pod \"maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd\" (UID: \"1889428b-4f89-4be0-ada3-7858da20b241\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:21.965142 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.965145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xgqv\" (UniqueName: \"kubernetes.io/projected/1889428b-4f89-4be0-ada3-7858da20b241-kube-api-access-7xgqv\") pod \"maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd\" (UID: \"1889428b-4f89-4be0-ada3-7858da20b241\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:21.965422 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.965243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1889428b-4f89-4be0-ada3-7858da20b241-openshift-service-ca\") pod \"maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd\" (UID: \"1889428b-4f89-4be0-ada3-7858da20b241\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:21.965422 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:17:21.965316    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-serving-cert: secret "maas-api-e2e-api-a-b6c0bd-serving-cert" not found
Jul 19 15:17:21.965422 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:17:21.965404    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1889428b-4f89-4be0-ada3-7858da20b241-maas-api-tls podName:1889428b-4f89-4be0-ada3-7858da20b241 nodeName:}" failed. No retries permitted until 2026-07-19 15:17:22.465385936 +0000 UTC m=+2452.857948300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1889428b-4f89-4be0-ada3-7858da20b241-maas-api-tls") pod "maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd" (UID: "1889428b-4f89-4be0-ada3-7858da20b241") : secret "maas-api-e2e-api-a-b6c0bd-serving-cert" not found
Jul 19 15:17:21.966015 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.965991    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1889428b-4f89-4be0-ada3-7858da20b241-openshift-service-ca\") pod \"maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd\" (UID: \"1889428b-4f89-4be0-ada3-7858da20b241\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:21.977138 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:21.977104    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xgqv\" (UniqueName: \"kubernetes.io/projected/1889428b-4f89-4be0-ada3-7858da20b241-kube-api-access-7xgqv\") pod \"maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd\" (UID: \"1889428b-4f89-4be0-ada3-7858da20b241\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:22.470664 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.470620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1889428b-4f89-4be0-ada3-7858da20b241-maas-api-tls\") pod \"maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd\" (UID: \"1889428b-4f89-4be0-ada3-7858da20b241\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:22.473243 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.473216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1889428b-4f89-4be0-ada3-7858da20b241-maas-api-tls\") pod \"maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd\" (UID: \"1889428b-4f89-4be0-ada3-7858da20b241\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:22.663996 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.663964    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:22.809065 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.809013    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:17:22.810968 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.810947    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"]
Jul 19 15:17:22.812888 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:17:22.812862    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1889428b_4f89_4be0_ada3_7858da20b241.slice/crio-080cbeaff3aa185a641ecf3d333fb3ed3f96f78c701cfe615ec1266c35549c1c WatchSource:0}: Error finding container 080cbeaff3aa185a641ecf3d333fb3ed3f96f78c701cfe615ec1266c35549c1c: Status 404 returned error can't find the container with id 080cbeaff3aa185a641ecf3d333fb3ed3f96f78c701cfe615ec1266c35549c1c
Jul 19 15:17:22.814251 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.814233    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 15:17:22.874037 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.874008    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzgst\" (UniqueName: \"kubernetes.io/projected/c9c0bcbf-2722-4777-b356-6c2591f2739e-kube-api-access-mzgst\") pod \"c9c0bcbf-2722-4777-b356-6c2591f2739e\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") "
Jul 19 15:17:22.874241 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.874070    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-podinfo\") pod \"c9c0bcbf-2722-4777-b356-6c2591f2739e\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") "
Jul 19 15:17:22.874241 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.874091    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-credential-socket\") pod \"c9c0bcbf-2722-4777-b356-6c2591f2739e\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") "
Jul 19 15:17:22.874241 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.874114    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-token\") pod \"c9c0bcbf-2722-4777-b356-6c2591f2739e\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") "
Jul 19 15:17:22.874241 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.874151    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-envoy\") pod \"c9c0bcbf-2722-4777-b356-6c2591f2739e\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") "
Jul 19 15:17:22.874241 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.874209    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-workload-socket\") pod \"c9c0bcbf-2722-4777-b356-6c2591f2739e\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") "
Jul 19 15:17:22.874241 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.874233    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-workload-certs\") pod \"c9c0bcbf-2722-4777-b356-6c2591f2739e\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") "
Jul 19 15:17:22.874575 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.874257    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9c0bcbf-2722-4777-b356-6c2591f2739e-istiod-ca-cert\") pod \"c9c0bcbf-2722-4777-b356-6c2591f2739e\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") "
Jul 19 15:17:22.874575 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.874286    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-data\") pod \"c9c0bcbf-2722-4777-b356-6c2591f2739e\" (UID: \"c9c0bcbf-2722-4777-b356-6c2591f2739e\") "
Jul 19 15:17:22.876160 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.874941    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c9c0bcbf-2722-4777-b356-6c2591f2739e" (UID: "c9c0bcbf-2722-4777-b356-6c2591f2739e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:17:22.876160 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.874542    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c9c0bcbf-2722-4777-b356-6c2591f2739e" (UID: "c9c0bcbf-2722-4777-b356-6c2591f2739e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:17:22.876160 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.875250    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c9c0bcbf-2722-4777-b356-6c2591f2739e" (UID: "c9c0bcbf-2722-4777-b356-6c2591f2739e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:17:22.876160 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.875301    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:22.876160 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.876088    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-data" (OuterVolumeSpecName: "istio-data") pod "c9c0bcbf-2722-4777-b356-6c2591f2739e" (UID: "c9c0bcbf-2722-4777-b356-6c2591f2739e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:17:22.876679 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.876641    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9c0bcbf-2722-4777-b356-6c2591f2739e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c9c0bcbf-2722-4777-b356-6c2591f2739e" (UID: "c9c0bcbf-2722-4777-b356-6c2591f2739e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:17:22.876679 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.876655    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c9c0bcbf-2722-4777-b356-6c2591f2739e" (UID: "c9c0bcbf-2722-4777-b356-6c2591f2739e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 15:17:22.877242 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.876957    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9c0bcbf-2722-4777-b356-6c2591f2739e" (UID: "c9c0bcbf-2722-4777-b356-6c2591f2739e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:17:22.877339 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.877275    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c9c0bcbf-2722-4777-b356-6c2591f2739e" (UID: "c9c0bcbf-2722-4777-b356-6c2591f2739e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:17:22.882585 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.882555    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9c0bcbf-2722-4777-b356-6c2591f2739e-kube-api-access-mzgst" (OuterVolumeSpecName: "kube-api-access-mzgst") pod "c9c0bcbf-2722-4777-b356-6c2591f2739e" (UID: "c9c0bcbf-2722-4777-b356-6c2591f2739e"). InnerVolumeSpecName "kube-api-access-mzgst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:17:22.976080 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.976045    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:22.976289 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.976087    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:22.976289 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.976101    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9c0bcbf-2722-4777-b356-6c2591f2739e-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:22.976289 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.976114    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:22.976289 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.976127    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzgst\" (UniqueName: \"kubernetes.io/projected/c9c0bcbf-2722-4777-b356-6c2591f2739e-kube-api-access-mzgst\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:22.976289 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.976141    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:22.976289 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.976154    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:22.976289 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:22.976165    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9c0bcbf-2722-4777-b356-6c2591f2739e-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:23.250359 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:23.250326    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd" event={"ID":"1889428b-4f89-4be0-ada3-7858da20b241","Type":"ContainerStarted","Data":"080cbeaff3aa185a641ecf3d333fb3ed3f96f78c701cfe615ec1266c35549c1c"}
Jul 19 15:17:23.251844 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:23.251820    2581 generic.go:356] "Generic (PLEG): container finished" podID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerID="f6395431e3fd0018da321bc9668dfc8a7b0e95f41c7ca2371157abadb76dcd58" exitCode=0
Jul 19 15:17:23.251960 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:23.251863    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv" event={"ID":"c9c0bcbf-2722-4777-b356-6c2591f2739e","Type":"ContainerDied","Data":"f6395431e3fd0018da321bc9668dfc8a7b0e95f41c7ca2371157abadb76dcd58"}
Jul 19 15:17:23.251960 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:23.251878    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"
Jul 19 15:17:23.251960 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:23.251903    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv" event={"ID":"c9c0bcbf-2722-4777-b356-6c2591f2739e","Type":"ContainerDied","Data":"6473f9c2921fe9bee6a1b5674b0f2a1cec871dc7ccaedbcd5800359645fa8fad"}
Jul 19 15:17:23.251960 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:23.251926    2581 scope.go:117] "RemoveContainer" containerID="f6395431e3fd0018da321bc9668dfc8a7b0e95f41c7ca2371157abadb76dcd58"
Jul 19 15:17:23.261083 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:23.261057    2581 scope.go:117] "RemoveContainer" containerID="980463b756e918d9e48a11b8606a690e72e5f0a1035e257e8da0fb1f36d69f9f"
Jul 19 15:17:23.270092 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:23.270066    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"]
Jul 19 15:17:23.270942 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:23.270924    2581 scope.go:117] "RemoveContainer" containerID="f6395431e3fd0018da321bc9668dfc8a7b0e95f41c7ca2371157abadb76dcd58"
Jul 19 15:17:23.271261 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:17:23.271242    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6395431e3fd0018da321bc9668dfc8a7b0e95f41c7ca2371157abadb76dcd58\": container with ID starting with f6395431e3fd0018da321bc9668dfc8a7b0e95f41c7ca2371157abadb76dcd58 not found: ID does not exist" containerID="f6395431e3fd0018da321bc9668dfc8a7b0e95f41c7ca2371157abadb76dcd58"
Jul 19 15:17:23.271320 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:23.271271    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6395431e3fd0018da321bc9668dfc8a7b0e95f41c7ca2371157abadb76dcd58"} err="failed to get container status \"f6395431e3fd0018da321bc9668dfc8a7b0e95f41c7ca2371157abadb76dcd58\": rpc error: code = NotFound desc = could not find container \"f6395431e3fd0018da321bc9668dfc8a7b0e95f41c7ca2371157abadb76dcd58\": container with ID starting with f6395431e3fd0018da321bc9668dfc8a7b0e95f41c7ca2371157abadb76dcd58 not found: ID does not exist"
Jul 19 15:17:23.271320 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:23.271289    2581 scope.go:117] "RemoveContainer" containerID="980463b756e918d9e48a11b8606a690e72e5f0a1035e257e8da0fb1f36d69f9f"
Jul 19 15:17:23.272085 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:17:23.271627    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"980463b756e918d9e48a11b8606a690e72e5f0a1035e257e8da0fb1f36d69f9f\": container with ID starting with 980463b756e918d9e48a11b8606a690e72e5f0a1035e257e8da0fb1f36d69f9f not found: ID does not exist" containerID="980463b756e918d9e48a11b8606a690e72e5f0a1035e257e8da0fb1f36d69f9f"
Jul 19 15:17:23.272085 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:23.271660    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"980463b756e918d9e48a11b8606a690e72e5f0a1035e257e8da0fb1f36d69f9f"} err="failed to get container status \"980463b756e918d9e48a11b8606a690e72e5f0a1035e257e8da0fb1f36d69f9f\": rpc error: code = NotFound desc = could not find container \"980463b756e918d9e48a11b8606a690e72e5f0a1035e257e8da0fb1f36d69f9f\": container with ID starting with 980463b756e918d9e48a11b8606a690e72e5f0a1035e257e8da0fb1f36d69f9f not found: ID does not exist"
Jul 19 15:17:23.274366 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:23.274347    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-36dc1d-openshift-default-64757f76d9-qszpv"]
Jul 19 15:17:24.257742 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:24.257701    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd" event={"ID":"1889428b-4f89-4be0-ada3-7858da20b241","Type":"ContainerStarted","Data":"703ab3422effafff2fc7187ab9cd6c4ac3230234ad82320411b427db5631dea0"}
Jul 19 15:17:24.258241 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:24.257840    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:24.274562 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:24.274508    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd" podStartSLOduration=2.870688015 podStartE2EDuration="3.27449072s" totalImagesPullingTime="403.802705ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:17:24.272602466 +0000 UTC m=+2454.665164884" watchObservedRunningTime="2026-07-19 15:17:24.27449072 +0000 UTC m=+2454.667053106"
Jul 19 15:17:24.967360 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:24.967331    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9c0bcbf-2722-4777-b356-6c2591f2739e" path="/var/lib/kubelet/pods/c9c0bcbf-2722-4777-b356-6c2591f2739e/volumes"
Jul 19 15:17:26.969250 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:26.969217    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"]
Jul 19 15:17:26.969765 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:26.969746    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerName="istio-proxy"
Jul 19 15:17:26.969765 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:26.969766    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerName="istio-proxy"
Jul 19 15:17:26.969908 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:26.969826    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerName="istio-proxy"
Jul 19 15:17:26.969908 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:26.969834    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerName="istio-proxy"
Jul 19 15:17:26.973220 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:26.973197    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:26.975516 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:26.975493    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5a578a-openshift-default-dockercfg-4n96s\""
Jul 19 15:17:26.983899 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:26.983876    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"]
Jul 19 15:17:27.012251 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.012216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istiod-ca-cert\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.012605 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.012582    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-data\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.012907 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.012890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-workload-socket\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.013081 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.013065    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-credential-socket\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.013321 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.013300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-envoy\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.013518 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.013483    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prhsd\" (UniqueName: \"kubernetes.io/projected/0e9e1097-b761-499c-b074-83ac5f3fd7f8-kube-api-access-prhsd\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.013702 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.013688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-podinfo\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.013867 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.013851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-token\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.014044 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.014031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-workload-certs\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.115293 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.115254    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-workload-socket\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.115293 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.115293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-credential-socket\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.115574 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.115324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-envoy\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.115574 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.115439    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prhsd\" (UniqueName: \"kubernetes.io/projected/0e9e1097-b761-499c-b074-83ac5f3fd7f8-kube-api-access-prhsd\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.115574 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.115480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-podinfo\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.115574 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.115499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-token\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.115574 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.115535    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-workload-certs\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.115837 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.115580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istiod-ca-cert\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.115837 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.115616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-data\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.115837 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.115780    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-workload-socket\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.115837 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.115806    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-credential-socket\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.116110 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.116090    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-data\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.116169 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.116119    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-workload-certs\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.116356 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.116337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istiod-ca-cert\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.118164 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.118136    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-envoy\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.118306 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.118290    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-podinfo\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.123424 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.123394    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-token\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.123708 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.123686    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prhsd\" (UniqueName: \"kubernetes.io/projected/0e9e1097-b761-499c-b074-83ac5f3fd7f8-kube-api-access-prhsd\") pod \"e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") " pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.283759 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.283666    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:27.422572 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.422538    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"]
Jul 19 15:17:27.426538 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:17:27.426505    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9e1097_b761_499c_b074_83ac5f3fd7f8.slice/crio-1fc7998891002de807340179d63c39bb03c9595a045e447f75be45db948ac337 WatchSource:0}: Error finding container 1fc7998891002de807340179d63c39bb03c9595a045e447f75be45db948ac337: Status 404 returned error can't find the container with id 1fc7998891002de807340179d63c39bb03c9595a045e447f75be45db948ac337
Jul 19 15:17:27.428572 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.428533    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:17:27.428629 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.428609    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:17:27.428667 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:27.428636    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:17:28.280095 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:28.280057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4" event={"ID":"0e9e1097-b761-499c-b074-83ac5f3fd7f8","Type":"ContainerStarted","Data":"eee2e71691806e11861efc7fbc32aeb145f545dad8bed21d90da028f49f07a13"}
Jul 19 15:17:28.280503 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:28.280114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4" event={"ID":"0e9e1097-b761-499c-b074-83ac5f3fd7f8","Type":"ContainerStarted","Data":"1fc7998891002de807340179d63c39bb03c9595a045e447f75be45db948ac337"}
Jul 19 15:17:28.284116 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:28.284093    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:28.289056 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:28.289033    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:28.301222 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:28.301159    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4" podStartSLOduration=2.301143697 podStartE2EDuration="2.301143697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:17:28.299617132 +0000 UTC m=+2458.692179516" watchObservedRunningTime="2026-07-19 15:17:28.301143697 +0000 UTC m=+2458.693706081"
Jul 19 15:17:29.284398 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:29.284370    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:29.285421 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:29.285405    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:30.268296 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.268269    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:30.600557 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.600465    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"]
Jul 19 15:17:30.601268 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.601060    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerName="istio-proxy"
Jul 19 15:17:30.601268 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.601086    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9c0bcbf-2722-4777-b356-6c2591f2739e" containerName="istio-proxy"
Jul 19 15:17:30.604168 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.604143    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:30.606607 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.606585    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-5a578a-serving-cert\""
Jul 19 15:17:30.613451 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.613421    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"]
Jul 19 15:17:30.649107 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.649071    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-maas-api-tls\") pod \"maas-api-e2e-api-b-5a578a-58f584555f-4n5s8\" (UID: \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:30.649107 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.649108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7tt6\" (UniqueName: \"kubernetes.io/projected/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-kube-api-access-r7tt6\") pod \"maas-api-e2e-api-b-5a578a-58f584555f-4n5s8\" (UID: \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:30.649362 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.649216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-openshift-service-ca\") pod \"maas-api-e2e-api-b-5a578a-58f584555f-4n5s8\" (UID: \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:30.749782 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.749741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-maas-api-tls\") pod \"maas-api-e2e-api-b-5a578a-58f584555f-4n5s8\" (UID: \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:30.749782 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.749789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7tt6\" (UniqueName: \"kubernetes.io/projected/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-kube-api-access-r7tt6\") pod \"maas-api-e2e-api-b-5a578a-58f584555f-4n5s8\" (UID: \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:30.750016 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.749840    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-openshift-service-ca\") pod \"maas-api-e2e-api-b-5a578a-58f584555f-4n5s8\" (UID: \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:30.750016 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:17:30.749898    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-serving-cert: secret "maas-api-e2e-api-b-5a578a-serving-cert" not found
Jul 19 15:17:30.750016 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:17:30.749964    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-maas-api-tls podName:e9425e1b-ecab-4f0a-b807-e74a59a6a3d6 nodeName:}" failed. No retries permitted until 2026-07-19 15:17:31.249947501 +0000 UTC m=+2461.642509864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-maas-api-tls") pod "maas-api-e2e-api-b-5a578a-58f584555f-4n5s8" (UID: "e9425e1b-ecab-4f0a-b807-e74a59a6a3d6") : secret "maas-api-e2e-api-b-5a578a-serving-cert" not found
Jul 19 15:17:30.750508 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.750490    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-openshift-service-ca\") pod \"maas-api-e2e-api-b-5a578a-58f584555f-4n5s8\" (UID: \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:30.757951 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:30.757927    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7tt6\" (UniqueName: \"kubernetes.io/projected/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-kube-api-access-r7tt6\") pod \"maas-api-e2e-api-b-5a578a-58f584555f-4n5s8\" (UID: \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:31.255008 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:31.254965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-maas-api-tls\") pod \"maas-api-e2e-api-b-5a578a-58f584555f-4n5s8\" (UID: \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:31.257508 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:31.257474    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-maas-api-tls\") pod \"maas-api-e2e-api-b-5a578a-58f584555f-4n5s8\" (UID: \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:31.516959 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:31.516927    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:31.655026 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:31.655002    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"]
Jul 19 15:17:31.657090 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:17:31.657059    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9425e1b_ecab_4f0a_b807_e74a59a6a3d6.slice/crio-b352c3671b9cd0f82e4a47ca1f12a880d52cfdaa26d72de8c57a049025d88232 WatchSource:0}: Error finding container b352c3671b9cd0f82e4a47ca1f12a880d52cfdaa26d72de8c57a049025d88232: Status 404 returned error can't find the container with id b352c3671b9cd0f82e4a47ca1f12a880d52cfdaa26d72de8c57a049025d88232
Jul 19 15:17:32.299978 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:32.299943    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8" event={"ID":"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6","Type":"ContainerStarted","Data":"b14660119d92106d5595fa78eb2c6c573f3d15b338bbd805a488de7beeff558d"}
Jul 19 15:17:32.300159 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:32.300005    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8" event={"ID":"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6","Type":"ContainerStarted","Data":"b352c3671b9cd0f82e4a47ca1f12a880d52cfdaa26d72de8c57a049025d88232"}
Jul 19 15:17:32.300159 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:32.300033    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:32.318757 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:32.318708    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8" podStartSLOduration=2.035125955 podStartE2EDuration="2.318690889s" totalImagesPullingTime="283.564934ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:17:32.316630512 +0000 UTC m=+2462.709192896" watchObservedRunningTime="2026-07-19 15:17:32.318690889 +0000 UTC m=+2462.711253274"
Jul 19 15:17:38.309063 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:38.309035    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:17:45.325427 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:45.325379    2581 patch_prober.go:28] interesting pod/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 19 15:17:45.325816 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:45.325455    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4" podUID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 19 15:17:47.377602 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:47.377569    2581 generic.go:356] "Generic (PLEG): container finished" podID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerID="eee2e71691806e11861efc7fbc32aeb145f545dad8bed21d90da028f49f07a13" exitCode=0
Jul 19 15:17:47.378082 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:47.377609    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4" event={"ID":"0e9e1097-b761-499c-b074-83ac5f3fd7f8","Type":"ContainerDied","Data":"eee2e71691806e11861efc7fbc32aeb145f545dad8bed21d90da028f49f07a13"}
Jul 19 15:17:47.378082 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:47.377998    2581 scope.go:117] "RemoveContainer" containerID="eee2e71691806e11861efc7fbc32aeb145f545dad8bed21d90da028f49f07a13"
Jul 19 15:17:47.378967 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:47.378936    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:17:47.379053 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:47.379006    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:17:47.379053 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:47.379042    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:17:48.384605 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:48.384567    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4" event={"ID":"0e9e1097-b761-499c-b074-83ac5f3fd7f8","Type":"ContainerStarted","Data":"e84e3c2c67d6281763f797510630b1e14ffdce4d7560d79406eaac63529fa120"}
Jul 19 15:17:49.284812 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:49.284764    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:49.285038 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:49.285015    2581 patch_prober.go:28] interesting pod/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 19 15:17:49.285096 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:49.285076    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4" podUID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 19 15:17:50.284835 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:50.284795    2581 patch_prober.go:28] interesting pod/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 19 15:17:50.285261 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:50.284867    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4" podUID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 19 15:17:51.284500 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:51.284453    2581 patch_prober.go:28] interesting pod/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 19 15:17:51.284685 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:51.284513    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4" podUID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 19 15:17:52.287773 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:52.287742    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:52.288212 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:52.288084    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:52.288829 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:52.288804    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:17:58.645945 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:58.645902    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"]
Jul 19 15:17:58.646396 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:58.646157    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd" podUID="1889428b-4f89-4be0-ada3-7858da20b241" containerName="maas-api" containerID="cri-o://703ab3422effafff2fc7187ab9cd6c4ac3230234ad82320411b427db5631dea0" gracePeriod=30
Jul 19 15:17:58.897164 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:58.897093    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:58.909906 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:58.909846    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1889428b-4f89-4be0-ada3-7858da20b241-maas-api-tls\") pod \"1889428b-4f89-4be0-ada3-7858da20b241\" (UID: \"1889428b-4f89-4be0-ada3-7858da20b241\") "
Jul 19 15:17:58.909906 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:58.909914    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1889428b-4f89-4be0-ada3-7858da20b241-openshift-service-ca\") pod \"1889428b-4f89-4be0-ada3-7858da20b241\" (UID: \"1889428b-4f89-4be0-ada3-7858da20b241\") "
Jul 19 15:17:58.910209 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:58.909951    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xgqv\" (UniqueName: \"kubernetes.io/projected/1889428b-4f89-4be0-ada3-7858da20b241-kube-api-access-7xgqv\") pod \"1889428b-4f89-4be0-ada3-7858da20b241\" (UID: \"1889428b-4f89-4be0-ada3-7858da20b241\") "
Jul 19 15:17:58.910320 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:58.910293    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1889428b-4f89-4be0-ada3-7858da20b241-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1889428b-4f89-4be0-ada3-7858da20b241" (UID: "1889428b-4f89-4be0-ada3-7858da20b241"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:17:58.912725 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:58.912690    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1889428b-4f89-4be0-ada3-7858da20b241-kube-api-access-7xgqv" (OuterVolumeSpecName: "kube-api-access-7xgqv") pod "1889428b-4f89-4be0-ada3-7858da20b241" (UID: "1889428b-4f89-4be0-ada3-7858da20b241"). InnerVolumeSpecName "kube-api-access-7xgqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:17:58.913340 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:58.913303    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1889428b-4f89-4be0-ada3-7858da20b241-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1889428b-4f89-4be0-ada3-7858da20b241" (UID: "1889428b-4f89-4be0-ada3-7858da20b241"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 15:17:59.010743 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:59.010694    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1889428b-4f89-4be0-ada3-7858da20b241-maas-api-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:59.010743 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:59.010741    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1889428b-4f89-4be0-ada3-7858da20b241-openshift-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:59.010743 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:59.010755    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xgqv\" (UniqueName: \"kubernetes.io/projected/1889428b-4f89-4be0-ada3-7858da20b241-kube-api-access-7xgqv\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:17:59.437354 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:59.437301    2581 generic.go:356] "Generic (PLEG): container finished" podID="1889428b-4f89-4be0-ada3-7858da20b241" containerID="703ab3422effafff2fc7187ab9cd6c4ac3230234ad82320411b427db5631dea0" exitCode=0
Jul 19 15:17:59.437527 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:59.437371    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"
Jul 19 15:17:59.437527 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:59.437387    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd" event={"ID":"1889428b-4f89-4be0-ada3-7858da20b241","Type":"ContainerDied","Data":"703ab3422effafff2fc7187ab9cd6c4ac3230234ad82320411b427db5631dea0"}
Jul 19 15:17:59.437527 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:59.437483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd" event={"ID":"1889428b-4f89-4be0-ada3-7858da20b241","Type":"ContainerDied","Data":"080cbeaff3aa185a641ecf3d333fb3ed3f96f78c701cfe615ec1266c35549c1c"}
Jul 19 15:17:59.437527 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:59.437515    2581 scope.go:117] "RemoveContainer" containerID="703ab3422effafff2fc7187ab9cd6c4ac3230234ad82320411b427db5631dea0"
Jul 19 15:17:59.446642 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:59.446621    2581 scope.go:117] "RemoveContainer" containerID="703ab3422effafff2fc7187ab9cd6c4ac3230234ad82320411b427db5631dea0"
Jul 19 15:17:59.446928 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:17:59.446907    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"703ab3422effafff2fc7187ab9cd6c4ac3230234ad82320411b427db5631dea0\": container with ID starting with 703ab3422effafff2fc7187ab9cd6c4ac3230234ad82320411b427db5631dea0 not found: ID does not exist" containerID="703ab3422effafff2fc7187ab9cd6c4ac3230234ad82320411b427db5631dea0"
Jul 19 15:17:59.446994 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:59.446937    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"703ab3422effafff2fc7187ab9cd6c4ac3230234ad82320411b427db5631dea0"} err="failed to get container status \"703ab3422effafff2fc7187ab9cd6c4ac3230234ad82320411b427db5631dea0\": rpc error: code = NotFound desc = could not find container \"703ab3422effafff2fc7187ab9cd6c4ac3230234ad82320411b427db5631dea0\": container with ID starting with 703ab3422effafff2fc7187ab9cd6c4ac3230234ad82320411b427db5631dea0 not found: ID does not exist"
Jul 19 15:17:59.454267 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:59.454236    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"]
Jul 19 15:17:59.457194 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:17:59.457145    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b6c0bd-59445899fb-l8svd"]
Jul 19 15:18:00.967860 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:00.967828    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1889428b-4f89-4be0-ada3-7858da20b241" path="/var/lib/kubelet/pods/1889428b-4f89-4be0-ada3-7858da20b241/volumes"
Jul 19 15:18:24.867730 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:24.867655    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"]
Jul 19 15:18:24.868238 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:24.867856    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8" podUID="e9425e1b-ecab-4f0a-b807-e74a59a6a3d6" containerName="maas-api" containerID="cri-o://b14660119d92106d5595fa78eb2c6c573f3d15b338bbd805a488de7beeff558d" gracePeriod=30
Jul 19 15:18:25.118880 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.118820    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:18:25.249804 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.249764    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7tt6\" (UniqueName: \"kubernetes.io/projected/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-kube-api-access-r7tt6\") pod \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\" (UID: \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\") "
Jul 19 15:18:25.250004 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.249820    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-maas-api-tls\") pod \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\" (UID: \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\") "
Jul 19 15:18:25.250004 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.249847    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-openshift-service-ca\") pod \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\" (UID: \"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6\") "
Jul 19 15:18:25.250337 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.250305    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e9425e1b-ecab-4f0a-b807-e74a59a6a3d6" (UID: "e9425e1b-ecab-4f0a-b807-e74a59a6a3d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:18:25.251953 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.251931    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e9425e1b-ecab-4f0a-b807-e74a59a6a3d6" (UID: "e9425e1b-ecab-4f0a-b807-e74a59a6a3d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 15:18:25.252040 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.251994    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-kube-api-access-r7tt6" (OuterVolumeSpecName: "kube-api-access-r7tt6") pod "e9425e1b-ecab-4f0a-b807-e74a59a6a3d6" (UID: "e9425e1b-ecab-4f0a-b807-e74a59a6a3d6"). InnerVolumeSpecName "kube-api-access-r7tt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:18:25.351418 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.351368    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7tt6\" (UniqueName: \"kubernetes.io/projected/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-kube-api-access-r7tt6\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:18:25.351418 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.351410    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-maas-api-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:18:25.351418 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.351420    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6-openshift-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:18:25.558231 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.558194    2581 generic.go:356] "Generic (PLEG): container finished" podID="e9425e1b-ecab-4f0a-b807-e74a59a6a3d6" containerID="b14660119d92106d5595fa78eb2c6c573f3d15b338bbd805a488de7beeff558d" exitCode=0
Jul 19 15:18:25.558416 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.558237    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"
Jul 19 15:18:25.558416 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.558276    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8" event={"ID":"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6","Type":"ContainerDied","Data":"b14660119d92106d5595fa78eb2c6c573f3d15b338bbd805a488de7beeff558d"}
Jul 19 15:18:25.558416 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.558330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8" event={"ID":"e9425e1b-ecab-4f0a-b807-e74a59a6a3d6","Type":"ContainerDied","Data":"b352c3671b9cd0f82e4a47ca1f12a880d52cfdaa26d72de8c57a049025d88232"}
Jul 19 15:18:25.558416 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.558353    2581 scope.go:117] "RemoveContainer" containerID="b14660119d92106d5595fa78eb2c6c573f3d15b338bbd805a488de7beeff558d"
Jul 19 15:18:25.567964 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.567945    2581 scope.go:117] "RemoveContainer" containerID="b14660119d92106d5595fa78eb2c6c573f3d15b338bbd805a488de7beeff558d"
Jul 19 15:18:25.568231 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:18:25.568205    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b14660119d92106d5595fa78eb2c6c573f3d15b338bbd805a488de7beeff558d\": container with ID starting with b14660119d92106d5595fa78eb2c6c573f3d15b338bbd805a488de7beeff558d not found: ID does not exist" containerID="b14660119d92106d5595fa78eb2c6c573f3d15b338bbd805a488de7beeff558d"
Jul 19 15:18:25.568291 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.568237    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14660119d92106d5595fa78eb2c6c573f3d15b338bbd805a488de7beeff558d"} err="failed to get container status \"b14660119d92106d5595fa78eb2c6c573f3d15b338bbd805a488de7beeff558d\": rpc error: code = NotFound desc = could not find container \"b14660119d92106d5595fa78eb2c6c573f3d15b338bbd805a488de7beeff558d\": container with ID starting with b14660119d92106d5595fa78eb2c6c573f3d15b338bbd805a488de7beeff558d not found: ID does not exist"
Jul 19 15:18:25.578426 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.578404    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"]
Jul 19 15:18:25.582767 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:25.582746    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5a578a-58f584555f-4n5s8"]
Jul 19 15:18:26.967462 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:26.967428    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9425e1b-ecab-4f0a-b807-e74a59a6a3d6" path="/var/lib/kubelet/pods/e9425e1b-ecab-4f0a-b807-e74a59a6a3d6/volumes"
Jul 19 15:18:31.200227 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:31.200171    2581 scope.go:117] "RemoveContainer" containerID="30152eb6d712e1b3661db5d0b3fab6dd0932079c2ca1a7f44647ea26bade7f09"
Jul 19 15:18:35.945470 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:35.945435    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"]
Jul 19 15:18:35.945876 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:35.945667    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4" podUID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerName="istio-proxy" containerID="cri-o://e84e3c2c67d6281763f797510630b1e14ffdce4d7560d79406eaac63529fa120" gracePeriod=30
Jul 19 15:18:37.291173 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:37.291132    2581 patch_prober.go:28] interesting pod/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 19 15:18:37.291652 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:37.291215    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4" podUID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 19 15:18:40.392452 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.392419    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"]
Jul 19 15:18:40.392844 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.392765    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9425e1b-ecab-4f0a-b807-e74a59a6a3d6" containerName="maas-api"
Jul 19 15:18:40.392844 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.392777    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9425e1b-ecab-4f0a-b807-e74a59a6a3d6" containerName="maas-api"
Jul 19 15:18:40.392844 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.392801    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1889428b-4f89-4be0-ada3-7858da20b241" containerName="maas-api"
Jul 19 15:18:40.392844 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.392808    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1889428b-4f89-4be0-ada3-7858da20b241" containerName="maas-api"
Jul 19 15:18:40.392983 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.392870    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9425e1b-ecab-4f0a-b807-e74a59a6a3d6" containerName="maas-api"
Jul 19 15:18:40.392983 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.392882    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1889428b-4f89-4be0-ada3-7858da20b241" containerName="maas-api"
Jul 19 15:18:40.395564 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.395548    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:18:40.398440 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.398414    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-7679e0-serving-cert\""
Jul 19 15:18:40.398571 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.398535    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 15:18:40.398804 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.398787    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 19 15:18:40.399508 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.399491    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-b4zp5\""
Jul 19 15:18:40.422477 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.422444    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"]
Jul 19 15:18:40.479699 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.479661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53047104-c426-4439-9342-802e50d21162-maas-api-tls\") pod \"maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d\" (UID: \"53047104-c426-4439-9342-802e50d21162\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:18:40.479882 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.479757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53047104-c426-4439-9342-802e50d21162-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d\" (UID: \"53047104-c426-4439-9342-802e50d21162\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:18:40.479882 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.479825    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf7fq\" (UniqueName: \"kubernetes.io/projected/53047104-c426-4439-9342-802e50d21162-kube-api-access-gf7fq\") pod \"maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d\" (UID: \"53047104-c426-4439-9342-802e50d21162\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:18:40.580890 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.580853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53047104-c426-4439-9342-802e50d21162-maas-api-tls\") pod \"maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d\" (UID: \"53047104-c426-4439-9342-802e50d21162\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:18:40.581076 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.580922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53047104-c426-4439-9342-802e50d21162-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d\" (UID: \"53047104-c426-4439-9342-802e50d21162\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:18:40.581076 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.580968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf7fq\" (UniqueName: \"kubernetes.io/projected/53047104-c426-4439-9342-802e50d21162-kube-api-access-gf7fq\") pod \"maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d\" (UID: \"53047104-c426-4439-9342-802e50d21162\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:18:40.581709 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.581687    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53047104-c426-4439-9342-802e50d21162-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d\" (UID: \"53047104-c426-4439-9342-802e50d21162\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:18:40.583382 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.583359    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53047104-c426-4439-9342-802e50d21162-maas-api-tls\") pod \"maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d\" (UID: \"53047104-c426-4439-9342-802e50d21162\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:18:40.590784 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.590752    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf7fq\" (UniqueName: \"kubernetes.io/projected/53047104-c426-4439-9342-802e50d21162-kube-api-access-gf7fq\") pod \"maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d\" (UID: \"53047104-c426-4439-9342-802e50d21162\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:18:40.706683 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.706586    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:18:40.840729 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:40.840679    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"]
Jul 19 15:18:40.842971 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:18:40.842941    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53047104_c426_4439_9342_802e50d21162.slice/crio-23168c8e372bf32d5a480918789e9cf7a28f9564a86e813dfddf578a594e0b58 WatchSource:0}: Error finding container 23168c8e372bf32d5a480918789e9cf7a28f9564a86e813dfddf578a594e0b58: Status 404 returned error can't find the container with id 23168c8e372bf32d5a480918789e9cf7a28f9564a86e813dfddf578a594e0b58
Jul 19 15:18:41.195248 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.195223    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:18:41.287106 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.287071    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-token\") pod \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") "
Jul 19 15:18:41.287330 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.287141    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-data\") pod \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") "
Jul 19 15:18:41.287330 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.287156    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-workload-certs\") pod \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") "
Jul 19 15:18:41.287330 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.287228    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istiod-ca-cert\") pod \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") "
Jul 19 15:18:41.287330 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.287260    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-workload-socket\") pod \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") "
Jul 19 15:18:41.287330 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.287302    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-podinfo\") pod \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") "
Jul 19 15:18:41.287330 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.287328    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-credential-socket\") pod \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") "
Jul 19 15:18:41.287647 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.287367    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-envoy\") pod \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") "
Jul 19 15:18:41.287647 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.287390    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prhsd\" (UniqueName: \"kubernetes.io/projected/0e9e1097-b761-499c-b074-83ac5f3fd7f8-kube-api-access-prhsd\") pod \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\" (UID: \"0e9e1097-b761-499c-b074-83ac5f3fd7f8\") "
Jul 19 15:18:41.287647 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.287499    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0e9e1097-b761-499c-b074-83ac5f3fd7f8" (UID: "0e9e1097-b761-499c-b074-83ac5f3fd7f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:18:41.287793 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.287724    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:18:41.287849 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.287825    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0e9e1097-b761-499c-b074-83ac5f3fd7f8" (UID: "0e9e1097-b761-499c-b074-83ac5f3fd7f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:18:41.288066 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.288042    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0e9e1097-b761-499c-b074-83ac5f3fd7f8" (UID: "0e9e1097-b761-499c-b074-83ac5f3fd7f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:18:41.288143 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.288060    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "0e9e1097-b761-499c-b074-83ac5f3fd7f8" (UID: "0e9e1097-b761-499c-b074-83ac5f3fd7f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:18:41.288143 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.288103    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0e9e1097-b761-499c-b074-83ac5f3fd7f8" (UID: "0e9e1097-b761-499c-b074-83ac5f3fd7f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:18:41.289548 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.289522    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "0e9e1097-b761-499c-b074-83ac5f3fd7f8" (UID: "0e9e1097-b761-499c-b074-83ac5f3fd7f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:18:41.289620 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.289528    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9e1097-b761-499c-b074-83ac5f3fd7f8-kube-api-access-prhsd" (OuterVolumeSpecName: "kube-api-access-prhsd") pod "0e9e1097-b761-499c-b074-83ac5f3fd7f8" (UID: "0e9e1097-b761-499c-b074-83ac5f3fd7f8"). InnerVolumeSpecName "kube-api-access-prhsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:18:41.289814 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.289770    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0e9e1097-b761-499c-b074-83ac5f3fd7f8" (UID: "0e9e1097-b761-499c-b074-83ac5f3fd7f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:18:41.289814 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.289776    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0e9e1097-b761-499c-b074-83ac5f3fd7f8" (UID: "0e9e1097-b761-499c-b074-83ac5f3fd7f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 15:18:41.389117 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.389083    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:18:41.389117 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.389114    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:18:41.389117 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.389124    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:18:41.389384 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.389132    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:18:41.389384 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.389142    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:18:41.389384 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.389152    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:18:41.389384 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.389161    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prhsd\" (UniqueName: \"kubernetes.io/projected/0e9e1097-b761-499c-b074-83ac5f3fd7f8-kube-api-access-prhsd\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:18:41.389384 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.389170    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e9e1097-b761-499c-b074-83ac5f3fd7f8-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:18:41.637748 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.637712    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d" event={"ID":"53047104-c426-4439-9342-802e50d21162","Type":"ContainerStarted","Data":"a776f69860bc38e2f20da5ccae642a828aa0fff205700157f5becad6b07f3963"}
Jul 19 15:18:41.638206 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.637774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d" event={"ID":"53047104-c426-4439-9342-802e50d21162","Type":"ContainerStarted","Data":"23168c8e372bf32d5a480918789e9cf7a28f9564a86e813dfddf578a594e0b58"}
Jul 19 15:18:41.638206 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.637795    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:18:41.639382 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.639358    2581 generic.go:356] "Generic (PLEG): container finished" podID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerID="e84e3c2c67d6281763f797510630b1e14ffdce4d7560d79406eaac63529fa120" exitCode=0
Jul 19 15:18:41.639503 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.639394    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"
Jul 19 15:18:41.639503 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.639419    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4" event={"ID":"0e9e1097-b761-499c-b074-83ac5f3fd7f8","Type":"ContainerDied","Data":"e84e3c2c67d6281763f797510630b1e14ffdce4d7560d79406eaac63529fa120"}
Jul 19 15:18:41.639503 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.639469    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4" event={"ID":"0e9e1097-b761-499c-b074-83ac5f3fd7f8","Type":"ContainerDied","Data":"1fc7998891002de807340179d63c39bb03c9595a045e447f75be45db948ac337"}
Jul 19 15:18:41.639503 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.639497    2581 scope.go:117] "RemoveContainer" containerID="e84e3c2c67d6281763f797510630b1e14ffdce4d7560d79406eaac63529fa120"
Jul 19 15:18:41.648797 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.648779    2581 scope.go:117] "RemoveContainer" containerID="eee2e71691806e11861efc7fbc32aeb145f545dad8bed21d90da028f49f07a13"
Jul 19 15:18:41.656233 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.656156    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d" podStartSLOduration=1.080452999 podStartE2EDuration="1.656141335s" totalImagesPullingTime="575.688336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:18:41.654011449 +0000 UTC m=+2532.046573837" watchObservedRunningTime="2026-07-19 15:18:41.656141335 +0000 UTC m=+2532.048703728"
Jul 19 15:18:41.657041 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.656995    2581 scope.go:117] "RemoveContainer" containerID="e84e3c2c67d6281763f797510630b1e14ffdce4d7560d79406eaac63529fa120"
Jul 19 15:18:41.657370 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:18:41.657342    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e84e3c2c67d6281763f797510630b1e14ffdce4d7560d79406eaac63529fa120\": container with ID starting with e84e3c2c67d6281763f797510630b1e14ffdce4d7560d79406eaac63529fa120 not found: ID does not exist" containerID="e84e3c2c67d6281763f797510630b1e14ffdce4d7560d79406eaac63529fa120"
Jul 19 15:18:41.657465 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.657381    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e84e3c2c67d6281763f797510630b1e14ffdce4d7560d79406eaac63529fa120"} err="failed to get container status \"e84e3c2c67d6281763f797510630b1e14ffdce4d7560d79406eaac63529fa120\": rpc error: code = NotFound desc = could not find container \"e84e3c2c67d6281763f797510630b1e14ffdce4d7560d79406eaac63529fa120\": container with ID starting with e84e3c2c67d6281763f797510630b1e14ffdce4d7560d79406eaac63529fa120 not found: ID does not exist"
Jul 19 15:18:41.657465 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.657404    2581 scope.go:117] "RemoveContainer" containerID="eee2e71691806e11861efc7fbc32aeb145f545dad8bed21d90da028f49f07a13"
Jul 19 15:18:41.657692 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:18:41.657671    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eee2e71691806e11861efc7fbc32aeb145f545dad8bed21d90da028f49f07a13\": container with ID starting with eee2e71691806e11861efc7fbc32aeb145f545dad8bed21d90da028f49f07a13 not found: ID does not exist" containerID="eee2e71691806e11861efc7fbc32aeb145f545dad8bed21d90da028f49f07a13"
Jul 19 15:18:41.657763 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.657701    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee2e71691806e11861efc7fbc32aeb145f545dad8bed21d90da028f49f07a13"} err="failed to get container status \"eee2e71691806e11861efc7fbc32aeb145f545dad8bed21d90da028f49f07a13\": rpc error: code = NotFound desc = could not find container \"eee2e71691806e11861efc7fbc32aeb145f545dad8bed21d90da028f49f07a13\": container with ID starting with eee2e71691806e11861efc7fbc32aeb145f545dad8bed21d90da028f49f07a13 not found: ID does not exist"
Jul 19 15:18:41.667644 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.667621    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"]
Jul 19 15:18:41.671057 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:41.671036    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5a578a-openshift-default-59584c5cbc-8wnd4"]
Jul 19 15:18:42.967852 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:42.967816    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" path="/var/lib/kubelet/pods/0e9e1097-b761-499c-b074-83ac5f3fd7f8/volumes"
Jul 19 15:18:45.419338 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.419306    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"]
Jul 19 15:18:45.419698 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.419628    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerName="istio-proxy"
Jul 19 15:18:45.419698 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.419638    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerName="istio-proxy"
Jul 19 15:18:45.419698 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.419657    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerName="istio-proxy"
Jul 19 15:18:45.419698 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.419664    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerName="istio-proxy"
Jul 19 15:18:45.419827 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.419714    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerName="istio-proxy"
Jul 19 15:18:45.424526 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.424500    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.426914 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.426888    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-3c4e71-openshift-default-dockercfg-jnm9m\""
Jul 19 15:18:45.435112 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.435079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"]
Jul 19 15:18:45.525680 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.525647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-workload-certs\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.525858 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.525689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-workload-socket\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.525858 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.525709    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-credential-socket\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.525858 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.525727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-token\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.525858 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.525813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-data\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.525858 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.525851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istiod-ca-cert\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.526027 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.525944    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj4sq\" (UniqueName: \"kubernetes.io/projected/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-kube-api-access-nj4sq\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.526027 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.525977    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-envoy\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.526027 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.526016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-podinfo\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.627216 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.627155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj4sq\" (UniqueName: \"kubernetes.io/projected/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-kube-api-access-nj4sq\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.627216 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.627214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-envoy\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.627482 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.627243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-podinfo\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.627482 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.627279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-workload-certs\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.627482 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.627301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-workload-socket\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.627482 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.627316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-credential-socket\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.627482 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.627433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-token\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.627736 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.627491    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-data\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.627736 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.627517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istiod-ca-cert\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.627736 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.627657    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-workload-socket\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.627896 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.627798    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-workload-certs\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.627896 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.627851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-data\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.627989 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.627900    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-credential-socket\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.628154 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.628137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istiod-ca-cert\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.629732 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.629703    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-envoy\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.629732 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.629721    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-podinfo\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.635106 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.635084    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-token\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.635487 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.635464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj4sq\" (UniqueName: \"kubernetes.io/projected/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-kube-api-access-nj4sq\") pod \"e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") " pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.738754 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.738722    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:45.875476 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.875447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"]
Jul 19 15:18:45.877465 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:18:45.877431    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b2aa2a8_ab5f_40cc_9a10_90156acaeb68.slice/crio-e0c3e699689163f3c49503620de60bd1a483f2bbeecc3d3adeb0c75ea2b889ab WatchSource:0}: Error finding container e0c3e699689163f3c49503620de60bd1a483f2bbeecc3d3adeb0c75ea2b889ab: Status 404 returned error can't find the container with id e0c3e699689163f3c49503620de60bd1a483f2bbeecc3d3adeb0c75ea2b889ab
Jul 19 15:18:45.879779 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.879747    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:18:45.879844 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.879831    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:18:45.879882 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:45.879870    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:18:46.665104 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:46.665068    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l" event={"ID":"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68","Type":"ContainerStarted","Data":"55add92b64e2c1203be2fc255203d62157df79258f230542c566362ed8f1603c"}
Jul 19 15:18:46.665562 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:46.665119    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l" event={"ID":"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68","Type":"ContainerStarted","Data":"e0c3e699689163f3c49503620de60bd1a483f2bbeecc3d3adeb0c75ea2b889ab"}
Jul 19 15:18:46.686414 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:46.686365    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l" podStartSLOduration=1.68634829 podStartE2EDuration="1.68634829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:18:46.6845478 +0000 UTC m=+2537.077110188" watchObservedRunningTime="2026-07-19 15:18:46.68634829 +0000 UTC m=+2537.078910675"
Jul 19 15:18:46.739835 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:46.739804    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:46.744309 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:46.744283    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:47.650517 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:47.650490    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:18:47.670112 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:47.670083    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:47.671125 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:47.671097    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:18:48.676302 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:48.676270    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"]
Jul 19 15:18:48.676753 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:48.676667    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e9e1097-b761-499c-b074-83ac5f3fd7f8" containerName="istio-proxy"
Jul 19 15:18:48.679978 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:48.679957    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:18:48.682345 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:48.682322    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-3c4e71-serving-cert\""
Jul 19 15:18:48.697635 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:48.697602    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"]
Jul 19 15:18:48.756569 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:48.756532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df4afb12-1c87-4067-97eb-37255c705833-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x\" (UID: \"df4afb12-1c87-4067-97eb-37255c705833\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:18:48.756798 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:48.756623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6c5\" (UniqueName: \"kubernetes.io/projected/df4afb12-1c87-4067-97eb-37255c705833-kube-api-access-qz6c5\") pod \"maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x\" (UID: \"df4afb12-1c87-4067-97eb-37255c705833\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:18:48.756798 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:48.756659    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df4afb12-1c87-4067-97eb-37255c705833-maas-api-tls\") pod \"maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x\" (UID: \"df4afb12-1c87-4067-97eb-37255c705833\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:18:48.857922 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:48.857882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df4afb12-1c87-4067-97eb-37255c705833-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x\" (UID: \"df4afb12-1c87-4067-97eb-37255c705833\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:18:48.858126 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:48.857959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6c5\" (UniqueName: \"kubernetes.io/projected/df4afb12-1c87-4067-97eb-37255c705833-kube-api-access-qz6c5\") pod \"maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x\" (UID: \"df4afb12-1c87-4067-97eb-37255c705833\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:18:48.858126 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:48.857989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df4afb12-1c87-4067-97eb-37255c705833-maas-api-tls\") pod \"maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x\" (UID: \"df4afb12-1c87-4067-97eb-37255c705833\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:18:48.858126 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:18:48.858114    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-serving-cert: secret "maas-api-e2e-shared-b-3c4e71-serving-cert" not found
Jul 19 15:18:48.858290 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:18:48.858207    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df4afb12-1c87-4067-97eb-37255c705833-maas-api-tls podName:df4afb12-1c87-4067-97eb-37255c705833 nodeName:}" failed. No retries permitted until 2026-07-19 15:18:49.358157051 +0000 UTC m=+2539.750719414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df4afb12-1c87-4067-97eb-37255c705833-maas-api-tls") pod "maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x" (UID: "df4afb12-1c87-4067-97eb-37255c705833") : secret "maas-api-e2e-shared-b-3c4e71-serving-cert" not found
Jul 19 15:18:48.858697 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:48.858673    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df4afb12-1c87-4067-97eb-37255c705833-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x\" (UID: \"df4afb12-1c87-4067-97eb-37255c705833\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:18:48.867158 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:48.867137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6c5\" (UniqueName: \"kubernetes.io/projected/df4afb12-1c87-4067-97eb-37255c705833-kube-api-access-qz6c5\") pod \"maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x\" (UID: \"df4afb12-1c87-4067-97eb-37255c705833\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:18:49.362397 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:49.362358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df4afb12-1c87-4067-97eb-37255c705833-maas-api-tls\") pod \"maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x\" (UID: \"df4afb12-1c87-4067-97eb-37255c705833\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:18:49.364984 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:49.364957    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df4afb12-1c87-4067-97eb-37255c705833-maas-api-tls\") pod \"maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x\" (UID: \"df4afb12-1c87-4067-97eb-37255c705833\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:18:49.600913 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:49.600871    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:18:49.747511 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:49.747474    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"]
Jul 19 15:18:49.750344 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:18:49.750316    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf4afb12_1c87_4067_97eb_37255c705833.slice/crio-7cdf2324ad38d5f23c079352155e74628ae43abaf13543470c9ed654db19b592 WatchSource:0}: Error finding container 7cdf2324ad38d5f23c079352155e74628ae43abaf13543470c9ed654db19b592: Status 404 returned error can't find the container with id 7cdf2324ad38d5f23c079352155e74628ae43abaf13543470c9ed654db19b592
Jul 19 15:18:50.689656 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:50.689622    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x" event={"ID":"df4afb12-1c87-4067-97eb-37255c705833","Type":"ContainerStarted","Data":"f927323d115c73828a4420141c04c804f49d258648d1ac236941da9e6e358eef"}
Jul 19 15:18:50.689832 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:50.689679    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x" event={"ID":"df4afb12-1c87-4067-97eb-37255c705833","Type":"ContainerStarted","Data":"7cdf2324ad38d5f23c079352155e74628ae43abaf13543470c9ed654db19b592"}
Jul 19 15:18:50.689832 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:50.689712    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:18:50.706144 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:50.706088    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x" podStartSLOduration=2.41196068 podStartE2EDuration="2.706073065s" totalImagesPullingTime="294.112385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:18:50.704746391 +0000 UTC m=+2541.097308785" watchObservedRunningTime="2026-07-19 15:18:50.706073065 +0000 UTC m=+2541.098635449"
Jul 19 15:18:56.701290 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:18:56.701258    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:19:00.744228 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:00.744197    2581 generic.go:356] "Generic (PLEG): container finished" podID="7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" containerID="55add92b64e2c1203be2fc255203d62157df79258f230542c566362ed8f1603c" exitCode=0
Jul 19 15:19:00.744696 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:00.744250    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l" event={"ID":"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68","Type":"ContainerDied","Data":"55add92b64e2c1203be2fc255203d62157df79258f230542c566362ed8f1603c"}
Jul 19 15:19:00.744696 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:00.744602    2581 scope.go:117] "RemoveContainer" containerID="55add92b64e2c1203be2fc255203d62157df79258f230542c566362ed8f1603c"
Jul 19 15:19:00.745576 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:00.745545    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:19:00.745675 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:00.745611    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:19:00.745675 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:00.745643    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 15:19:01.755158 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:01.755115    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l" event={"ID":"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68","Type":"ContainerStarted","Data":"f5e90f8eb6fbccf571ceb6c925398ac549943776a1ae9c38eb2f2330a1b54c54"}
Jul 19 15:19:02.670241 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:02.670198    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:19:02.739173 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:02.739131    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:19:02.740343 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:02.740321    2581 patch_prober.go:28] interesting pod/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 19 15:19:02.740403 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:02.740383    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l" podUID="7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 19 15:19:03.739974 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:03.739934    2581 patch_prober.go:28] interesting pod/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 19 15:19:03.740436 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:03.739994    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l" podUID="7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 19 15:19:04.739672 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:04.739633    2581 patch_prober.go:28] interesting pod/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 19 15:19:04.739859 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:04.739720    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l" podUID="7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 19 15:19:05.739707 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:05.739667    2581 patch_prober.go:28] interesting pod/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 19 15:19:05.740168 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:05.739726    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l" podUID="7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 19 15:19:06.743512 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:06.743477    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:19:06.744329 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:06.744311    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:19:31.225208 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:19:31.225147    2581 scope.go:117] "RemoveContainer" containerID="57e599e3f802f5a1effe060d2b27527b7014c7f107c5dd466c37a5a5258fd5b1"
Jul 19 15:25:33.166098 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.166059    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"]
Jul 19 15:25:33.166612 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.166364    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d" podUID="53047104-c426-4439-9342-802e50d21162" containerName="maas-api" containerID="cri-o://a776f69860bc38e2f20da5ccae642a828aa0fff205700157f5becad6b07f3963" gracePeriod=30
Jul 19 15:25:33.414323 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.414296    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:25:33.524632 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.524601    2581 generic.go:356] "Generic (PLEG): container finished" podID="53047104-c426-4439-9342-802e50d21162" containerID="a776f69860bc38e2f20da5ccae642a828aa0fff205700157f5becad6b07f3963" exitCode=0
Jul 19 15:25:33.524783 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.524642    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"
Jul 19 15:25:33.524783 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.524655    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d" event={"ID":"53047104-c426-4439-9342-802e50d21162","Type":"ContainerDied","Data":"a776f69860bc38e2f20da5ccae642a828aa0fff205700157f5becad6b07f3963"}
Jul 19 15:25:33.524783 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.524706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d" event={"ID":"53047104-c426-4439-9342-802e50d21162","Type":"ContainerDied","Data":"23168c8e372bf32d5a480918789e9cf7a28f9564a86e813dfddf578a594e0b58"}
Jul 19 15:25:33.524783 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.524725    2581 scope.go:117] "RemoveContainer" containerID="a776f69860bc38e2f20da5ccae642a828aa0fff205700157f5becad6b07f3963"
Jul 19 15:25:33.532739 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.532724    2581 scope.go:117] "RemoveContainer" containerID="a776f69860bc38e2f20da5ccae642a828aa0fff205700157f5becad6b07f3963"
Jul 19 15:25:33.533007 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:25:33.532990    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a776f69860bc38e2f20da5ccae642a828aa0fff205700157f5becad6b07f3963\": container with ID starting with a776f69860bc38e2f20da5ccae642a828aa0fff205700157f5becad6b07f3963 not found: ID does not exist" containerID="a776f69860bc38e2f20da5ccae642a828aa0fff205700157f5becad6b07f3963"
Jul 19 15:25:33.533045 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.533018    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a776f69860bc38e2f20da5ccae642a828aa0fff205700157f5becad6b07f3963"} err="failed to get container status \"a776f69860bc38e2f20da5ccae642a828aa0fff205700157f5becad6b07f3963\": rpc error: code = NotFound desc = could not find container \"a776f69860bc38e2f20da5ccae642a828aa0fff205700157f5becad6b07f3963\": container with ID starting with a776f69860bc38e2f20da5ccae642a828aa0fff205700157f5becad6b07f3963 not found: ID does not exist"
Jul 19 15:25:33.572444 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.572420    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf7fq\" (UniqueName: \"kubernetes.io/projected/53047104-c426-4439-9342-802e50d21162-kube-api-access-gf7fq\") pod \"53047104-c426-4439-9342-802e50d21162\" (UID: \"53047104-c426-4439-9342-802e50d21162\") "
Jul 19 15:25:33.572558 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.572469    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53047104-c426-4439-9342-802e50d21162-openshift-service-ca\") pod \"53047104-c426-4439-9342-802e50d21162\" (UID: \"53047104-c426-4439-9342-802e50d21162\") "
Jul 19 15:25:33.572558 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.572527    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53047104-c426-4439-9342-802e50d21162-maas-api-tls\") pod \"53047104-c426-4439-9342-802e50d21162\" (UID: \"53047104-c426-4439-9342-802e50d21162\") "
Jul 19 15:25:33.572800 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.572779    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53047104-c426-4439-9342-802e50d21162-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "53047104-c426-4439-9342-802e50d21162" (UID: "53047104-c426-4439-9342-802e50d21162"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:25:33.572861 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.572845    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53047104-c426-4439-9342-802e50d21162-openshift-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:25:33.574543 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.574519    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53047104-c426-4439-9342-802e50d21162-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "53047104-c426-4439-9342-802e50d21162" (UID: "53047104-c426-4439-9342-802e50d21162"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 15:25:33.574650 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.574581    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53047104-c426-4439-9342-802e50d21162-kube-api-access-gf7fq" (OuterVolumeSpecName: "kube-api-access-gf7fq") pod "53047104-c426-4439-9342-802e50d21162" (UID: "53047104-c426-4439-9342-802e50d21162"). InnerVolumeSpecName "kube-api-access-gf7fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:25:33.673784 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.673748    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf7fq\" (UniqueName: \"kubernetes.io/projected/53047104-c426-4439-9342-802e50d21162-kube-api-access-gf7fq\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:25:33.673784 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.673779    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53047104-c426-4439-9342-802e50d21162-maas-api-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:25:33.845552 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.845525    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"]
Jul 19 15:25:33.847320 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:33.847296    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7679e0-6cc9568f9d-46k8d"]
Jul 19 15:25:34.967606 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:34.967572    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53047104-c426-4439-9342-802e50d21162" path="/var/lib/kubelet/pods/53047104-c426-4439-9342-802e50d21162/volumes"
Jul 19 15:25:55.380865 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.380788    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"]
Jul 19 15:25:55.381289 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.381096    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x" podUID="df4afb12-1c87-4067-97eb-37255c705833" containerName="maas-api" containerID="cri-o://f927323d115c73828a4420141c04c804f49d258648d1ac236941da9e6e358eef" gracePeriod=30
Jul 19 15:25:55.625478 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.625446    2581 generic.go:356] "Generic (PLEG): container finished" podID="df4afb12-1c87-4067-97eb-37255c705833" containerID="f927323d115c73828a4420141c04c804f49d258648d1ac236941da9e6e358eef" exitCode=0
Jul 19 15:25:55.625621 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.625483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x" event={"ID":"df4afb12-1c87-4067-97eb-37255c705833","Type":"ContainerDied","Data":"f927323d115c73828a4420141c04c804f49d258648d1ac236941da9e6e358eef"}
Jul 19 15:25:55.625621 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.625545    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x" event={"ID":"df4afb12-1c87-4067-97eb-37255c705833","Type":"ContainerDied","Data":"7cdf2324ad38d5f23c079352155e74628ae43abaf13543470c9ed654db19b592"}
Jul 19 15:25:55.625621 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.625570    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cdf2324ad38d5f23c079352155e74628ae43abaf13543470c9ed654db19b592"
Jul 19 15:25:55.628421 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.628406    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:25:55.666915 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.666829    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df4afb12-1c87-4067-97eb-37255c705833-maas-api-tls\") pod \"df4afb12-1c87-4067-97eb-37255c705833\" (UID: \"df4afb12-1c87-4067-97eb-37255c705833\") "
Jul 19 15:25:55.666915 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.666871    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df4afb12-1c87-4067-97eb-37255c705833-openshift-service-ca\") pod \"df4afb12-1c87-4067-97eb-37255c705833\" (UID: \"df4afb12-1c87-4067-97eb-37255c705833\") "
Jul 19 15:25:55.667152 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.666949    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz6c5\" (UniqueName: \"kubernetes.io/projected/df4afb12-1c87-4067-97eb-37255c705833-kube-api-access-qz6c5\") pod \"df4afb12-1c87-4067-97eb-37255c705833\" (UID: \"df4afb12-1c87-4067-97eb-37255c705833\") "
Jul 19 15:25:55.667279 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.667247    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df4afb12-1c87-4067-97eb-37255c705833-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df4afb12-1c87-4067-97eb-37255c705833" (UID: "df4afb12-1c87-4067-97eb-37255c705833"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:25:55.669091 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.669064    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df4afb12-1c87-4067-97eb-37255c705833-kube-api-access-qz6c5" (OuterVolumeSpecName: "kube-api-access-qz6c5") pod "df4afb12-1c87-4067-97eb-37255c705833" (UID: "df4afb12-1c87-4067-97eb-37255c705833"). InnerVolumeSpecName "kube-api-access-qz6c5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:25:55.669091 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.669080    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df4afb12-1c87-4067-97eb-37255c705833-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df4afb12-1c87-4067-97eb-37255c705833" (UID: "df4afb12-1c87-4067-97eb-37255c705833"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 15:25:55.767766 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.767731    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df4afb12-1c87-4067-97eb-37255c705833-maas-api-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:25:55.767766 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.767761    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df4afb12-1c87-4067-97eb-37255c705833-openshift-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:25:55.767766 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:55.767771    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz6c5\" (UniqueName: \"kubernetes.io/projected/df4afb12-1c87-4067-97eb-37255c705833-kube-api-access-qz6c5\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:25:56.630634 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:56.630602    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"
Jul 19 15:25:56.650395 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:56.650366    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"]
Jul 19 15:25:56.653837 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:56.653813    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3c4e71-59b768994d-8lr6x"]
Jul 19 15:25:56.967295 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:25:56.967268    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df4afb12-1c87-4067-97eb-37255c705833" path="/var/lib/kubelet/pods/df4afb12-1c87-4067-97eb-37255c705833/volumes"
Jul 19 15:26:06.389759 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:06.389724    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"]
Jul 19 15:26:06.390326 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:06.389953    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l" podUID="7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" containerName="istio-proxy" containerID="cri-o://f5e90f8eb6fbccf571ceb6c925398ac549943776a1ae9c38eb2f2330a1b54c54" gracePeriod=30
Jul 19 15:26:06.746782 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:06.746738    2581 patch_prober.go:28] interesting pod/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 19 15:26:06.746949 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:06.746805    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l" podUID="7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 19 15:26:11.639013 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.638983    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:26:11.702828 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.702742    2581 generic.go:356] "Generic (PLEG): container finished" podID="7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" containerID="f5e90f8eb6fbccf571ceb6c925398ac549943776a1ae9c38eb2f2330a1b54c54" exitCode=0
Jul 19 15:26:11.702828 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.702793    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"
Jul 19 15:26:11.703023 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.702790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l" event={"ID":"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68","Type":"ContainerDied","Data":"f5e90f8eb6fbccf571ceb6c925398ac549943776a1ae9c38eb2f2330a1b54c54"}
Jul 19 15:26:11.703023 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.702907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l" event={"ID":"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68","Type":"ContainerDied","Data":"e0c3e699689163f3c49503620de60bd1a483f2bbeecc3d3adeb0c75ea2b889ab"}
Jul 19 15:26:11.703023 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.702935    2581 scope.go:117] "RemoveContainer" containerID="f5e90f8eb6fbccf571ceb6c925398ac549943776a1ae9c38eb2f2330a1b54c54"
Jul 19 15:26:11.711172 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.711145    2581 scope.go:117] "RemoveContainer" containerID="55add92b64e2c1203be2fc255203d62157df79258f230542c566362ed8f1603c"
Jul 19 15:26:11.713309 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.713288    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-workload-certs\") pod \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") "
Jul 19 15:26:11.713389 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.713328    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj4sq\" (UniqueName: \"kubernetes.io/projected/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-kube-api-access-nj4sq\") pod \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") "
Jul 19 15:26:11.713389 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.713384    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istiod-ca-cert\") pod \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") "
Jul 19 15:26:11.713500 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.713417    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-envoy\") pod \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") "
Jul 19 15:26:11.713500 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.713467    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-podinfo\") pod \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") "
Jul 19 15:26:11.713611 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.713497    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-credential-socket\") pod \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") "
Jul 19 15:26:11.713611 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.713521    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-data\") pod \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") "
Jul 19 15:26:11.713611 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.713548    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-workload-socket\") pod \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") "
Jul 19 15:26:11.713611 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.713584    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-token\") pod \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\" (UID: \"7b2aa2a8-ab5f-40cc-9a10-90156acaeb68\") "
Jul 19 15:26:11.713939 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.713521    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" (UID: "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:26:11.714018 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.713986    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" (UID: "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:26:11.714075 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.714056    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" (UID: "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:26:11.714477 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.714444    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" (UID: "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:26:11.714605 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.714540    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" (UID: "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 15:26:11.715612 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.715585    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" (UID: "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 15:26:11.715810 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.715774    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" (UID: "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 15:26:11.715957 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.715933    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-kube-api-access-nj4sq" (OuterVolumeSpecName: "kube-api-access-nj4sq") pod "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" (UID: "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68"). InnerVolumeSpecName "kube-api-access-nj4sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:26:11.716063 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.716045    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" (UID: "7b2aa2a8-ab5f-40cc-9a10-90156acaeb68"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 15:26:11.719210 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.719192    2581 scope.go:117] "RemoveContainer" containerID="f5e90f8eb6fbccf571ceb6c925398ac549943776a1ae9c38eb2f2330a1b54c54"
Jul 19 15:26:11.719513 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:26:11.719489    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5e90f8eb6fbccf571ceb6c925398ac549943776a1ae9c38eb2f2330a1b54c54\": container with ID starting with f5e90f8eb6fbccf571ceb6c925398ac549943776a1ae9c38eb2f2330a1b54c54 not found: ID does not exist" containerID="f5e90f8eb6fbccf571ceb6c925398ac549943776a1ae9c38eb2f2330a1b54c54"
Jul 19 15:26:11.719624 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.719521    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5e90f8eb6fbccf571ceb6c925398ac549943776a1ae9c38eb2f2330a1b54c54"} err="failed to get container status \"f5e90f8eb6fbccf571ceb6c925398ac549943776a1ae9c38eb2f2330a1b54c54\": rpc error: code = NotFound desc = could not find container \"f5e90f8eb6fbccf571ceb6c925398ac549943776a1ae9c38eb2f2330a1b54c54\": container with ID starting with f5e90f8eb6fbccf571ceb6c925398ac549943776a1ae9c38eb2f2330a1b54c54 not found: ID does not exist"
Jul 19 15:26:11.719624 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.719542    2581 scope.go:117] "RemoveContainer" containerID="55add92b64e2c1203be2fc255203d62157df79258f230542c566362ed8f1603c"
Jul 19 15:26:11.719807 ip-10-0-134-165 kubenswrapper[2581]: E0719 15:26:11.719789    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55add92b64e2c1203be2fc255203d62157df79258f230542c566362ed8f1603c\": container with ID starting with 55add92b64e2c1203be2fc255203d62157df79258f230542c566362ed8f1603c not found: ID does not exist" containerID="55add92b64e2c1203be2fc255203d62157df79258f230542c566362ed8f1603c"
Jul 19 15:26:11.719868 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.719815    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55add92b64e2c1203be2fc255203d62157df79258f230542c566362ed8f1603c"} err="failed to get container status \"55add92b64e2c1203be2fc255203d62157df79258f230542c566362ed8f1603c\": rpc error: code = NotFound desc = could not find container \"55add92b64e2c1203be2fc255203d62157df79258f230542c566362ed8f1603c\": container with ID starting with 55add92b64e2c1203be2fc255203d62157df79258f230542c566362ed8f1603c not found: ID does not exist"
Jul 19 15:26:11.814599 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.814562    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istiod-ca-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:26:11.814599 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.814594    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-envoy\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:26:11.814599 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.814604    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-podinfo\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:26:11.814839 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.814612    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-credential-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:26:11.814839 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.814621    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:26:11.814839 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.814630    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-workload-socket\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:26:11.814839 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.814638    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-istio-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:26:11.814839 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.814647    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-workload-certs\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:26:11.814839 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:11.814654    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj4sq\" (UniqueName: \"kubernetes.io/projected/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68-kube-api-access-nj4sq\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\""
Jul 19 15:26:12.024059 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:12.024025    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"]
Jul 19 15:26:12.027516 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:12.027488    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-3c4e71-openshift-default-648fd4d5bc-rhx2l"]
Jul 19 15:26:12.754781 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:12.754745    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59c569b9f5-4ccr9_d614c31f-ce1d-47ef-8318-2c3516be2fd9/manager/0.log"
Jul 19 15:26:12.870711 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:12.870681    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8nqv9_fba0b774-fd0b-4a7d-bb73-9280fbf870e9/server/0.log"
Jul 19 15:26:12.967533 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:12.967501    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" path="/var/lib/kubelet/pods/7b2aa2a8-ab5f-40cc-9a10-90156acaeb68/volumes"
Jul 19 15:26:13.099916 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:13.099836    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c4b5b7c5f-98v29_ff291121-4918-4f15-aae3-97388db1ee6a/copy-manifests/0.log"
Jul 19 15:26:13.106887 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:13.106864    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c4b5b7c5f-98v29_ff291121-4918-4f15-aae3-97388db1ee6a/manager/0.log"
Jul 19 15:26:13.928963 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:13.928936    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29741235-8svr4_1249a625-2cec-4a2e-a43f-b74b869bb842/cleanup/0.log"
Jul 19 15:26:16.552063 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:16.552035    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mst7w_11869ba2-af5e-4c43-9c4d-27dd672afe1a/istio-proxy/0.log"
Jul 19 15:26:16.674705 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:16.674679    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-r98r8_792dc167-1a25-45df-88dd-dcc82a5f141b/discovery/0.log"
Jul 19 15:26:17.857868 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:17.857838    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-xxl44_18067051-b765-4946-9f2a-1ff0f5a947b5/main/0.log"
Jul 19 15:26:18.086339 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:18.086310    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flr5c2_e92a2c70-d159-4853-864d-3fac0dba51f5/main/0.log"
Jul 19 15:26:26.886340 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:26.886304    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4hj4p_c2b7dc9f-5e13-4837-b5db-9b68f3cae761/global-pull-secret-syncer/0.log"
Jul 19 15:26:27.084021 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:27.083987    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gtm8v_41482ca2-bd13-4005-ba14-3077ac539682/konnectivity-agent/0.log"
Jul 19 15:26:27.131601 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:27.131571    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-165.ec2.internal_2ed18d9f9ede21e451f5e83ef12c968d/haproxy/0.log"
Jul 19 15:26:31.293755 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:31.293724    2581 scope.go:117] "RemoveContainer" containerID="f927323d115c73828a4420141c04c804f49d258648d1ac236941da9e6e358eef"
Jul 19 15:26:34.600878 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:34.600796    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sflgh_d35b32d7-a273-4ab9-b3c3-51a246672fb2/node-exporter/0.log"
Jul 19 15:26:34.620663 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:34.620638    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sflgh_d35b32d7-a273-4ab9-b3c3-51a246672fb2/kube-rbac-proxy/0.log"
Jul 19 15:26:34.642597 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:34.642571    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sflgh_d35b32d7-a273-4ab9-b3c3-51a246672fb2/init-textfile/0.log"
Jul 19 15:26:34.671742 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:34.671715    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-5zpkx_d16b3033-1593-4d5b-8e4b-a63289b75b7b/kube-rbac-proxy-main/0.log"
Jul 19 15:26:34.693410 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:34.693385    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-5zpkx_d16b3033-1593-4d5b-8e4b-a63289b75b7b/kube-rbac-proxy-self/0.log"
Jul 19 15:26:34.717767 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:34.717745    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-5zpkx_d16b3033-1593-4d5b-8e4b-a63289b75b7b/openshift-state-metrics/0.log"
Jul 19 15:26:34.994933 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:34.994901    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c9584bcc-wzxnz_a4113615-e5e0-470e-83e0-bd47ac6c9718/telemeter-client/0.log"
Jul 19 15:26:35.024580 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:35.024558    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c9584bcc-wzxnz_a4113615-e5e0-470e-83e0-bd47ac6c9718/reload/0.log"
Jul 19 15:26:35.044695 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:35.044672    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c9584bcc-wzxnz_a4113615-e5e0-470e-83e0-bd47ac6c9718/kube-rbac-proxy/0.log"
Jul 19 15:26:35.074899 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:35.074873    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c5486d4bb-w6ltv_7317a362-036e-4229-a6c1-3b4a69e83a78/thanos-query/0.log"
Jul 19 15:26:35.095300 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:35.095246    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c5486d4bb-w6ltv_7317a362-036e-4229-a6c1-3b4a69e83a78/kube-rbac-proxy-web/0.log"
Jul 19 15:26:35.116729 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:35.116704    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c5486d4bb-w6ltv_7317a362-036e-4229-a6c1-3b4a69e83a78/kube-rbac-proxy/0.log"
Jul 19 15:26:35.136133 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:35.136105    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c5486d4bb-w6ltv_7317a362-036e-4229-a6c1-3b4a69e83a78/prom-label-proxy/0.log"
Jul 19 15:26:35.155864 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:35.155839    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c5486d4bb-w6ltv_7317a362-036e-4229-a6c1-3b4a69e83a78/kube-rbac-proxy-rules/0.log"
Jul 19 15:26:35.176294 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:35.176270    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c5486d4bb-w6ltv_7317a362-036e-4229-a6c1-3b4a69e83a78/kube-rbac-proxy-metrics/0.log"
Jul 19 15:26:36.978534 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.978504    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"]
Jul 19 15:26:36.978930 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.978806    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53047104-c426-4439-9342-802e50d21162" containerName="maas-api"
Jul 19 15:26:36.978930 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.978817    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="53047104-c426-4439-9342-802e50d21162" containerName="maas-api"
Jul 19 15:26:36.978930 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.978832    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" containerName="istio-proxy"
Jul 19 15:26:36.978930 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.978837    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" containerName="istio-proxy"
Jul 19 15:26:36.978930 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.978846    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df4afb12-1c87-4067-97eb-37255c705833" containerName="maas-api"
Jul 19 15:26:36.978930 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.978852    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="df4afb12-1c87-4067-97eb-37255c705833" containerName="maas-api"
Jul 19 15:26:36.978930 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.978912    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="53047104-c426-4439-9342-802e50d21162" containerName="maas-api"
Jul 19 15:26:36.978930 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.978921    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="df4afb12-1c87-4067-97eb-37255c705833" containerName="maas-api"
Jul 19 15:26:36.978930 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.978929    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b2aa2a8-ab5f-40cc-9a10-90156acaeb68" containerName="istio-proxy"
Jul 19 15:26:36.981815 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.981798    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:36.984398 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.984374    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9q7mm\"/\"kube-root-ca.crt\""
Jul 19 15:26:36.984531 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.984375    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9q7mm\"/\"default-dockercfg-8hr7t\""
Jul 19 15:26:36.985168 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.985152    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9q7mm\"/\"openshift-service-ca.crt\""
Jul 19 15:26:36.989543 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:36.989519    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"]
Jul 19 15:26:37.023024 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.022989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25a57c4c-b938-4824-9242-43f8668ca531-lib-modules\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.023024 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.023024    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/25a57c4c-b938-4824-9242-43f8668ca531-proc\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.023298 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.023119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9bzl\" (UniqueName: \"kubernetes.io/projected/25a57c4c-b938-4824-9242-43f8668ca531-kube-api-access-k9bzl\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.023298 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.023149    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25a57c4c-b938-4824-9242-43f8668ca531-sys\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.023298 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.023201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/25a57c4c-b938-4824-9242-43f8668ca531-podres\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.124356 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.124316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9bzl\" (UniqueName: \"kubernetes.io/projected/25a57c4c-b938-4824-9242-43f8668ca531-kube-api-access-k9bzl\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.124356 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.124360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25a57c4c-b938-4824-9242-43f8668ca531-sys\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.124611 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.124395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/25a57c4c-b938-4824-9242-43f8668ca531-podres\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.124611 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.124448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25a57c4c-b938-4824-9242-43f8668ca531-lib-modules\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.124611 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.124474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/25a57c4c-b938-4824-9242-43f8668ca531-proc\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.124611 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.124526    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25a57c4c-b938-4824-9242-43f8668ca531-sys\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.124611 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.124566    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/25a57c4c-b938-4824-9242-43f8668ca531-proc\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.124611 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.124591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25a57c4c-b938-4824-9242-43f8668ca531-lib-modules\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.124611 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.124594    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/25a57c4c-b938-4824-9242-43f8668ca531-podres\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.133076 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.133047    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9bzl\" (UniqueName: \"kubernetes.io/projected/25a57c4c-b938-4824-9242-43f8668ca531-kube-api-access-k9bzl\") pod \"perf-node-gather-daemonset-t769s\" (UID: \"25a57c4c-b938-4824-9242-43f8668ca531\") " pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.291760 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.291665    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.421634 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.421561    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"]
Jul 19 15:26:37.423915 ip-10-0-134-165 kubenswrapper[2581]: W0719 15:26:37.423886    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod25a57c4c_b938_4824_9242_43f8668ca531.slice/crio-c3cdae664a1daca141971db41b4be725b5fad73b427b2aca952b9324c66aaa33 WatchSource:0}: Error finding container c3cdae664a1daca141971db41b4be725b5fad73b427b2aca952b9324c66aaa33: Status 404 returned error can't find the container with id c3cdae664a1daca141971db41b4be725b5fad73b427b2aca952b9324c66aaa33
Jul 19 15:26:37.694535 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.694508    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-fc6lx_4f08afff-1a6e-4d89-9a38-aaae8d5c7877/download-server/0.log"
Jul 19 15:26:37.826607 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.826509    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s" event={"ID":"25a57c4c-b938-4824-9242-43f8668ca531","Type":"ContainerStarted","Data":"e75cda17ffa7da976f7f9391c7db4658b2e425f5fb00ef6958115357e469f721"}
Jul 19 15:26:37.826607 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.826562    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s" event={"ID":"25a57c4c-b938-4824-9242-43f8668ca531","Type":"ContainerStarted","Data":"c3cdae664a1daca141971db41b4be725b5fad73b427b2aca952b9324c66aaa33"}
Jul 19 15:26:37.826607 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.826583    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:37.843556 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:37.843512    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s" podStartSLOduration=1.843496155 podStartE2EDuration="1.843496155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 15:26:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:26:37.841791027 +0000 UTC m=+3008.234353413" watchObservedRunningTime="2026-07-19 15:26:37.843496155 +0000 UTC m=+3008.236058542"
Jul 19 15:26:39.328644 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:39.328615    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4wrzz_cbdd8533-9848-42a8-99f0-1f28ae211619/dns/0.log"
Jul 19 15:26:39.364218 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:39.364190    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4wrzz_cbdd8533-9848-42a8-99f0-1f28ae211619/kube-rbac-proxy/0.log"
Jul 19 15:26:39.537737 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:39.537706    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wcvsd_71c9fd9a-f6de-4c6e-b44c-cb761417d887/dns-node-resolver/0.log"
Jul 19 15:26:40.060982 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:40.060953    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-264jl_6e02de66-c838-4a32-a23e-5e948f61cf8e/node-ca/0.log"
Jul 19 15:26:41.059645 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:41.059620    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mst7w_11869ba2-af5e-4c43-9c4d-27dd672afe1a/istio-proxy/0.log"
Jul 19 15:26:41.180478 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:41.180448    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-r98r8_792dc167-1a25-45df-88dd-dcc82a5f141b/discovery/0.log"
Jul 19 15:26:42.151732 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:42.151703    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d66jn_54c8a2d7-3080-4b45-b121-4f689792949b/serve-healthcheck-canary/0.log"
Jul 19 15:26:42.650528 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:42.650501    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4s7vz_4384ca8c-19d8-4d39-9022-13785e868b59/kube-rbac-proxy/0.log"
Jul 19 15:26:42.673620 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:42.673595    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4s7vz_4384ca8c-19d8-4d39-9022-13785e868b59/exporter/0.log"
Jul 19 15:26:42.695598 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:42.695563    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4s7vz_4384ca8c-19d8-4d39-9022-13785e868b59/extractor/0.log"
Jul 19 15:26:43.840728 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:43.840699    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9q7mm/perf-node-gather-daemonset-t769s"
Jul 19 15:26:45.306926 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:45.306889    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59c569b9f5-4ccr9_d614c31f-ce1d-47ef-8318-2c3516be2fd9/manager/0.log"
Jul 19 15:26:45.329071 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:45.329043    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8nqv9_fba0b774-fd0b-4a7d-bb73-9280fbf870e9/server/0.log"
Jul 19 15:26:45.469813 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:45.469756    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c4b5b7c5f-98v29_ff291121-4918-4f15-aae3-97388db1ee6a/manager/0.log"
Jul 19 15:26:45.495008 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:45.494986    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c4b5b7c5f-98v29_ff291121-4918-4f15-aae3-97388db1ee6a/copy-manifests/0.log"
Jul 19 15:26:46.822112 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:46.822028    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mst7w_11869ba2-af5e-4c43-9c4d-27dd672afe1a/istio-proxy/0.log"
Jul 19 15:26:46.945266 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:46.945232    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-r98r8_792dc167-1a25-45df-88dd-dcc82a5f141b/discovery/0.log"
Jul 19 15:26:47.178357 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:47.178256    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7499d794d8-7tbl6_5b974c06-7272-4f04-a908-c0205384a805/manager/0.log"
Jul 19 15:26:48.265595 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:48.265564    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mst7w_11869ba2-af5e-4c43-9c4d-27dd672afe1a/istio-proxy/0.log"
Jul 19 15:26:48.382208 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:48.382116    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-r98r8_792dc167-1a25-45df-88dd-dcc82a5f141b/discovery/0.log"
Jul 19 15:26:53.125138 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:53.125055    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69b5h_e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5/kube-multus-additional-cni-plugins/0.log"
Jul 19 15:26:53.146656 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:53.146623    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69b5h_e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5/egress-router-binary-copy/0.log"
Jul 19 15:26:53.167490 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:53.167459    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69b5h_e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5/cni-plugins/0.log"
Jul 19 15:26:53.187265 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:53.187235    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69b5h_e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5/bond-cni-plugin/0.log"
Jul 19 15:26:53.207167 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:53.207143    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69b5h_e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5/routeoverride-cni/0.log"
Jul 19 15:26:53.229438 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:53.229413    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69b5h_e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5/whereabouts-cni-bincopy/0.log"
Jul 19 15:26:53.249324 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:53.249297    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69b5h_e8b299eb-dc12-43c9-ab17-3e86ca3ae6c5/whereabouts-cni/0.log"
Jul 19 15:26:53.689374 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:53.689335    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lz9d6_7ac73163-d7e2-4658-ac4d-c4cdd46ca467/kube-multus/0.log"
Jul 19 15:26:53.749903 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:53.749869    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-52jmh_0529a9f4-7d49-47f5-9c5f-e61102a365d9/network-metrics-daemon/0.log"
Jul 19 15:26:53.768580 ip-10-0-134-165 kubenswrapper[2581]: I0719 15:26:53.768550    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-52jmh_0529a9f4-7d49-47f5-9c5f-e61102a365d9/kube-rbac-proxy/0.log"