Jul 22 16:18:52.973391 ip-10-0-136-140 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 16:18:52.973405 ip-10-0-136-140 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 16:18:52.973414 ip-10-0-136-140 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 16:18:52.973732 ip-10-0-136-140 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 16:19:01.902851 ip-10-0-136-140 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 22 16:19:01.902864 ip-10-0-136-140 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ef2ee2ab3f7c4b0a9f76387ddac92be7 --
Jul 22 16:20:33.691489 ip-10-0-136-140 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.054999    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061909    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061923    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061926    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061930    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061933    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061936    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061939    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 16:20:34.092936 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061942    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061944    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061951    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061954    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061958    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061962    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061965    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061968    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061971    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061973    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061976    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061979    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061983    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061986    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061992    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061995    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.061998    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062000    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062003    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 16:20:34.095596 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062007    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062011    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062014    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062017    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062020    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062023    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062026    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062029    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062034    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062037    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062039    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062042    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062045    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062048    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062050    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062055    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062058    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062061    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062064    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 16:20:34.097381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062067    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062073    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062076    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062079    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062081    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062085    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062089    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062091    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062095    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062097    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062100    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062104    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062106    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062112    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062115    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062117    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062120    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062123    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062126    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062128    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 16:20:34.101736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062131    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062134    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062137    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062140    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062143    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062146    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062151    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062154    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062157    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062160    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062163    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062165    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062168    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062171    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062174    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062178    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062181    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062187    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062189    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062192    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 16:20:34.106681 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062195    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062199    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062202    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062205    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062208    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062212    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062215    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062236    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062241    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062244    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062250    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062252    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062255    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.062258    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063354    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063362    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063365    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063370    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063374    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 16:20:34.117897 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063377    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063381    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063387    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063392    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063396    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063399    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063403    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063406    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063409    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063412    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063418    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063421    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063424    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063427    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063431    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063436    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063439    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063443    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063446    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 16:20:34.359068 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063449    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 16:20:34.125265 ip-10-0-136-140 systemd[1]: Started Kubernetes Kubelet.
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063452    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063455    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063462    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063465    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063468    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063471    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063474    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063477    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063480    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063483    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063485    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063488    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063491    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063494    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063496    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063502    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063505    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063508    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063513    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 16:20:34.383848 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063516    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063519    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063522    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063524    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063527    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063530    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063533    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063536    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063541    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063544    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063547    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063549    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063552    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063555    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063558    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063561    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063564    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063569    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063571    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063574    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 16:20:34.385604 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063577    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063582    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063585    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063587    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063590    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063593    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063596    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063599    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063601    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063604    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063607    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063611    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063614    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063617    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063622    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063625    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063627    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063630    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063633    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063637    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 16:20:34.386317 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063640    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063642    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063646    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063648    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063651    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063656    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063659    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063662    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063665    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063669    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063672    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063674    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063677    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063680    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.063682    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064373    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064380    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064384    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064388    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064391    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 16:20:34.386912 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064394    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064397    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064400    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064405    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064408    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064411    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064416    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064419    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064422    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064425    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064427    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064430    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064433    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064437    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064441    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064445    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064448    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064451    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064456    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 16:20:34.387572 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064459    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064462    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064468    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064471    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064473    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064477    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064479    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064482    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064485    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064488    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064490    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064495    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064498    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064501    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064505    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064509    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064515    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064520    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.064527    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 16:20:34.388143 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065056    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065062    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065065    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065068    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065071    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065074    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065077    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065079    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065083    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065085    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065088    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065091    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065094    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065097    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065100    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065104    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065107    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065110    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065112    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065116    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 16:20:34.388770 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065120    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065125    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065129    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065136    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065139    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065141    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065144    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065147    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065150    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065154    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065157    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065159    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065165    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065168    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065172    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065177    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065180    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065186    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065190    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 16:20:34.389416 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065196    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065202    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065206    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065215    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065230    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065235    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065238    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065242    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065248    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065251    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065256    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065258    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065261    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065266    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065269    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065273    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.065278    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065354    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065363    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065372    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065378    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 16:20:34.390012 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065384    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065389    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065393    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065397    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065400    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065403    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065407    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065410    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065414    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065417    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065420    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065423    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065426    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065429    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065433    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065436    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065439    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065443    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065448    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065457    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065461    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065464    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065468    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065471    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 16:20:34.390645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065475    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065478    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065481    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065484    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065488    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065492    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065495    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065498    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065501    2580 flags.go:64] FLAG: --enable-server="true"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065505    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065511    2580 flags.go:64] FLAG: --event-burst="100"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065514    2580 flags.go:64] FLAG: --event-qps="50"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065517    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065521    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065526    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065532    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065537    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065541    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065544    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065546    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065549    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065554    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065557    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065560    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065562    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 16:20:34.391374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065566    2580 flags.go:64] FLAG: --feature-gates=""
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065570    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065574    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065577    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065580    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065583    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065586    2580 flags.go:64] FLAG: --help="false"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065589    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065592    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065595    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065598    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065603    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065609    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065614    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065619    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065622    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065626    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065629    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065632    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065635    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065638    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065641    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065644    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065647    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 16:20:34.392070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065650    2580 flags.go:64] FLAG: --lock-file=""
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065653    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065655    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065659    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065664    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065667    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065670    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065673    2580 flags.go:64] FLAG: --logging-format="text"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065676    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065679    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065685    2580 flags.go:64] FLAG: --manifest-url=""
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065690    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065696    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065700    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065704    2580 flags.go:64] FLAG: --max-pods="110"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065707    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065710    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065713    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065715    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065719    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065722    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065725    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065732    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065735    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065739    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 16:20:34.398212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065742    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065745    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065750    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065753    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065756    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065760    2580 flags.go:64] FLAG: --port="10250"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065765    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065770    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07e381d2f5d59f410"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065775    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065778    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065781    2580 flags.go:64] FLAG: --register-node="true"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065784    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065788    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065791    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065794    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065797    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065800    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065806    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065810    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065813    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065816    2580 flags.go:64] FLAG: --runonce="false"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065819    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065822    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065825    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065828    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 16:20:34.399038 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065831    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065834    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065837    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065843    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065847    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065852    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065857    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065861    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065864    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065867    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065870    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065875    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065878    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065881    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065885    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065888    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065891    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065894    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065896    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065899    2580 flags.go:64] FLAG: --v="2"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065903    2580 flags.go:64] FLAG: --version="false"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065908    2580 flags.go:64] FLAG: --vmodule=""
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065912    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.065915    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066040    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 16:20:34.399831 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066045    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066048    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066051    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066054    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066057    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066060    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066063    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066066    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066068    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066071    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066074    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066078    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066082    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066086    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066092    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066094    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066097    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066100    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066102    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066105    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 16:20:34.400566 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066107    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066110    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066113    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066115    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066118    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066121    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066123    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066126    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066128    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066132    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066134    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066138    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066141    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066145    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066149    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066151    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066155    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066160    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066165    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 16:20:34.401305 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066169    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066173    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066175    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066178    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066181    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066183    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066186    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066190    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066193    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066196    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066199    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066202    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066205    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066207    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066210    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066212    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066215    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066229    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066232    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 16:20:34.401819 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066239    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066245    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066250    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066253    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066257    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066262    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066265    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066268    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066271    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066274    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066277    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066280    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066283    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066286    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066288    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066291    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066294    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066297    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066300    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066303    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 16:20:34.402598 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066307    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066310    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066313    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066318    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066323    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066328    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066332    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066334    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066337    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066340    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066342    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066345    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066347    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066350    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066353    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066355    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066358    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066362    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066365    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 16:20:34.403207 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.066368    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.066373    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.073122    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.073137    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.073830    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.073837    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073893    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073898    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073902    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073905    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073907    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073912    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073917    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073920    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 16:20:34.403788 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073925    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073929    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073932    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073935    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073938    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073941    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073944    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073946    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073949    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073952    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073954    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073957    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073962    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073965    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073969    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073972    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073976    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073979    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073983    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 16:20:34.522933 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073985    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073988    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073991    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073994    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073996    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.073999    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074002    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074004    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074007    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074010    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074014    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074017    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074019    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074022    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074025    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074027    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074030    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074033    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074035    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 16:20:34.524060 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074038    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074040    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074043    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074045    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074048    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074050    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074053    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074056    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074058    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074061    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074063    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074067    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074069    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074072    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074075    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074079    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074082    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074084    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074087    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074090    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 16:20:34.531161 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074092    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074095    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074097    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074101    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074104    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074107    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074109    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074112    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074114    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074117    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074119    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074121    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074124    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074127    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074130    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074132    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074135    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074137    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074140    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 16:20:34.532041 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074142    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074145    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074147    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074150    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074152    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074155    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074158    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074160    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074164    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074167    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074169    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074172    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074175    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074177    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.074182    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 16:20:34.532948 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074302    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074308    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074312    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074315    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074318    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074321    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074325    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074329    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074332    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074335    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074338    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074341    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074343    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074346    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074349    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074352    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074355    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074358    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074360    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 16:20:34.533833 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074363    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074366    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074369    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074371    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074378    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074380    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074383    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074387    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074390    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074392    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074395    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074397    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074400    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074403    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074407    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074410    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074412    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074414    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074417    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074420    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 16:20:34.534723 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074422    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074425    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074427    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074430    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074433    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074435    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074438    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074440    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074443    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074446    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074448    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074451    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074453    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074456    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074459    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074461    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074463    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074467    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074470    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074475    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 16:20:34.535608 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074478    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074481    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074484    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074487    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074489    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074492    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074496    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074499    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074501    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074504    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074507    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074509    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074512    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074515    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074517    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074520    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074522    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074525    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074528    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074530    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 16:20:34.536499 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074533    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074536    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074538    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074541    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074543    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074546    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074549    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074551    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074554    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074556    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074560    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074563    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074566    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074569    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074571    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074574    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074577    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074579    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074584    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 16:20:34.537381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:34.074587    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 16:20:34.538472 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.074593    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 16:20:34.538472 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.074683    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 16:20:34.538472 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.076861    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 16:20:34.538472 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.078297    2580 server.go:1019] "Starting client certificate rotation"
Jul 22 16:20:34.538472 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.078404    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 16:20:34.538472 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.078437    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 16:20:34.538472 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.080401    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 16:20:34.538472 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.081444    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 16:20:34.538472 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.089111    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 22 16:20:34.538472 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.091464    2580 log.go:25] "Validated CRI v1 image API"
Jul 22 16:20:34.538472 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.092970    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 16:20:34.538472 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.095479    2580 fs.go:135] Filesystem UUIDs: map[2b3f41d4-eabe-4707-8ad9-46899fcaed26:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a7c1373f-bfda-4042-9081-4ef48563954a:/dev/nvme0n1p4]
Jul 22 16:20:34.539134 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.095507    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 16:20:34.539571 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.102774    2580 manager.go:216] Machine: {Timestamp:2026-07-22 16:20:34.10131486 +0000 UTC m=+0.293518191 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103380 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b28b9ae7b9bb213011bc92e0866b0 SystemUUID:ec2b28b9-ae7b-9bb2-1301-1bc92e0866b0 BootID:ef2ee2ab-3f7c-4b0a-9f76-387ddac92be7 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d9:1d:d0:4d:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d9:1d:d0:4d:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:c5:58:ce:59:33 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 16:20:34.539571 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.102917    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 16:20:34.539571 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.103068    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 16:20:34.539571 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.106042    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 16:20:34.539571 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.106074    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-140.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 16:20:34.539571 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.106791    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 16:20:34.539571 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.106800    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 16:20:34.539571 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.106807    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.107417    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.109032    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.111652    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.113241    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.113364    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.113393    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.113409    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.113423    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.113432    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.113442    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.113862    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.113877    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.115863    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.118138    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.118166    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119181    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119198    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119208    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119217    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119245    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119253    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119264    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119272    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119282    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119290    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119303    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119312    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119908    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.119920    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.123249    2580 server.go:1268] "Started kubelet"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.123328    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.123639    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.123687    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.124960    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-140.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.124982    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.125122    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.125862    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.127011    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 16:20:34.540017 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.130389    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.130570    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-140.ec2.internal.18c4a90ef953ac80  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-140.ec2.internal,UID:ip-10-0-136-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-140.ec2.internal,},FirstTimestamp:2026-07-22 16:20:34.12320576 +0000 UTC m=+0.315409070,LastTimestamp:2026-07-22 16:20:34.12320576 +0000 UTC m=+0.315409070,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-140.ec2.internal,}"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.133451    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.133460    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.133521    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.134135    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.134153    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.134165    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.134279    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.134289    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.134573    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.134604    2580 factory.go:55] Registering systemd factory
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.134613    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.134842    2580 factory.go:153] Registering CRI-O factory
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.134861    2580 factory.go:223] Registration of the crio container factory successfully
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.134884    2580 factory.go:103] Registering Raw factory
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.134915    2580 manager.go:1196] Started watching for new ooms in manager
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.136270    2580 manager.go:349] Starting recovery of all containers
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.138185    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.138417    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.150410    2580 manager.go:354] Recovery completed
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.155638    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.157546    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.157577    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.157591    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.158056    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.158062    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.158065    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.158102    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.158763    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.158786    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:20:34.541779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.158796    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.159280    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-140.ec2.internal.18c4a90efb5fe38d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-140.ec2.internal,UID:ip-10-0-136-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-140.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-140.ec2.internal,},FirstTimestamp:2026-07-22 16:20:34.157560717 +0000 UTC m=+0.349764027,LastTimestamp:2026-07-22 16:20:34.157560717 +0000 UTC m=+0.349764027,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-140.ec2.internal,}"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.160063    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mdcp5"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.160109    2580 policy_none.go:49] "None policy: Start"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.160122    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.160141    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.161990    2580 policy_none.go:47] "Start"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.168115    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mdcp5"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.171614    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-140.ec2.internal.18c4a90efb603fe7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-140.ec2.internal,UID:ip-10-0-136-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-140.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-140.ec2.internal,},FirstTimestamp:2026-07-22 16:20:34.157584359 +0000 UTC m=+0.349787669,LastTimestamp:2026-07-22 16:20:34.157584359 +0000 UTC m=+0.349787669,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-140.ec2.internal,}"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.214809    2580 manager.go:337] "Starting Device Plugin manager"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.214837    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.214846    2580 server.go:87] "Starting device plugin registration server"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.215116    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.215126    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.215263    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.215375    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.215385    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.216024    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.216080    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.240367    2580 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2613 into the system container \"/system.slice\": <nil>"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.315779    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.316931    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.316961    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.316971    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.317002    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.543108 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.326037    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.326056    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-140.ec2.internal\": node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.354901    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.400504    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.402040    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.402086    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.402112    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.402152    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.404583    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.455753    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.502909    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal"]
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.503004    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.506943    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.506979    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.507002    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.509243    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.509356    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.509647    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.513055    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.513078    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.513088    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.514506    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.514525    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.514538    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.517077    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.544235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.517104    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:20:34.636942 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.555023    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:20:34.636942 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.555065    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:20:34.636942 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.555075    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:20:34.636942 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.556356    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:34.636942 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.575918    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-140.ec2.internal\" not found" node="ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.636942 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.585352    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-140.ec2.internal\" not found" node="ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.828122 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.654697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc23c176a2af80037228d601c235eb03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal\" (UID: \"fc23c176a2af80037228d601c235eb03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.828122 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.654723    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc23c176a2af80037228d601c235eb03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal\" (UID: \"fc23c176a2af80037228d601c235eb03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.828122 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.654741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0914649e35306a68df1632ae34f49b6b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-140.ec2.internal\" (UID: \"0914649e35306a68df1632ae34f49b6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.828122 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.656781    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:34.828122 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.755625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc23c176a2af80037228d601c235eb03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal\" (UID: \"fc23c176a2af80037228d601c235eb03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.828122 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.755641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc23c176a2af80037228d601c235eb03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal\" (UID: \"fc23c176a2af80037228d601c235eb03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.828122 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.755669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc23c176a2af80037228d601c235eb03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal\" (UID: \"fc23c176a2af80037228d601c235eb03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.828122 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.755714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0914649e35306a68df1632ae34f49b6b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-140.ec2.internal\" (UID: \"0914649e35306a68df1632ae34f49b6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.828122 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.755719    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc23c176a2af80037228d601c235eb03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal\" (UID: \"fc23c176a2af80037228d601c235eb03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.828122 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.755745    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0914649e35306a68df1632ae34f49b6b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-140.ec2.internal\" (UID: \"0914649e35306a68df1632ae34f49b6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.828122 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.757698    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:34.940769 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.858276    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:34.940769 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.879449    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:34.940769 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:34.889552    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:35.072132 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:34.958450    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:35.072132 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:35.058927    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:35.072132 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.067201    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 16:20:35.222589 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.077700    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 16:20:35.222589 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.077808    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 16:20:35.222589 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.077856    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 16:20:35.222589 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:35.159326    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:35.222589 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.174041    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 16:15:34 +0000 UTC" deadline="2028-01-25 17:26:23.729826094 +0000 UTC"
Jul 22 16:20:35.222589 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.174071    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13249h5m48.555758266s"
Jul 22 16:20:35.407692 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:35.260254    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:35.407692 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.278575    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 16:20:35.407692 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.279917    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 16:20:35.407692 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.279945    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 16:20:35.407692 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.279955    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeHasSufficientPID"
Jul 22 16:20:35.407692 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:35.361615    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:35.579034 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.448774    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 16:20:35.579034 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:35.462404    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-140.ec2.internal\" not found"
Jul 22 16:20:35.579034 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.533938    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 16:20:35.714006 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:35.604161    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0914649e35306a68df1632ae34f49b6b.slice/crio-4a25c4641a963ae7a5db0f20388cb3640f84e140c13416074f6972fabe57e045 WatchSource:0}: Error finding container 4a25c4641a963ae7a5db0f20388cb3640f84e140c13416074f6972fabe57e045: Status 404 returned error can't find the container with id 4a25c4641a963ae7a5db0f20388cb3640f84e140c13416074f6972fabe57e045
Jul 22 16:20:35.714006 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:35.604760    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc23c176a2af80037228d601c235eb03.slice/crio-d88a050eab63f6aa064881fea85d2a2e39dca6d06e98cbfe143b9e6138ce3c4e WatchSource:0}: Error finding container d88a050eab63f6aa064881fea85d2a2e39dca6d06e98cbfe143b9e6138ce3c4e: Status 404 returned error can't find the container with id d88a050eab63f6aa064881fea85d2a2e39dca6d06e98cbfe143b9e6138ce3c4e
Jul 22 16:20:35.714006 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.613851    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 16:20:35.714006 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.634705    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:35.714006 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.650829    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 16:20:35.714006 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.651878    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal"
Jul 22 16:20:35.714006 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:35.661384    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.119757    2580 apiserver.go:52] "Watching apiserver"
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.127997    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.128434    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-zdkhc","openshift-network-diagnostics/network-check-target-rb879","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9","openshift-image-registry/node-ca-smnmv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal","openshift-multus/multus-additional-cni-plugins-pp6jx","openshift-multus/multus-jb7gh","openshift-network-operator/iptables-alerter-9ttsg","openshift-ovn-kubernetes/ovnkube-node-2dzbk","kube-system/global-pull-secret-syncer-9xxgw","kube-system/konnectivity-agent-vbrfq","kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4kjrz","openshift-dns/node-resolver-2cr6p"]
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.131355    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.134178    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.134231    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.134253    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c6rhk\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.134291    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.134647    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.134814    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.135109    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.135264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.135499    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.135687    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.139134    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.141337    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.141432    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.141441    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.141527    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-whb5w\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.141664    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2cr6p"
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.143778    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.143910    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.143988    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wz42t\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.144030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.145955    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rgdbb\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.146149    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 16:20:36.165829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.146149    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.146517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vbrfq"
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.147550    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.148648    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.148708    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-s8td2\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.148850    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.148919    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.150988    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.151114    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.151144    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.151194    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z5kfv\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.151338    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.151439    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9ttsg"
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.153510    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.153614    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j7qlp\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.153629    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.153751    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.154018    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-smnmv"
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.156439    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.156449    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ltrq5\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.156457    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.156517    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.156718    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.156798    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.159164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.161401    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.161597    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.161624    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f46vz\""
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.161652    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:20:36.167000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.161664    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.167746    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-kubelet\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.167769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-run-netns\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.167786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-ovnkube-script-lib\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.167804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-run-systemd\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.167828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pd65\" (UniqueName: \"kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65\") pod \"network-check-target-rb879\" (UID: \"5fdd45e5-b1d4-4a66-996a-e35934bfeb30\") " pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.167887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-sys-fs\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.167930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-run-ovn\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.167955    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-var-lib-openvswitch\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.167971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-node-log\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-ovn-node-metrics-cert\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-registration-dir\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-log-socket\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168114    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-run-openvswitch\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.168674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-cni-bin\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.169483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.169483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-ovnkube-config\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.169483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-env-overrides\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.169483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhlkh\" (UniqueName: \"kubernetes.io/projected/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-kube-api-access-rhlkh\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.169483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.169483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-etc-selinux\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.169483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168372    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v494p\" (UniqueName: \"kubernetes.io/projected/be35697a-c932-42de-8573-bf920c3d5eee-kube-api-access-v494p\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.169483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-systemd-units\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.169483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-slash\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.169483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-cni-netd\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.169483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.169483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-device-dir\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.169483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168581    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-etc-openvswitch\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.170210 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.168608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-socket-dir\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.175489 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.175014    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qz4t2"
Jul 22 16:20:36.190969 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.190128    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qz4t2"
Jul 22 16:20:36.252858 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.216127    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 16:20:36.252858 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.235181    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269124    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-sys\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-tuned\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-run-netns\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn2h8\" (UniqueName: \"kubernetes.io/projected/165db51b-25b9-4e40-b397-b43dad8ea72e-kube-api-access-bn2h8\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269267    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-dbus\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269311    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-var-lib-openvswitch\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-node-log\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269424    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-var-lib-openvswitch\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-ovn-node-metrics-cert\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-node-log\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269599    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-sysctl-d\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-host\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269675    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3318273d-8948-43bf-bee1-d2072dc02332-serviceca\") pod \"node-ca-smnmv\" (UID: \"3318273d-8948-43bf-bee1-d2072dc02332\") " pod="openshift-image-registry/node-ca-smnmv"
Jul 22 16:20:36.323975 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269717    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-run-openvswitch\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-cni-bin\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269796    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-sysctl-conf\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-var-lib-kubelet\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-run-openvswitch\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269802    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-cni-bin\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78781944-15af-426a-ad46-41dbdcf83131-iptables-alerter-script\") pod \"iptables-alerter-9ttsg\" (UID: \"78781944-15af-426a-ad46-41dbdcf83131\") " pod="openshift-network-operator/iptables-alerter-9ttsg"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269920    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/149c47db-83da-464e-9f3e-1331ed99670c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.269992    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-ovnkube-config\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhlkh\" (UniqueName: \"kubernetes.io/projected/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-kube-api-access-rhlkh\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270021    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-etc-selinux\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.326968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-etc-selinux\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270278    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-systemd\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-tmp\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-run-k8s-cni-cncf-io\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-device-dir\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-var-lib-cni-bin\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m54jj\" (UniqueName: \"kubernetes.io/projected/3318273d-8948-43bf-bee1-d2072dc02332-kube-api-access-m54jj\") pod \"node-ca-smnmv\" (UID: \"3318273d-8948-43bf-bee1-d2072dc02332\") " pod="openshift-image-registry/node-ca-smnmv"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/149c47db-83da-464e-9f3e-1331ed99670c-cnibin\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-device-dir\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-etc-openvswitch\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270542    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-sysconfig\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-lib-modules\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-etc-openvswitch\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270589    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-ovnkube-config\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.328155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-etc-kubernetes\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270627    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78781944-15af-426a-ad46-41dbdcf83131-host-slash\") pod \"iptables-alerter-9ttsg\" (UID: \"78781944-15af-426a-ad46-41dbdcf83131\") " pod="openshift-network-operator/iptables-alerter-9ttsg"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/149c47db-83da-464e-9f3e-1331ed99670c-system-cni-dir\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-kubelet\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-os-release\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270750    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-kubelet-config\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pd65\" (UniqueName: \"kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65\") pod \"network-check-target-rb879\" (UID: \"5fdd45e5-b1d4-4a66-996a-e35934bfeb30\") " pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-modprobe-d\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270820    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-kubelet\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270833    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-run\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-system-cni-dir\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270916    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3318273d-8948-43bf-bee1-d2072dc02332-host\") pod \"node-ca-smnmv\" (UID: \"3318273d-8948-43bf-bee1-d2072dc02332\") " pod="openshift-image-registry/node-ca-smnmv"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7stzg\" (UniqueName: \"kubernetes.io/projected/406ea80e-5332-40e8-8bda-8edf582a17c9-kube-api-access-7stzg\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.270977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:36.330689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-run-ovn\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271044    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m76md\" (UniqueName: \"kubernetes.io/projected/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-kube-api-access-m76md\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-run-ovn\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/165db51b-25b9-4e40-b397-b43dad8ea72e-cni-binary-copy\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/165db51b-25b9-4e40-b397-b43dad8ea72e-multus-daemon-config\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271118    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-registration-dir\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77z5q\" (UniqueName: \"kubernetes.io/projected/3878f729-87e8-49d0-83bb-b172496e2119-kube-api-access-77z5q\") pod \"node-resolver-2cr6p\" (UID: \"3878f729-87e8-49d0-83bb-b172496e2119\") " pod="openshift-dns/node-resolver-2cr6p"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-hostroot\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/149c47db-83da-464e-9f3e-1331ed99670c-os-release\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-log-socket\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-registration-dir\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271275    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3878f729-87e8-49d0-83bb-b172496e2119-hosts-file\") pod \"node-resolver-2cr6p\" (UID: \"3878f729-87e8-49d0-83bb-b172496e2119\") " pod="openshift-dns/node-resolver-2cr6p"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-log-socket\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.331624 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-multus-socket-dir-parent\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.335339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271415    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdvp5\" (UniqueName: \"kubernetes.io/projected/78781944-15af-426a-ad46-41dbdcf83131-kube-api-access-sdvp5\") pod \"iptables-alerter-9ttsg\" (UID: \"78781944-15af-426a-ad46-41dbdcf83131\") " pod="openshift-network-operator/iptables-alerter-9ttsg"
Jul 22 16:20:36.335339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/149c47db-83da-464e-9f3e-1331ed99670c-cni-binary-copy\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.335339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-env-overrides\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.335339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.335339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271551    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v494p\" (UniqueName: \"kubernetes.io/projected/be35697a-c932-42de-8573-bf920c3d5eee-kube-api-access-v494p\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.335339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271579    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzllf\" (UniqueName: \"kubernetes.io/projected/149c47db-83da-464e-9f3e-1331ed99670c-kube-api-access-fzllf\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.335339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-systemd-units\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.335339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-slash\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.335339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-cni-netd\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.335339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.335339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271730    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-multus-conf-dir\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.335339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271760    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/149c47db-83da-464e-9f3e-1331ed99670c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.335339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-socket-dir\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-systemd-units\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-cnibin\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-var-lib-cni-multus\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271880    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-slash\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-var-lib-kubelet\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271914    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-run-multus-certs\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-cni-netd\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-run-netns\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.271990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-ovnkube-script-lib\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272020    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272022    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-env-overrides\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-multus-cni-dir\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.336726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-run-systemd\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-sys-fs\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-kubernetes\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-host-run-netns\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272165    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-socket-dir\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-run-systemd\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73b2362e-2c49-4a00-aaa8-0e1bb2203a52-agent-certs\") pod \"konnectivity-agent-vbrfq\" (UID: \"73b2362e-2c49-4a00-aaa8-0e1bb2203a52\") " pod="kube-system/konnectivity-agent-vbrfq"
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272241    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73b2362e-2c49-4a00-aaa8-0e1bb2203a52-konnectivity-ca\") pod \"konnectivity-agent-vbrfq\" (UID: \"73b2362e-2c49-4a00-aaa8-0e1bb2203a52\") " pod="kube-system/konnectivity-agent-vbrfq"
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/149c47db-83da-464e-9f3e-1331ed99670c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be35697a-c932-42de-8573-bf920c3d5eee-sys-fs\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3878f729-87e8-49d0-83bb-b172496e2119-tmp-dir\") pod \"node-resolver-2cr6p\" (UID: \"3878f729-87e8-49d0-83bb-b172496e2119\") " pod="openshift-dns/node-resolver-2cr6p"
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.272521    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-ovnkube-script-lib\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.274184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-ovn-node-metrics-cert\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.277444    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.277469    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:20:36.342853 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.277483    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5pd65 for pod openshift-network-diagnostics/network-check-target-rb879: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:20:36.344009 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.277577    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65 podName:5fdd45e5-b1d4-4a66-996a-e35934bfeb30 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:36.777549623 +0000 UTC m=+2.969752996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5pd65" (UniqueName: "kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65") pod "network-check-target-rb879" (UID: "5fdd45e5-b1d4-4a66-996a-e35934bfeb30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:20:36.344009 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.280524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhlkh\" (UniqueName: \"kubernetes.io/projected/2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91-kube-api-access-rhlkh\") pod \"ovnkube-node-2dzbk\" (UID: \"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.344009 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.283188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v494p\" (UniqueName: \"kubernetes.io/projected/be35697a-c932-42de-8573-bf920c3d5eee-kube-api-access-v494p\") pod \"aws-ebs-csi-driver-node-k9mt9\" (UID: \"be35697a-c932-42de-8573-bf920c3d5eee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78781944-15af-426a-ad46-41dbdcf83131-host-slash\") pod \"iptables-alerter-9ttsg\" (UID: \"78781944-15af-426a-ad46-41dbdcf83131\") " pod="openshift-network-operator/iptables-alerter-9ttsg"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373355    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/149c47db-83da-464e-9f3e-1331ed99670c-system-cni-dir\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-os-release\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373440    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78781944-15af-426a-ad46-41dbdcf83131-host-slash\") pod \"iptables-alerter-9ttsg\" (UID: \"78781944-15af-426a-ad46-41dbdcf83131\") " pod="openshift-network-operator/iptables-alerter-9ttsg"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-os-release\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-kubelet-config\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-modprobe-d\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373591    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/149c47db-83da-464e-9f3e-1331ed99670c-system-cni-dir\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-kubelet-config\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-run\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-system-cni-dir\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3318273d-8948-43bf-bee1-d2072dc02332-host\") pod \"node-ca-smnmv\" (UID: \"3318273d-8948-43bf-bee1-d2072dc02332\") " pod="openshift-image-registry/node-ca-smnmv"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373709    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-modprobe-d\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373726    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7stzg\" (UniqueName: \"kubernetes.io/projected/406ea80e-5332-40e8-8bda-8edf582a17c9-kube-api-access-7stzg\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:36.409726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3318273d-8948-43bf-bee1-d2072dc02332-host\") pod \"node-ca-smnmv\" (UID: \"3318273d-8948-43bf-bee1-d2072dc02332\") " pod="openshift-image-registry/node-ca-smnmv"
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373761    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-system-cni-dir\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m76md\" (UniqueName: \"kubernetes.io/projected/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-kube-api-access-m76md\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/165db51b-25b9-4e40-b397-b43dad8ea72e-cni-binary-copy\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373824    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-run\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/165db51b-25b9-4e40-b397-b43dad8ea72e-multus-daemon-config\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.373850    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77z5q\" (UniqueName: \"kubernetes.io/projected/3878f729-87e8-49d0-83bb-b172496e2119-kube-api-access-77z5q\") pod \"node-resolver-2cr6p\" (UID: \"3878f729-87e8-49d0-83bb-b172496e2119\") " pod="openshift-dns/node-resolver-2cr6p"
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.373936    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret podName:1e45ac08-35b3-438f-8cbf-aa2f8f4950c3 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:36.873896246 +0000 UTC m=+3.066099563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret") pod "global-pull-secret-syncer-9xxgw" (UID: "1e45ac08-35b3-438f-8cbf-aa2f8f4950c3") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.373973    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-hostroot\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/149c47db-83da-464e-9f3e-1331ed99670c-os-release\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374056    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3878f729-87e8-49d0-83bb-b172496e2119-hosts-file\") pod \"node-resolver-2cr6p\" (UID: \"3878f729-87e8-49d0-83bb-b172496e2119\") " pod="openshift-dns/node-resolver-2cr6p"
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.374073    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:20:36.412708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-multus-socket-dir-parent\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.374114    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs podName:406ea80e-5332-40e8-8bda-8edf582a17c9 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:36.874101034 +0000 UTC m=+3.066304345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs") pod "network-metrics-daemon-zdkhc" (UID: "406ea80e-5332-40e8-8bda-8edf582a17c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-multus-socket-dir-parent\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-hostroot\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/149c47db-83da-464e-9f3e-1331ed99670c-os-release\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3878f729-87e8-49d0-83bb-b172496e2119-hosts-file\") pod \"node-resolver-2cr6p\" (UID: \"3878f729-87e8-49d0-83bb-b172496e2119\") " pod="openshift-dns/node-resolver-2cr6p"
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdvp5\" (UniqueName: \"kubernetes.io/projected/78781944-15af-426a-ad46-41dbdcf83131-kube-api-access-sdvp5\") pod \"iptables-alerter-9ttsg\" (UID: \"78781944-15af-426a-ad46-41dbdcf83131\") " pod="openshift-network-operator/iptables-alerter-9ttsg"
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/149c47db-83da-464e-9f3e-1331ed99670c-cni-binary-copy\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374324    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzllf\" (UniqueName: \"kubernetes.io/projected/149c47db-83da-464e-9f3e-1331ed99670c-kube-api-access-fzllf\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-multus-conf-dir\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/149c47db-83da-464e-9f3e-1331ed99670c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-cnibin\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-var-lib-cni-multus\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374465    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-var-lib-kubelet\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.413670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-run-multus-certs\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-multus-cni-dir\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374548    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-kubernetes\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/165db51b-25b9-4e40-b397-b43dad8ea72e-cni-binary-copy\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73b2362e-2c49-4a00-aaa8-0e1bb2203a52-agent-certs\") pod \"konnectivity-agent-vbrfq\" (UID: \"73b2362e-2c49-4a00-aaa8-0e1bb2203a52\") " pod="kube-system/konnectivity-agent-vbrfq"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/165db51b-25b9-4e40-b397-b43dad8ea72e-multus-daemon-config\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73b2362e-2c49-4a00-aaa8-0e1bb2203a52-konnectivity-ca\") pod \"konnectivity-agent-vbrfq\" (UID: \"73b2362e-2c49-4a00-aaa8-0e1bb2203a52\") " pod="kube-system/konnectivity-agent-vbrfq"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374626    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-var-lib-kubelet\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/149c47db-83da-464e-9f3e-1331ed99670c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3878f729-87e8-49d0-83bb-b172496e2119-tmp-dir\") pod \"node-resolver-2cr6p\" (UID: \"3878f729-87e8-49d0-83bb-b172496e2119\") " pod="openshift-dns/node-resolver-2cr6p"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-sys\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-tuned\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-run-netns\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn2h8\" (UniqueName: \"kubernetes.io/projected/165db51b-25b9-4e40-b397-b43dad8ea72e-kube-api-access-bn2h8\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-dbus\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:36.484121 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-sysctl-d\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-kubernetes\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.374987    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-run-multus-certs\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-cnibin\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/149c47db-83da-464e-9f3e-1331ed99670c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-var-lib-cni-multus\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375112    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-multus-conf-dir\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375120    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/149c47db-83da-464e-9f3e-1331ed99670c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-multus-cni-dir\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-host\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3318273d-8948-43bf-bee1-d2072dc02332-serviceca\") pod \"node-ca-smnmv\" (UID: \"3318273d-8948-43bf-bee1-d2072dc02332\") " pod="openshift-image-registry/node-ca-smnmv"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-sysctl-conf\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-var-lib-kubelet\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78781944-15af-426a-ad46-41dbdcf83131-iptables-alerter-script\") pod \"iptables-alerter-9ttsg\" (UID: \"78781944-15af-426a-ad46-41dbdcf83131\") " pod="openshift-network-operator/iptables-alerter-9ttsg"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/149c47db-83da-464e-9f3e-1331ed99670c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.486102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-systemd\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-tmp\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-run-k8s-cni-cncf-io\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-var-lib-cni-bin\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m54jj\" (UniqueName: \"kubernetes.io/projected/3318273d-8948-43bf-bee1-d2072dc02332-kube-api-access-m54jj\") pod \"node-ca-smnmv\" (UID: \"3318273d-8948-43bf-bee1-d2072dc02332\") " pod="openshift-image-registry/node-ca-smnmv"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3878f729-87e8-49d0-83bb-b172496e2119-tmp-dir\") pod \"node-resolver-2cr6p\" (UID: \"3878f729-87e8-49d0-83bb-b172496e2119\") " pod="openshift-dns/node-resolver-2cr6p"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375693    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73b2362e-2c49-4a00-aaa8-0e1bb2203a52-konnectivity-ca\") pod \"konnectivity-agent-vbrfq\" (UID: \"73b2362e-2c49-4a00-aaa8-0e1bb2203a52\") " pod="kube-system/konnectivity-agent-vbrfq"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/149c47db-83da-464e-9f3e-1331ed99670c-cnibin\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-sysconfig\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-lib-modules\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-etc-kubernetes\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375755    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-run-netns\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-etc-kubernetes\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375963    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-sys\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.375972    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-host\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.487110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.376005    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-dbus\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.376120    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-sysctl-d\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.376424    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3318273d-8948-43bf-bee1-d2072dc02332-serviceca\") pod \"node-ca-smnmv\" (UID: \"3318273d-8948-43bf-bee1-d2072dc02332\") " pod="openshift-image-registry/node-ca-smnmv"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.376489    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-run-k8s-cni-cncf-io\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.376559    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/149c47db-83da-464e-9f3e-1331ed99670c-cnibin\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.376619    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-sysconfig\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.376724    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-lib-modules\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.376776    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-var-lib-kubelet\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.376897    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-sysctl-conf\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.377052    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/149c47db-83da-464e-9f3e-1331ed99670c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.377057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/149c47db-83da-464e-9f3e-1331ed99670c-cni-binary-copy\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.377117    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/165db51b-25b9-4e40-b397-b43dad8ea72e-host-var-lib-cni-bin\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.377124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-systemd\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.377128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78781944-15af-426a-ad46-41dbdcf83131-iptables-alerter-script\") pod \"iptables-alerter-9ttsg\" (UID: \"78781944-15af-426a-ad46-41dbdcf83131\") " pod="openshift-network-operator/iptables-alerter-9ttsg"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.378740    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73b2362e-2c49-4a00-aaa8-0e1bb2203a52-agent-certs\") pod \"konnectivity-agent-vbrfq\" (UID: \"73b2362e-2c49-4a00-aaa8-0e1bb2203a52\") " pod="kube-system/konnectivity-agent-vbrfq"
Jul 22 16:20:36.488786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.378975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-tmp\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.380687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-etc-tuned\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.386636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdvp5\" (UniqueName: \"kubernetes.io/projected/78781944-15af-426a-ad46-41dbdcf83131-kube-api-access-sdvp5\") pod \"iptables-alerter-9ttsg\" (UID: \"78781944-15af-426a-ad46-41dbdcf83131\") " pod="openshift-network-operator/iptables-alerter-9ttsg"
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.389676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn2h8\" (UniqueName: \"kubernetes.io/projected/165db51b-25b9-4e40-b397-b43dad8ea72e-kube-api-access-bn2h8\") pod \"multus-jb7gh\" (UID: \"165db51b-25b9-4e40-b397-b43dad8ea72e\") " pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.392325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzllf\" (UniqueName: \"kubernetes.io/projected/149c47db-83da-464e-9f3e-1331ed99670c-kube-api-access-fzllf\") pod \"multus-additional-cni-plugins-pp6jx\" (UID: \"149c47db-83da-464e-9f3e-1331ed99670c\") " pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.392503    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77z5q\" (UniqueName: \"kubernetes.io/projected/3878f729-87e8-49d0-83bb-b172496e2119-kube-api-access-77z5q\") pod \"node-resolver-2cr6p\" (UID: \"3878f729-87e8-49d0-83bb-b172496e2119\") " pod="openshift-dns/node-resolver-2cr6p"
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.392511    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m76md\" (UniqueName: \"kubernetes.io/projected/6982f7db-b258-4c3d-bf44-72fb5a4b89d1-kube-api-access-m76md\") pod \"tuned-4kjrz\" (UID: \"6982f7db-b258-4c3d-bf44-72fb5a4b89d1\") " pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.393060    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7stzg\" (UniqueName: \"kubernetes.io/projected/406ea80e-5332-40e8-8bda-8edf582a17c9-kube-api-access-7stzg\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.394588    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m54jj\" (UniqueName: \"kubernetes.io/projected/3318273d-8948-43bf-bee1-d2072dc02332-kube-api-access-m54jj\") pod \"node-ca-smnmv\" (UID: \"3318273d-8948-43bf-bee1-d2072dc02332\") " pod="openshift-image-registry/node-ca-smnmv"
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.410380    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal" event={"ID":"0914649e35306a68df1632ae34f49b6b","Type":"ContainerStarted","Data":"4a25c4641a963ae7a5db0f20388cb3640f84e140c13416074f6972fabe57e045"}
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.413126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" event={"ID":"fc23c176a2af80037228d601c235eb03","Type":"ContainerStarted","Data":"d88a050eab63f6aa064881fea85d2a2e39dca6d06e98cbfe143b9e6138ce3c4e"}
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.461812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.468040    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9"
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:36.475391    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc7e4d1_c769_4a8a_bbc6_81fc30d03e91.slice/crio-95dc7d449522680488718960d7c84033dc5442a1b3ca5408562764a38cc7065a WatchSource:0}: Error finding container 95dc7d449522680488718960d7c84033dc5442a1b3ca5408562764a38cc7065a: Status 404 returned error can't find the container with id 95dc7d449522680488718960d7c84033dc5442a1b3ca5408562764a38cc7065a
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.478390    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2cr6p"
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:36.482020    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe35697a_c932_42de_8573_bf920c3d5eee.slice/crio-edb4466ceb4059c15b325cc5714fe9c02b5abb0c6480c984b5ade875f18eee34 WatchSource:0}: Error finding container edb4466ceb4059c15b325cc5714fe9c02b5abb0c6480c984b5ade875f18eee34: Status 404 returned error can't find the container with id edb4466ceb4059c15b325cc5714fe9c02b5abb0c6480c984b5ade875f18eee34
Jul 22 16:20:36.489985 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.486132    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4kjrz"
Jul 22 16:20:36.497482 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:36.497286    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6982f7db_b258_4c3d_bf44_72fb5a4b89d1.slice/crio-e395be454f7cce3a17db8556f6de5420b03b6281ebb8d31dfe48fe6454b26e2f WatchSource:0}: Error finding container e395be454f7cce3a17db8556f6de5420b03b6281ebb8d31dfe48fe6454b26e2f: Status 404 returned error can't find the container with id e395be454f7cce3a17db8556f6de5420b03b6281ebb8d31dfe48fe6454b26e2f
Jul 22 16:20:36.500456 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.499535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vbrfq"
Jul 22 16:20:36.511216 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:36.511188    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b2362e_2c49_4a00_aaa8_0e1bb2203a52.slice/crio-f6f6f2cc681870e629c0035d24f6649d8557084eafa6fd5e0e3952ece339a560 WatchSource:0}: Error finding container f6f6f2cc681870e629c0035d24f6649d8557084eafa6fd5e0e3952ece339a560: Status 404 returned error can't find the container with id f6f6f2cc681870e629c0035d24f6649d8557084eafa6fd5e0e3952ece339a560
Jul 22 16:20:36.511358 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.511347    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jb7gh"
Jul 22 16:20:36.525736 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:36.525538    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165db51b_25b9_4e40_b397_b43dad8ea72e.slice/crio-a5a1a6ea8e09054c84437d44dbb6c1179215fa88e89713ad6282103c4c1405e3 WatchSource:0}: Error finding container a5a1a6ea8e09054c84437d44dbb6c1179215fa88e89713ad6282103c4c1405e3: Status 404 returned error can't find the container with id a5a1a6ea8e09054c84437d44dbb6c1179215fa88e89713ad6282103c4c1405e3
Jul 22 16:20:36.546820 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.546783    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9ttsg"
Jul 22 16:20:36.555837 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.555810    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-smnmv"
Jul 22 16:20:36.558541 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:36.558512    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78781944_15af_426a_ad46_41dbdcf83131.slice/crio-d18a56f1f6cced505a6b9704f0b7694909abf82f4c647c1da5531b73a40c5df0 WatchSource:0}: Error finding container d18a56f1f6cced505a6b9704f0b7694909abf82f4c647c1da5531b73a40c5df0: Status 404 returned error can't find the container with id d18a56f1f6cced505a6b9704f0b7694909abf82f4c647c1da5531b73a40c5df0
Jul 22 16:20:36.564041 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.563875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pp6jx"
Jul 22 16:20:36.569382 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:36.569350    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3318273d_8948_43bf_bee1_d2072dc02332.slice/crio-938f03c5e56452a17e10f8560309c8daa0498bf553c909a66cdd4d9fb507116e WatchSource:0}: Error finding container 938f03c5e56452a17e10f8560309c8daa0498bf553c909a66cdd4d9fb507116e: Status 404 returned error can't find the container with id 938f03c5e56452a17e10f8560309c8daa0498bf553c909a66cdd4d9fb507116e
Jul 22 16:20:36.577381 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:20:36.577354    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149c47db_83da_464e_9f3e_1331ed99670c.slice/crio-c165383364d333ff71b1145982991ada613edf328c1de659464f02fd3acb3a6f WatchSource:0}: Error finding container c165383364d333ff71b1145982991ada613edf328c1de659464f02fd3acb3a6f: Status 404 returned error can't find the container with id c165383364d333ff71b1145982991ada613edf328c1de659464f02fd3acb3a6f
Jul 22 16:20:36.778820 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.778729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pd65\" (UniqueName: \"kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65\") pod \"network-check-target-rb879\" (UID: \"5fdd45e5-b1d4-4a66-996a-e35934bfeb30\") " pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:36.778998 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.778928    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:20:36.778998 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.778952    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:20:36.778998 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.778964    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5pd65 for pod openshift-network-diagnostics/network-check-target-rb879: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:20:36.779155 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.779023    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65 podName:5fdd45e5-b1d4-4a66-996a-e35934bfeb30 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:37.779002515 +0000 UTC m=+3.971205813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5pd65" (UniqueName: "kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65") pod "network-check-target-rb879" (UID: "5fdd45e5-b1d4-4a66-996a-e35934bfeb30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:20:36.879323 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.879262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:36.879323 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:36.879327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:36.879569 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.879381    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:20:36.879569 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.879465    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:20:36.879569 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.879474    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret podName:1e45ac08-35b3-438f-8cbf-aa2f8f4950c3 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:37.879452689 +0000 UTC m=+4.071656001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret") pod "global-pull-secret-syncer-9xxgw" (UID: "1e45ac08-35b3-438f-8cbf-aa2f8f4950c3") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:20:36.879569 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:36.879517    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs podName:406ea80e-5332-40e8-8bda-8edf582a17c9 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:37.879501374 +0000 UTC m=+4.071704687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs") pod "network-metrics-daemon-zdkhc" (UID: "406ea80e-5332-40e8-8bda-8edf582a17c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:20:37.194047 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.193954    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 16:15:36 +0000 UTC" deadline="2028-04-27 06:46:21.481638498 +0000 UTC"
Jul 22 16:20:37.194047 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.194040    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15470h25m44.287602365s"
Jul 22 16:20:37.403112 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.403085    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:37.403860 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:37.403236    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:20:37.403860 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.403401    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:37.403860 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:37.403518    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:20:37.416873 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.416840    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp6jx" event={"ID":"149c47db-83da-464e-9f3e-1331ed99670c","Type":"ContainerStarted","Data":"c165383364d333ff71b1145982991ada613edf328c1de659464f02fd3acb3a6f"}
Jul 22 16:20:37.418386 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.418358    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-smnmv" event={"ID":"3318273d-8948-43bf-bee1-d2072dc02332","Type":"ContainerStarted","Data":"938f03c5e56452a17e10f8560309c8daa0498bf553c909a66cdd4d9fb507116e"}
Jul 22 16:20:37.419876 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.419844    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jb7gh" event={"ID":"165db51b-25b9-4e40-b397-b43dad8ea72e","Type":"ContainerStarted","Data":"a5a1a6ea8e09054c84437d44dbb6c1179215fa88e89713ad6282103c4c1405e3"}
Jul 22 16:20:37.422061 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.422032    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4kjrz" event={"ID":"6982f7db-b258-4c3d-bf44-72fb5a4b89d1","Type":"ContainerStarted","Data":"e395be454f7cce3a17db8556f6de5420b03b6281ebb8d31dfe48fe6454b26e2f"}
Jul 22 16:20:37.424299 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.424063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2cr6p" event={"ID":"3878f729-87e8-49d0-83bb-b172496e2119","Type":"ContainerStarted","Data":"506eb008926905cf677dfc544366fe5c8f204192490c278ca5f8d3f7d780c0c2"}
Jul 22 16:20:37.426952 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.426928    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk" event={"ID":"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91","Type":"ContainerStarted","Data":"95dc7d449522680488718960d7c84033dc5442a1b3ca5408562764a38cc7065a"}
Jul 22 16:20:37.428350 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.428329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9ttsg" event={"ID":"78781944-15af-426a-ad46-41dbdcf83131","Type":"ContainerStarted","Data":"d18a56f1f6cced505a6b9704f0b7694909abf82f4c647c1da5531b73a40c5df0"}
Jul 22 16:20:37.429793 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.429766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vbrfq" event={"ID":"73b2362e-2c49-4a00-aaa8-0e1bb2203a52","Type":"ContainerStarted","Data":"f6f6f2cc681870e629c0035d24f6649d8557084eafa6fd5e0e3952ece339a560"}
Jul 22 16:20:37.431010 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.430949    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9" event={"ID":"be35697a-c932-42de-8573-bf920c3d5eee","Type":"ContainerStarted","Data":"edb4466ceb4059c15b325cc5714fe9c02b5abb0c6480c984b5ade875f18eee34"}
Jul 22 16:20:37.787589 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.787549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pd65\" (UniqueName: \"kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65\") pod \"network-check-target-rb879\" (UID: \"5fdd45e5-b1d4-4a66-996a-e35934bfeb30\") " pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:37.787802 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:37.787783    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:20:37.787867 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:37.787805    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:20:37.787867 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:37.787820    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5pd65 for pod openshift-network-diagnostics/network-check-target-rb879: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:20:37.787978 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:37.787883    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65 podName:5fdd45e5-b1d4-4a66-996a-e35934bfeb30 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:39.787862622 +0000 UTC m=+5.980065940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5pd65" (UniqueName: "kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65") pod "network-check-target-rb879" (UID: "5fdd45e5-b1d4-4a66-996a-e35934bfeb30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:20:37.882665 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.882627    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 16:20:37.888913 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.888871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:37.889143 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:37.888924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:37.889143 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:37.889064    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:20:37.889143 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:37.889127    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs podName:406ea80e-5332-40e8-8bda-8edf582a17c9 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:39.8891077 +0000 UTC m=+6.081311006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs") pod "network-metrics-daemon-zdkhc" (UID: "406ea80e-5332-40e8-8bda-8edf582a17c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:20:37.889626 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:37.889604    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:20:37.889725 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:37.889665    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret podName:1e45ac08-35b3-438f-8cbf-aa2f8f4950c3 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:39.889648513 +0000 UTC m=+6.081851817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret") pod "global-pull-secret-syncer-9xxgw" (UID: "1e45ac08-35b3-438f-8cbf-aa2f8f4950c3") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:20:38.194801 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:38.194753    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 16:15:36 +0000 UTC" deadline="2028-04-06 12:17:56.05155339 +0000 UTC"
Jul 22 16:20:38.194801 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:38.194799    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14971h57m17.856759715s"
Jul 22 16:20:38.406443 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:38.405805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:38.406443 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:38.405942    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:20:39.404449 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:39.403663    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:39.404449 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:39.403837    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:20:39.404449 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:39.404278    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:39.404449 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:39.404395    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:20:39.807504 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:39.807465    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pd65\" (UniqueName: \"kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65\") pod \"network-check-target-rb879\" (UID: \"5fdd45e5-b1d4-4a66-996a-e35934bfeb30\") " pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:39.807970 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:39.807661    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:20:39.807970 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:39.807692    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:20:39.807970 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:39.807706    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5pd65 for pod openshift-network-diagnostics/network-check-target-rb879: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:20:39.807970 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:39.807773    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65 podName:5fdd45e5-b1d4-4a66-996a-e35934bfeb30 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:43.807753749 +0000 UTC m=+9.999957062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5pd65" (UniqueName: "kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65") pod "network-check-target-rb879" (UID: "5fdd45e5-b1d4-4a66-996a-e35934bfeb30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:20:39.909737 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:39.908803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:39.909737 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:39.908886    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:39.909737 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:39.909119    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:20:39.909737 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:39.909188    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs podName:406ea80e-5332-40e8-8bda-8edf582a17c9 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:43.909168268 +0000 UTC m=+10.101371569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs") pod "network-metrics-daemon-zdkhc" (UID: "406ea80e-5332-40e8-8bda-8edf582a17c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:20:39.909737 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:39.909591    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:20:39.909737 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:39.909642    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret podName:1e45ac08-35b3-438f-8cbf-aa2f8f4950c3 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:43.909627456 +0000 UTC m=+10.101830758 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret") pod "global-pull-secret-syncer-9xxgw" (UID: "1e45ac08-35b3-438f-8cbf-aa2f8f4950c3") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:20:40.403398 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:40.403361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:40.403614 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:40.403505    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:20:41.403811 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:41.403250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:41.403811 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:41.403360    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:20:41.403811 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:41.403672    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:41.403811 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:41.403745    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:20:42.403105 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:42.403065    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:42.403322 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:42.403201    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:20:43.403024 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:43.402991    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:43.403468 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:43.403000    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:43.403468 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:43.403109    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:20:43.403468 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:43.403260    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:20:43.846884 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:43.846838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pd65\" (UniqueName: \"kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65\") pod \"network-check-target-rb879\" (UID: \"5fdd45e5-b1d4-4a66-996a-e35934bfeb30\") " pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:43.847055 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:43.846995    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:20:43.847055 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:43.847025    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:20:43.847055 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:43.847042    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5pd65 for pod openshift-network-diagnostics/network-check-target-rb879: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:20:43.847244 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:43.847112    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65 podName:5fdd45e5-b1d4-4a66-996a-e35934bfeb30 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:51.847092604 +0000 UTC m=+18.039295927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5pd65" (UniqueName: "kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65") pod "network-check-target-rb879" (UID: "5fdd45e5-b1d4-4a66-996a-e35934bfeb30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:20:43.947586 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:43.947547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:43.947770 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:43.947605    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:43.947770 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:43.947715    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:20:43.947770 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:43.947743    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:20:43.947921 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:43.947790    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret podName:1e45ac08-35b3-438f-8cbf-aa2f8f4950c3 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:51.947768095 +0000 UTC m=+18.139971411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret") pod "global-pull-secret-syncer-9xxgw" (UID: "1e45ac08-35b3-438f-8cbf-aa2f8f4950c3") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:20:43.947921 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:43.947814    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs podName:406ea80e-5332-40e8-8bda-8edf582a17c9 nodeName:}" failed. No retries permitted until 2026-07-22 16:20:51.947802796 +0000 UTC m=+18.140006093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs") pod "network-metrics-daemon-zdkhc" (UID: "406ea80e-5332-40e8-8bda-8edf582a17c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:20:44.403142 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:44.403101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:44.403619 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:44.403260    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:20:45.402937 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:45.402902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:45.403132 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:45.403040    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:20:45.403199 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:45.403130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:45.403577 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:45.403260    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:20:46.402911 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:46.402724    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:46.403090 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:46.403023    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:20:47.403276 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:47.403255    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:47.403544 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:47.403255    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:47.403544 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:47.403370    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:20:47.403544 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:47.403425    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:20:48.402570 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:48.402532    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:48.402758 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:48.402666    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:20:49.403199 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:49.403165    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:49.403645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:49.403164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:49.403645 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:49.403314    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:20:49.403645 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:49.403472    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:20:50.403215 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:50.403176    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:50.403651 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:50.403329    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:20:51.403303 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:51.403264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:51.403303 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:51.403290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:51.403795 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:51.403393    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:20:51.403795 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:51.403510    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:20:51.904667 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:51.904632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pd65\" (UniqueName: \"kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65\") pod \"network-check-target-rb879\" (UID: \"5fdd45e5-b1d4-4a66-996a-e35934bfeb30\") " pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:51.904833 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:51.904796    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:20:51.904833 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:51.904818    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:20:51.904833 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:51.904833    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5pd65 for pod openshift-network-diagnostics/network-check-target-rb879: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:20:51.904968 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:51.904892    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65 podName:5fdd45e5-b1d4-4a66-996a-e35934bfeb30 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:07.904876237 +0000 UTC m=+34.097079546 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5pd65" (UniqueName: "kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65") pod "network-check-target-rb879" (UID: "5fdd45e5-b1d4-4a66-996a-e35934bfeb30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:20:52.005261 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:52.005216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:52.005261 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:52.005266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:52.005470 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:52.005395    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:20:52.005470 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:52.005408    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:20:52.005470 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:52.005468    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs podName:406ea80e-5332-40e8-8bda-8edf582a17c9 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:08.005452852 +0000 UTC m=+34.197656167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs") pod "network-metrics-daemon-zdkhc" (UID: "406ea80e-5332-40e8-8bda-8edf582a17c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:20:52.005621 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:52.005484    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret podName:1e45ac08-35b3-438f-8cbf-aa2f8f4950c3 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:08.00547692 +0000 UTC m=+34.197680217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret") pod "global-pull-secret-syncer-9xxgw" (UID: "1e45ac08-35b3-438f-8cbf-aa2f8f4950c3") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:20:52.403382 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:52.403104    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:52.403830 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:52.403487    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:20:53.403029 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:53.402991    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:53.403248 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:53.403037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:53.403248 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:53.403139    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:20:53.403374 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:53.403299    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:20:54.403289 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:54.403256    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:54.403713 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:54.403369    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:20:55.402994 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:55.402957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:55.403157 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:55.402995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:55.403157 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:55.403101    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:20:55.403272 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:55.403242    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:20:56.402552 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.402320    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:56.403194 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:56.402669    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:20:56.472851 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.472269    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2cr6p" event={"ID":"3878f729-87e8-49d0-83bb-b172496e2119","Type":"ContainerStarted","Data":"c11809035d8ba3408578ca7e30b83158fb4cde7c8d9083bc7ccbc1729e79e931"}
Jul 22 16:20:56.475067 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.475043    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk" event={"ID":"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91","Type":"ContainerStarted","Data":"3b6cf44b373a0ff401e3b6d1ddba536fbb5e4d0ee0eb7bf54d2d1c9043c7282d"}
Jul 22 16:20:56.475192 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.475119    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk" event={"ID":"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91","Type":"ContainerStarted","Data":"cecbfc1c431cd9606a8af32376de2394e8c494982f554174815d342082b0a427"}
Jul 22 16:20:56.475192 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.475168    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk" event={"ID":"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91","Type":"ContainerStarted","Data":"2177cf10851763c1d828ce2f190467a4fc7e304534efd0473318a3a41cc5a8b4"}
Jul 22 16:20:56.476286 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.476261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vbrfq" event={"ID":"73b2362e-2c49-4a00-aaa8-0e1bb2203a52","Type":"ContainerStarted","Data":"d755be94d01f44e318f01b7298ccdb13dbd10b1b35bbc013c5ed6bcd32e71edc"}
Jul 22 16:20:56.477623 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.477602    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9" event={"ID":"be35697a-c932-42de-8573-bf920c3d5eee","Type":"ContainerStarted","Data":"2c7b2bbfd277cfcc8ea143122379fe253693b43d1db6ae9830279a3a445b7097"}
Jul 22 16:20:56.478883 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.478864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal" event={"ID":"0914649e35306a68df1632ae34f49b6b","Type":"ContainerStarted","Data":"f5d612530dc3284a8b4d55840025311c56035c1dbd6ee4555677447b20341a08"}
Jul 22 16:20:56.480101 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.480082    2580 generic.go:356] "Generic (PLEG): container finished" podID="fc23c176a2af80037228d601c235eb03" containerID="9f423593d8e29283f50db7954e4533cc38a658c22f25205ac91be830c3c0f2ea" exitCode=0
Jul 22 16:20:56.480166 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.480140    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" event={"ID":"fc23c176a2af80037228d601c235eb03","Type":"ContainerDied","Data":"9f423593d8e29283f50db7954e4533cc38a658c22f25205ac91be830c3c0f2ea"}
Jul 22 16:20:56.481617 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.481589    2580 generic.go:356] "Generic (PLEG): container finished" podID="149c47db-83da-464e-9f3e-1331ed99670c" containerID="390afa2e5d60f242243519f47108f3f4cf3859af2de81b5b7766a3ddfd0ea292" exitCode=0
Jul 22 16:20:56.481691 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.481614    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp6jx" event={"ID":"149c47db-83da-464e-9f3e-1331ed99670c","Type":"ContainerDied","Data":"390afa2e5d60f242243519f47108f3f4cf3859af2de81b5b7766a3ddfd0ea292"}
Jul 22 16:20:56.483126 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.483105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-smnmv" event={"ID":"3318273d-8948-43bf-bee1-d2072dc02332","Type":"ContainerStarted","Data":"c9a099821c684d5624e9e0b3969cc6a7794c1ee2ab072227bbfe8f6cd5db9393"}
Jul 22 16:20:56.484674 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.484651    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jb7gh" event={"ID":"165db51b-25b9-4e40-b397-b43dad8ea72e","Type":"ContainerStarted","Data":"f023f27caa3c3062de0ce7897b8f1ffc100e045e90923d8853ccb58ce01c59d3"}
Jul 22 16:20:56.486095 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.486074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4kjrz" event={"ID":"6982f7db-b258-4c3d-bf44-72fb5a4b89d1","Type":"ContainerStarted","Data":"daa467dcd241c65cdcb82765778b9a3557f21d64abb95096e8defe805431be50"}
Jul 22 16:20:56.493809 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.493766    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2cr6p" podStartSLOduration=3.077634397 podStartE2EDuration="22.493753677s" totalImagesPullingTime="19.41611928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:20:56.493287712 +0000 UTC m=+22.685491032" watchObservedRunningTime="2026-07-22 16:20:56.493753677 +0000 UTC m=+22.685956995"
Jul 22 16:20:56.524103 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.524062    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vbrfq" podStartSLOduration=3.556963235 podStartE2EDuration="22.524048074s" totalImagesPullingTime="18.967084839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:20:56.523742073 +0000 UTC m=+22.715945392" watchObservedRunningTime="2026-07-22 16:20:56.524048074 +0000 UTC m=+22.716251393"
Jul 22 16:20:56.524204 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.524133    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-140.ec2.internal" podStartSLOduration=21.524127651 podStartE2EDuration="21.524127651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:20:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:20:56.507197261 +0000 UTC m=+22.699400579" watchObservedRunningTime="2026-07-22 16:20:56.524127651 +0000 UTC m=+22.716330972"
Jul 22 16:20:56.545174 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.545135    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jb7gh" podStartSLOduration=3.151644821 podStartE2EDuration="22.545121018s" totalImagesPullingTime="19.393476197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:20:56.544797891 +0000 UTC m=+22.737001210" watchObservedRunningTime="2026-07-22 16:20:56.545121018 +0000 UTC m=+22.737324336"
Jul 22 16:20:56.560338 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.560301    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-smnmv" podStartSLOduration=2.651460266 podStartE2EDuration="21.560288464s" totalImagesPullingTime="18.908828198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:20:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:20:56.560049198 +0000 UTC m=+22.752252538" watchObservedRunningTime="2026-07-22 16:20:56.560288464 +0000 UTC m=+22.752491782"
Jul 22 16:20:56.579358 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:56.579320    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4kjrz" podStartSLOduration=3.169928677 podStartE2EDuration="22.579306859s" totalImagesPullingTime="19.409378182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:20:56.578804836 +0000 UTC m=+22.771008156" watchObservedRunningTime="2026-07-22 16:20:56.579306859 +0000 UTC m=+22.771510178"
Jul 22 16:20:57.403119 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:57.402930    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:57.403546 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:57.402991    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:57.403546 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:57.403247    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:20:57.403546 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:57.403300    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:20:57.492147 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:57.492107    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk" event={"ID":"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91","Type":"ContainerStarted","Data":"47a2000b228594af97b8285452a7d62117c9cf05a85d49c813d4c2ae7aa832ec"}
Jul 22 16:20:57.492327 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:57.492204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk" event={"ID":"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91","Type":"ContainerStarted","Data":"3ecbdda3087191edae3ecd5974cbb372dc2dac643eeb6de37ef7abcd230e1aff"}
Jul 22 16:20:57.492327 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:57.492267    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk" event={"ID":"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91","Type":"ContainerStarted","Data":"e2de787ad83458b57180cf22df35f51b769b08361a3ea61b186021b949a3a985"}
Jul 22 16:20:57.493771 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:57.493735    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9ttsg" event={"ID":"78781944-15af-426a-ad46-41dbdcf83131","Type":"ContainerStarted","Data":"aff0d57427158a0fafe6c3e50dbeb9428b045c1b87d16f7e7bec78848d2e9692"}
Jul 22 16:20:57.530728 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:57.530688    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9ttsg" podStartSLOduration=4.185671016 podStartE2EDuration="23.530672451s" totalImagesPullingTime="19.345001435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:20:57.513049738 +0000 UTC m=+23.705253081" watchObservedRunningTime="2026-07-22 16:20:57.530672451 +0000 UTC m=+23.722875773"
Jul 22 16:20:57.645785 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:57.645743    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 16:20:58.229490 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:58.229296    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T16:20:57.645764183Z","UUID":"4c4c6ffe-82fd-4fb9-8892-4ce8c8b07320","Handler":null,"Name":"","Endpoint":""}
Jul 22 16:20:58.230971 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:58.230950    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 16:20:58.231101 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:58.231015    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 16:20:58.402607 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:58.402529    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:20:58.402800 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:58.402665    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:20:58.498460 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:58.498379    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9" event={"ID":"be35697a-c932-42de-8573-bf920c3d5eee","Type":"ContainerStarted","Data":"0f4093eb036de4d159b691a2c3e7ad49d6e3e7f84bafd160a8bc9cf58ac480f0"}
Jul 22 16:20:58.502028 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:58.501996    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" event={"ID":"fc23c176a2af80037228d601c235eb03","Type":"ContainerStarted","Data":"679d883dbe181643a9822fcf214a47929b33c3d8d6982bf2505615e55c200b15"}
Jul 22 16:20:58.519106 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:58.519061    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-140.ec2.internal" podStartSLOduration=23.519035963 podStartE2EDuration="23.519035963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:20:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:20:58.518513028 +0000 UTC m=+24.710716372" watchObservedRunningTime="2026-07-22 16:20:58.519035963 +0000 UTC m=+24.711239281"
Jul 22 16:20:59.141928 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:59.141891    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vbrfq"
Jul 22 16:20:59.142671 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:59.142648    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vbrfq"
Jul 22 16:20:59.403045 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:59.402972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:20:59.403235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:59.402990    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:20:59.403235 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:59.403116    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:20:59.403235 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:20:59.403208    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:20:59.508343 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:59.508307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk" event={"ID":"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91","Type":"ContainerStarted","Data":"61fb1b52534dace2ccec8719ac465a52679b2868b550643c768c666bf728c3fb"}
Jul 22 16:20:59.510683 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:59.510652    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9" event={"ID":"be35697a-c932-42de-8573-bf920c3d5eee","Type":"ContainerStarted","Data":"3ce570d1872b4c7f71ca9893afc0da8ff6fbba79f8e10a0ce39dc7d2d249630c"}
Jul 22 16:20:59.529381 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:20:59.529328    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9mt9" podStartSLOduration=4.245424693 podStartE2EDuration="25.529309557s" totalImagesPullingTime="21.283884864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:20:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:20:59.528973 +0000 UTC m=+25.721176319" watchObservedRunningTime="2026-07-22 16:20:59.529309557 +0000 UTC m=+25.721512881"
Jul 22 16:21:00.402833 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:00.402794    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:21:00.403023 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:00.402930    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:21:01.402330 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:01.402303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:21:01.402907 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:01.402303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:21:01.402907 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:01.402431    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:21:01.402907 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:01.402471    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:21:01.516363 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:01.516328    2580 generic.go:356] "Generic (PLEG): container finished" podID="149c47db-83da-464e-9f3e-1331ed99670c" containerID="49c42791b155c3808947629c4ed27dae0d24df3289c2d456c0120e0c73d247fb" exitCode=0
Jul 22 16:21:01.516532 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:01.516408    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp6jx" event={"ID":"149c47db-83da-464e-9f3e-1331ed99670c","Type":"ContainerDied","Data":"49c42791b155c3808947629c4ed27dae0d24df3289c2d456c0120e0c73d247fb"}
Jul 22 16:21:01.520156 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:01.520134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk" event={"ID":"2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91","Type":"ContainerStarted","Data":"0c8511dada963895d341f4e107bb0147c30cf4678c3c3bba12ebaa2aba6c637c"}
Jul 22 16:21:01.520407 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:01.520395    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:21:01.535449 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:01.535428    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:21:01.575096 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:01.575053    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk" podStartSLOduration=8.064959289 podStartE2EDuration="27.575036659s" totalImagesPullingTime="19.51007737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:01.574255768 +0000 UTC m=+27.766459108" watchObservedRunningTime="2026-07-22 16:21:01.575036659 +0000 UTC m=+27.767239977"
Jul 22 16:21:02.403330 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:02.403296    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:21:02.403879 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:02.403405    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:21:02.522490 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:02.522463    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 22 16:21:02.522874 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:02.522853    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:21:02.539021 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:02.538988    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:21:03.200883 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:03.200691    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9xxgw"]
Jul 22 16:21:03.201048 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:03.200967    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:21:03.201139 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:03.201091    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:21:03.203753 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:03.203728    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rb879"]
Jul 22 16:21:03.203881 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:03.203822    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:21:03.203934 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:03.203899    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:21:03.206538 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:03.206516    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zdkhc"]
Jul 22 16:21:03.206634 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:03.206606    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:21:03.206698 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:03.206683    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:21:03.527359 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:03.527268    2580 generic.go:356] "Generic (PLEG): container finished" podID="149c47db-83da-464e-9f3e-1331ed99670c" containerID="7cc0596e193f57176476398149b12c201af7bc7d29e7c23d1047605bb76cb14c" exitCode=0
Jul 22 16:21:03.527801 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:03.527360    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp6jx" event={"ID":"149c47db-83da-464e-9f3e-1331ed99670c","Type":"ContainerDied","Data":"7cc0596e193f57176476398149b12c201af7bc7d29e7c23d1047605bb76cb14c"}
Jul 22 16:21:03.527801 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:03.527449    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 22 16:21:04.402988 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:04.402952    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:21:04.403182 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:04.403050    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:21:04.532545 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:04.532517    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 22 16:21:05.402598 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:05.402567    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:21:05.402768 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:05.402575    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:21:05.402768 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:05.402668    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:21:05.402768 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:05.402744    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:21:05.537606 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:05.537567    2580 generic.go:356] "Generic (PLEG): container finished" podID="149c47db-83da-464e-9f3e-1331ed99670c" containerID="9fe0d7e622e486ea1b377939e805538bf1f0b83dc0e667241fce603a8d08abb8" exitCode=0
Jul 22 16:21:05.537986 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:05.537613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp6jx" event={"ID":"149c47db-83da-464e-9f3e-1331ed99670c","Type":"ContainerDied","Data":"9fe0d7e622e486ea1b377939e805538bf1f0b83dc0e667241fce603a8d08abb8"}
Jul 22 16:21:05.709298 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:05.709216    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:21:05.709477 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:05.709462    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 22 16:21:05.723783 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:05.723741    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk" podUID="2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 22 16:21:05.732991 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:05.732956    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk" podUID="2dc7e4d1-c769-4a8a-bbc6-81fc30d03e91" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 22 16:21:06.082055 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:06.081970    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vbrfq"
Jul 22 16:21:06.082212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:06.082102    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 22 16:21:06.082731 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:06.082714    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vbrfq"
Jul 22 16:21:06.403450 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:06.403419    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:21:06.403622 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:06.403571    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:21:07.402463 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:07.402430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:21:07.402900 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:07.402481    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:21:07.402900 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:07.402568    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xxgw" podUID="1e45ac08-35b3-438f-8cbf-aa2f8f4950c3"
Jul 22 16:21:07.402900 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:07.402694    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb879" podUID="5fdd45e5-b1d4-4a66-996a-e35934bfeb30"
Jul 22 16:21:07.919585 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:07.919550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pd65\" (UniqueName: \"kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65\") pod \"network-check-target-rb879\" (UID: \"5fdd45e5-b1d4-4a66-996a-e35934bfeb30\") " pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:21:07.919740 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:07.919712    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 16:21:07.919740 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:07.919732    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 16:21:07.919808 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:07.919742    2580 projected.go:196] Error preparing data for projected volume kube-api-access-5pd65 for pod openshift-network-diagnostics/network-check-target-rb879: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:21:07.919808 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:07.919794    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65 podName:5fdd45e5-b1d4-4a66-996a-e35934bfeb30 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:39.91977784 +0000 UTC m=+66.111981158 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5pd65" (UniqueName: "kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65") pod "network-check-target-rb879" (UID: "5fdd45e5-b1d4-4a66-996a-e35934bfeb30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 16:21:08.020353 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.020307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:21:08.020549 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.020361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:21:08.020549 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:08.020491    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 16:21:08.020664 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:08.020568    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret podName:1e45ac08-35b3-438f-8cbf-aa2f8f4950c3 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:40.020548103 +0000 UTC m=+66.212751413 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret") pod "global-pull-secret-syncer-9xxgw" (UID: "1e45ac08-35b3-438f-8cbf-aa2f8f4950c3") : object "kube-system"/"original-pull-secret" not registered
Jul 22 16:21:08.020664 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:08.020498    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:21:08.020664 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:08.020626    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs podName:406ea80e-5332-40e8-8bda-8edf582a17c9 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:40.020614823 +0000 UTC m=+66.212818135 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs") pod "network-metrics-daemon-zdkhc" (UID: "406ea80e-5332-40e8-8bda-8edf582a17c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 16:21:08.403147 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.403109    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:21:08.403615 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:08.403279    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdkhc" podUID="406ea80e-5332-40e8-8bda-8edf582a17c9"
Jul 22 16:21:08.618780 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.618567    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-140.ec2.internal" event="NodeReady"
Jul 22 16:21:08.618968 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.618929    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 16:21:08.656341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.656260    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58f7d8dc56-lct4l"]
Jul 22 16:21:08.688535 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.688507    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58f7d8dc56-lct4l"]
Jul 22 16:21:08.688704 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.688549    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5h2xr"]
Jul 22 16:21:08.689253 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.689214    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.691492 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.691471    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 16:21:08.691609 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.691557    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 16:21:08.691818 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.691797    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-88qfg\""
Jul 22 16:21:08.691933 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.691803    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 16:21:08.704478 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.704444    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pw65x"]
Jul 22 16:21:08.704639 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.704618    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:08.704974 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.704957    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 16:21:08.706918 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.706900    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 16:21:08.707031 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.706900    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 16:21:08.707031 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.706944    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4ntcb\""
Jul 22 16:21:08.722698 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.722663    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pw65x"]
Jul 22 16:21:08.722698 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.722701    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5h2xr"]
Jul 22 16:21:08.722857 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.722772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pw65x"
Jul 22 16:21:08.725309 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.725080    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 16:21:08.725309 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.725080    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 16:21:08.725309 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.725165    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 16:21:08.725309 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.725089    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4chrv\""
Jul 22 16:21:08.827485 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.827669 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827504    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63e12931-5100-4df3-a0c6-6a9943036f02-cert\") pod \"ingress-canary-pw65x\" (UID: \"63e12931-5100-4df3-a0c6-6a9943036f02\") " pod="openshift-ingress-canary/ingress-canary-pw65x"
Jul 22 16:21:08.827669 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-certificates\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.827669 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4dlh\" (UniqueName: \"kubernetes.io/projected/6b43f2cc-b438-4d0f-b109-14165ae92064-kube-api-access-w4dlh\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:08.827669 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827636    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10be6c66-7f28-4c48-b071-f560ca3dbdcd-ca-trust-extracted\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.827865 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827664    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:08.827865 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10be6c66-7f28-4c48-b071-f560ca3dbdcd-trusted-ca\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.827865 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827783    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b43f2cc-b438-4d0f-b109-14165ae92064-config-volume\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:08.827865 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10be6c66-7f28-4c48-b071-f560ca3dbdcd-image-registry-private-configuration\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.827865 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-bound-sa-token\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.828056 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b43f2cc-b438-4d0f-b109-14165ae92064-tmp-dir\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:08.828056 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95c6d\" (UniqueName: \"kubernetes.io/projected/63e12931-5100-4df3-a0c6-6a9943036f02-kube-api-access-95c6d\") pod \"ingress-canary-pw65x\" (UID: \"63e12931-5100-4df3-a0c6-6a9943036f02\") " pod="openshift-ingress-canary/ingress-canary-pw65x"
Jul 22 16:21:08.828056 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10be6c66-7f28-4c48-b071-f560ca3dbdcd-installation-pull-secrets\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.828056 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.827979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78bts\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-kube-api-access-78bts\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.929317 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-bound-sa-token\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.929317 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929277    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b43f2cc-b438-4d0f-b109-14165ae92064-tmp-dir\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:08.929317 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95c6d\" (UniqueName: \"kubernetes.io/projected/63e12931-5100-4df3-a0c6-6a9943036f02-kube-api-access-95c6d\") pod \"ingress-canary-pw65x\" (UID: \"63e12931-5100-4df3-a0c6-6a9943036f02\") " pod="openshift-ingress-canary/ingress-canary-pw65x"
Jul 22 16:21:08.929600 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10be6c66-7f28-4c48-b071-f560ca3dbdcd-installation-pull-secrets\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.929600 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78bts\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-kube-api-access-78bts\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.929600 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.929600 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63e12931-5100-4df3-a0c6-6a9943036f02-cert\") pod \"ingress-canary-pw65x\" (UID: \"63e12931-5100-4df3-a0c6-6a9943036f02\") " pod="openshift-ingress-canary/ingress-canary-pw65x"
Jul 22 16:21:08.929803 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-certificates\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.929803 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929680    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b43f2cc-b438-4d0f-b109-14165ae92064-tmp-dir\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:08.929803 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4dlh\" (UniqueName: \"kubernetes.io/projected/6b43f2cc-b438-4d0f-b109-14165ae92064-kube-api-access-w4dlh\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:08.929803 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10be6c66-7f28-4c48-b071-f560ca3dbdcd-ca-trust-extracted\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.929803 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:08.930050 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10be6c66-7f28-4c48-b071-f560ca3dbdcd-trusted-ca\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.930050 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b43f2cc-b438-4d0f-b109-14165ae92064-config-volume\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:08.930050 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.929885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10be6c66-7f28-4c48-b071-f560ca3dbdcd-image-registry-private-configuration\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.930684 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.930244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-certificates\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.930684 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:08.930307    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 16:21:08.930684 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:08.930380    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls podName:6b43f2cc-b438-4d0f-b109-14165ae92064 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:09.430357204 +0000 UTC m=+35.622560516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls") pod "dns-default-5h2xr" (UID: "6b43f2cc-b438-4d0f-b109-14165ae92064") : secret "dns-default-metrics-tls" not found
Jul 22 16:21:08.930934 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:08.930727    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 16:21:08.930934 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:08.930748    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f7d8dc56-lct4l: secret "image-registry-tls" not found
Jul 22 16:21:08.930934 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:08.930859    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls podName:10be6c66-7f28-4c48-b071-f560ca3dbdcd nodeName:}" failed. No retries permitted until 2026-07-22 16:21:09.430833235 +0000 UTC m=+35.623036534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls") pod "image-registry-58f7d8dc56-lct4l" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd") : secret "image-registry-tls" not found
Jul 22 16:21:08.931084 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.931044    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10be6c66-7f28-4c48-b071-f560ca3dbdcd-ca-trust-extracted\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.931520 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.931495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b43f2cc-b438-4d0f-b109-14165ae92064-config-volume\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:08.931668 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.931647    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10be6c66-7f28-4c48-b071-f560ca3dbdcd-trusted-ca\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.934634 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.934605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10be6c66-7f28-4c48-b071-f560ca3dbdcd-image-registry-private-configuration\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.934634 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.934623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63e12931-5100-4df3-a0c6-6a9943036f02-cert\") pod \"ingress-canary-pw65x\" (UID: \"63e12931-5100-4df3-a0c6-6a9943036f02\") " pod="openshift-ingress-canary/ingress-canary-pw65x"
Jul 22 16:21:08.934812 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.934610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10be6c66-7f28-4c48-b071-f560ca3dbdcd-installation-pull-secrets\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.942993 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.942972    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78bts\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-kube-api-access-78bts\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:08.943126 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.943106    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4dlh\" (UniqueName: \"kubernetes.io/projected/6b43f2cc-b438-4d0f-b109-14165ae92064-kube-api-access-w4dlh\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:08.943189 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.943111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95c6d\" (UniqueName: \"kubernetes.io/projected/63e12931-5100-4df3-a0c6-6a9943036f02-kube-api-access-95c6d\") pod \"ingress-canary-pw65x\" (UID: \"63e12931-5100-4df3-a0c6-6a9943036f02\") " pod="openshift-ingress-canary/ingress-canary-pw65x"
Jul 22 16:21:08.944898 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:08.944874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-bound-sa-token\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:09.033261 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:09.033201    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pw65x"
Jul 22 16:21:09.402963 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:09.402919    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:21:09.403162 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:09.402928    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:21:09.406047 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:09.405756    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 16:21:09.406047 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:09.405766    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 16:21:09.406047 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:09.405804    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6qdrm\""
Jul 22 16:21:09.406047 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:09.405766    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 16:21:09.434352 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:09.434203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:09.434352 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:09.434323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:09.434352 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:09.434352    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 16:21:09.434624 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:09.434371    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f7d8dc56-lct4l: secret "image-registry-tls" not found
Jul 22 16:21:09.434624 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:09.434423    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 16:21:09.434624 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:09.434466    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls podName:10be6c66-7f28-4c48-b071-f560ca3dbdcd nodeName:}" failed. No retries permitted until 2026-07-22 16:21:10.434447195 +0000 UTC m=+36.626650511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls") pod "image-registry-58f7d8dc56-lct4l" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd") : secret "image-registry-tls" not found
Jul 22 16:21:09.434624 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:09.434480    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls podName:6b43f2cc-b438-4d0f-b109-14165ae92064 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:10.434474231 +0000 UTC m=+36.626677528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls") pod "dns-default-5h2xr" (UID: "6b43f2cc-b438-4d0f-b109-14165ae92064") : secret "dns-default-metrics-tls" not found
Jul 22 16:21:09.666753 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:09.666729    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pw65x"]
Jul 22 16:21:09.703078 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:21:09.703037    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e12931_5100_4df3_a0c6_6a9943036f02.slice/crio-cf7088cb88399bb9c85b55696d0a136a548fe28ea28a161adebe6916e7c6752f WatchSource:0}: Error finding container cf7088cb88399bb9c85b55696d0a136a548fe28ea28a161adebe6916e7c6752f: Status 404 returned error can't find the container with id cf7088cb88399bb9c85b55696d0a136a548fe28ea28a161adebe6916e7c6752f
Jul 22 16:21:10.402653 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:10.402439    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:21:10.407709 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:10.407674    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 16:21:10.408535 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:10.407687    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9mc4s\""
Jul 22 16:21:10.442090 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:10.442058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:10.442293 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:10.442151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:10.442293 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:10.442262    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 16:21:10.442293 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:10.442277    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 16:21:10.442293 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:10.442284    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f7d8dc56-lct4l: secret "image-registry-tls" not found
Jul 22 16:21:10.442485 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:10.442339    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls podName:6b43f2cc-b438-4d0f-b109-14165ae92064 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:12.442321523 +0000 UTC m=+38.634524821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls") pod "dns-default-5h2xr" (UID: "6b43f2cc-b438-4d0f-b109-14165ae92064") : secret "dns-default-metrics-tls" not found
Jul 22 16:21:10.442485 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:10.442358    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls podName:10be6c66-7f28-4c48-b071-f560ca3dbdcd nodeName:}" failed. No retries permitted until 2026-07-22 16:21:12.442349166 +0000 UTC m=+38.634552462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls") pod "image-registry-58f7d8dc56-lct4l" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd") : secret "image-registry-tls" not found
Jul 22 16:21:10.551907 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:10.551871    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pw65x" event={"ID":"63e12931-5100-4df3-a0c6-6a9943036f02","Type":"ContainerStarted","Data":"cf7088cb88399bb9c85b55696d0a136a548fe28ea28a161adebe6916e7c6752f"}
Jul 22 16:21:10.555606 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:10.555569    2580 generic.go:356] "Generic (PLEG): container finished" podID="149c47db-83da-464e-9f3e-1331ed99670c" containerID="d513142f4390d30c62da62efaadefd84efc685194018277a5622786f5ca7ae37" exitCode=0
Jul 22 16:21:10.555765 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:10.555622    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp6jx" event={"ID":"149c47db-83da-464e-9f3e-1331ed99670c","Type":"ContainerDied","Data":"d513142f4390d30c62da62efaadefd84efc685194018277a5622786f5ca7ae37"}
Jul 22 16:21:11.561640 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:11.561600    2580 generic.go:356] "Generic (PLEG): container finished" podID="149c47db-83da-464e-9f3e-1331ed99670c" containerID="15d11fbab5e53090d6c72da2e8337d6e1c20619120d77bb847f764e44daa6cad" exitCode=0
Jul 22 16:21:11.562060 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:11.561655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp6jx" event={"ID":"149c47db-83da-464e-9f3e-1331ed99670c","Type":"ContainerDied","Data":"15d11fbab5e53090d6c72da2e8337d6e1c20619120d77bb847f764e44daa6cad"}
Jul 22 16:21:12.459459 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:12.459428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:12.459582 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:12.459514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:12.459645 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:12.459601    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 16:21:12.459645 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:12.459617    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f7d8dc56-lct4l: secret "image-registry-tls" not found
Jul 22 16:21:12.459722 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:12.459658    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 16:21:12.459722 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:12.459677    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls podName:10be6c66-7f28-4c48-b071-f560ca3dbdcd nodeName:}" failed. No retries permitted until 2026-07-22 16:21:16.459659966 +0000 UTC m=+42.651863289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls") pod "image-registry-58f7d8dc56-lct4l" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd") : secret "image-registry-tls" not found
Jul 22 16:21:12.459789 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:12.459745    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls podName:6b43f2cc-b438-4d0f-b109-14165ae92064 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:16.459726787 +0000 UTC m=+42.651930101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls") pod "dns-default-5h2xr" (UID: "6b43f2cc-b438-4d0f-b109-14165ae92064") : secret "dns-default-metrics-tls" not found
Jul 22 16:21:12.566482 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:12.566267    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pw65x" event={"ID":"63e12931-5100-4df3-a0c6-6a9943036f02","Type":"ContainerStarted","Data":"5a9aa5d66df4e34c356994657cb07fc170c5e06ee7bc14385e1c6242aa676377"}
Jul 22 16:21:12.569799 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:12.569761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp6jx" event={"ID":"149c47db-83da-464e-9f3e-1331ed99670c","Type":"ContainerStarted","Data":"2cb51f15b8ff3372dfdfee8893169e1bc450deafac7fb2d47e8c8d2cd8d05d8d"}
Jul 22 16:21:12.586297 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:12.586248    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pw65x" podStartSLOduration=1.834987962 podStartE2EDuration="4.586213869s" totalImagesPullingTime="2.751225907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:21:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:12.584908464 +0000 UTC m=+38.777111782" watchObservedRunningTime="2026-07-22 16:21:12.586213869 +0000 UTC m=+38.778417188"
Jul 22 16:21:12.606829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:12.606776    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pp6jx" podStartSLOduration=7.470276476 podStartE2EDuration="37.60675682s" totalImagesPullingTime="30.136480344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:20:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:12.605445691 +0000 UTC m=+38.797649010" watchObservedRunningTime="2026-07-22 16:21:12.60675682 +0000 UTC m=+38.798960140"
Jul 22 16:21:16.490632 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:16.490589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:16.491117 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:16.490689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:16.491117 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:16.490762    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 16:21:16.491117 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:16.490784    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f7d8dc56-lct4l: secret "image-registry-tls" not found
Jul 22 16:21:16.491117 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:16.490811    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 16:21:16.491117 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:16.490847    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls podName:10be6c66-7f28-4c48-b071-f560ca3dbdcd nodeName:}" failed. No retries permitted until 2026-07-22 16:21:24.490830147 +0000 UTC m=+50.683033483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls") pod "image-registry-58f7d8dc56-lct4l" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd") : secret "image-registry-tls" not found
Jul 22 16:21:16.491117 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:16.490861    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls podName:6b43f2cc-b438-4d0f-b109-14165ae92064 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:24.49085504 +0000 UTC m=+50.683058337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls") pod "dns-default-5h2xr" (UID: "6b43f2cc-b438-4d0f-b109-14165ae92064") : secret "dns-default-metrics-tls" not found
Jul 22 16:21:24.546280 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:24.546207    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:24.546811 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:24.546316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:24.546811 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:24.546393    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 16:21:24.546811 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:24.546412    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 16:21:24.546811 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:24.546423    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f7d8dc56-lct4l: secret "image-registry-tls" not found
Jul 22 16:21:24.546811 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:24.546475    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls podName:10be6c66-7f28-4c48-b071-f560ca3dbdcd nodeName:}" failed. No retries permitted until 2026-07-22 16:21:40.546457708 +0000 UTC m=+66.738661025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls") pod "image-registry-58f7d8dc56-lct4l" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd") : secret "image-registry-tls" not found
Jul 22 16:21:24.546811 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:24.546494    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls podName:6b43f2cc-b438-4d0f-b109-14165ae92064 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:40.546485187 +0000 UTC m=+66.738688486 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls") pod "dns-default-5h2xr" (UID: "6b43f2cc-b438-4d0f-b109-14165ae92064") : secret "dns-default-metrics-tls" not found
Jul 22 16:21:27.022365 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.022324    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-xkjnk"]
Jul 22 16:21:27.042686 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.042649    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-xkjnk"]
Jul 22 16:21:27.042831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.042782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-xkjnk"
Jul 22 16:21:27.045136 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.045100    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bqdbv\""
Jul 22 16:21:27.045136 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.045100    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 22 16:21:27.045836 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.045821    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 22 16:21:27.063994 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.063969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxj55\" (UniqueName: \"kubernetes.io/projected/648f9a98-2cc7-44da-bb10-a1dac37c1299-kube-api-access-xxj55\") pod \"volume-data-source-validator-78cf4c6f6-xkjnk\" (UID: \"648f9a98-2cc7-44da-bb10-a1dac37c1299\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-xkjnk"
Jul 22 16:21:27.164813 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.164780    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxj55\" (UniqueName: \"kubernetes.io/projected/648f9a98-2cc7-44da-bb10-a1dac37c1299-kube-api-access-xxj55\") pod \"volume-data-source-validator-78cf4c6f6-xkjnk\" (UID: \"648f9a98-2cc7-44da-bb10-a1dac37c1299\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-xkjnk"
Jul 22 16:21:27.176465 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.176442    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxj55\" (UniqueName: \"kubernetes.io/projected/648f9a98-2cc7-44da-bb10-a1dac37c1299-kube-api-access-xxj55\") pod \"volume-data-source-validator-78cf4c6f6-xkjnk\" (UID: \"648f9a98-2cc7-44da-bb10-a1dac37c1299\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-xkjnk"
Jul 22 16:21:27.352161 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.352131    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-xkjnk"
Jul 22 16:21:27.494183 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.494152    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-xkjnk"]
Jul 22 16:21:27.497541 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:21:27.497512    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648f9a98_2cc7_44da_bb10_a1dac37c1299.slice/crio-b405d158c32ec765b5da720dcfa5ff7d812363aabe345533fbaade9cad49fbae WatchSource:0}: Error finding container b405d158c32ec765b5da720dcfa5ff7d812363aabe345533fbaade9cad49fbae: Status 404 returned error can't find the container with id b405d158c32ec765b5da720dcfa5ff7d812363aabe345533fbaade9cad49fbae
Jul 22 16:21:27.603258 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.603173    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-xkjnk" event={"ID":"648f9a98-2cc7-44da-bb10-a1dac37c1299","Type":"ContainerStarted","Data":"b405d158c32ec765b5da720dcfa5ff7d812363aabe345533fbaade9cad49fbae"}
Jul 22 16:21:27.825209 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.825176    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-5x5qt"]
Jul 22 16:21:27.827581 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.827567    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:27.830034 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.830007    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 22 16:21:27.830162 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.830008    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 22 16:21:27.830162 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.830099    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 22 16:21:27.830462 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.830448    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 22 16:21:27.830959 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.830945    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-twhhj\""
Jul 22 16:21:27.837158 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.837136    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 22 16:21:27.838879 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.838859    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-5x5qt"]
Jul 22 16:21:27.869527 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.869466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a165dc47-9c65-4843-8011-596009f64244-config\") pod \"console-operator-565b7b569d-5x5qt\" (UID: \"a165dc47-9c65-4843-8011-596009f64244\") " pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:27.869527 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.869493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqh8r\" (UniqueName: \"kubernetes.io/projected/a165dc47-9c65-4843-8011-596009f64244-kube-api-access-kqh8r\") pod \"console-operator-565b7b569d-5x5qt\" (UID: \"a165dc47-9c65-4843-8011-596009f64244\") " pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:27.869687 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.869566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a165dc47-9c65-4843-8011-596009f64244-serving-cert\") pod \"console-operator-565b7b569d-5x5qt\" (UID: \"a165dc47-9c65-4843-8011-596009f64244\") " pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:27.869687 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.869594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a165dc47-9c65-4843-8011-596009f64244-trusted-ca\") pod \"console-operator-565b7b569d-5x5qt\" (UID: \"a165dc47-9c65-4843-8011-596009f64244\") " pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:27.970716 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.970679    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a165dc47-9c65-4843-8011-596009f64244-serving-cert\") pod \"console-operator-565b7b569d-5x5qt\" (UID: \"a165dc47-9c65-4843-8011-596009f64244\") " pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:27.970909 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.970732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a165dc47-9c65-4843-8011-596009f64244-trusted-ca\") pod \"console-operator-565b7b569d-5x5qt\" (UID: \"a165dc47-9c65-4843-8011-596009f64244\") " pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:27.970909 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.970768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a165dc47-9c65-4843-8011-596009f64244-config\") pod \"console-operator-565b7b569d-5x5qt\" (UID: \"a165dc47-9c65-4843-8011-596009f64244\") " pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:27.970909 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.970793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqh8r\" (UniqueName: \"kubernetes.io/projected/a165dc47-9c65-4843-8011-596009f64244-kube-api-access-kqh8r\") pod \"console-operator-565b7b569d-5x5qt\" (UID: \"a165dc47-9c65-4843-8011-596009f64244\") " pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:27.971615 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.971581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a165dc47-9c65-4843-8011-596009f64244-config\") pod \"console-operator-565b7b569d-5x5qt\" (UID: \"a165dc47-9c65-4843-8011-596009f64244\") " pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:27.971979 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.971948    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a165dc47-9c65-4843-8011-596009f64244-trusted-ca\") pod \"console-operator-565b7b569d-5x5qt\" (UID: \"a165dc47-9c65-4843-8011-596009f64244\") " pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:27.973545 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.973524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a165dc47-9c65-4843-8011-596009f64244-serving-cert\") pod \"console-operator-565b7b569d-5x5qt\" (UID: \"a165dc47-9c65-4843-8011-596009f64244\") " pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:27.980511 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:27.980488    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqh8r\" (UniqueName: \"kubernetes.io/projected/a165dc47-9c65-4843-8011-596009f64244-kube-api-access-kqh8r\") pod \"console-operator-565b7b569d-5x5qt\" (UID: \"a165dc47-9c65-4843-8011-596009f64244\") " pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:28.139471 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:28.139378    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:28.261807 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:28.261775    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-5x5qt"]
Jul 22 16:21:28.430084 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:21:28.430019    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda165dc47_9c65_4843_8011_596009f64244.slice/crio-29affe5f18ea59b332d85a47fc13ccab9315aa97e005e14aea7360458622d03d WatchSource:0}: Error finding container 29affe5f18ea59b332d85a47fc13ccab9315aa97e005e14aea7360458622d03d: Status 404 returned error can't find the container with id 29affe5f18ea59b332d85a47fc13ccab9315aa97e005e14aea7360458622d03d
Jul 22 16:21:28.608493 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:28.607886    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-xkjnk" event={"ID":"648f9a98-2cc7-44da-bb10-a1dac37c1299","Type":"ContainerStarted","Data":"bf149892e68a30120212d27aa8185aeec70a2c89a30f8a8cf1f83b6f314b2a12"}
Jul 22 16:21:28.610032 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:28.610001    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt" event={"ID":"a165dc47-9c65-4843-8011-596009f64244","Type":"ContainerStarted","Data":"29affe5f18ea59b332d85a47fc13ccab9315aa97e005e14aea7360458622d03d"}
Jul 22 16:21:28.624524 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:28.624486    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-xkjnk" podStartSLOduration=0.666818131 podStartE2EDuration="1.624472173s" totalImagesPullingTime="957.654042ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:28.623481722 +0000 UTC m=+54.815685041" watchObservedRunningTime="2026-07-22 16:21:28.624472173 +0000 UTC m=+54.816675491"
Jul 22 16:21:31.217783 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.217750    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5phwh"]
Jul 22 16:21:31.220677 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.220660    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.223364 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.223341    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 16:21:31.224363 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.224339    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 16:21:31.224457 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.224410    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-km9pf\""
Jul 22 16:21:31.224457 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.224432    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 16:21:31.224982 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.224964    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 16:21:31.233598 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.233497    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5phwh"]
Jul 22 16:21:31.298268 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.298237    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-crio-socket\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.298268 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.298268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-data-volume\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.298500 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.298322    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.298500 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.298349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.298500 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.298437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6kj6\" (UniqueName: \"kubernetes.io/projected/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-api-access-x6kj6\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.398806 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.398748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-crio-socket\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.398806 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.398808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-data-volume\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.399027 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.398862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.399027 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.398882    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-crio-socket\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.399027 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.398885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.399027 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:31.398965    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 16:21:31.399027 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:31.398987    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 16:21:31.399185 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:31.399046    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls podName:c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:31.899019129 +0000 UTC m=+58.091222431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5phwh" (UID: "c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544") : secret "insights-runtime-extractor-tls" not found
Jul 22 16:21:31.399185 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:31.399071    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm podName:c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:31.899060515 +0000 UTC m=+58.091263811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5phwh" (UID: "c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544") : configmap "kube-rbac-proxy" not found
Jul 22 16:21:31.399185 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.399122    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6kj6\" (UniqueName: \"kubernetes.io/projected/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-api-access-x6kj6\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.399315 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.399244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-data-volume\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.406910 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.406885    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6kj6\" (UniqueName: \"kubernetes.io/projected/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-api-access-x6kj6\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.619831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.619802    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/0.log"
Jul 22 16:21:31.619987 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.619843    2580 generic.go:356] "Generic (PLEG): container finished" podID="a165dc47-9c65-4843-8011-596009f64244" containerID="7878b2eb3245dcad5f136832c65d6c29b866036f5359e20458283bb829e054c0" exitCode=255
Jul 22 16:21:31.619987 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.619875    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt" event={"ID":"a165dc47-9c65-4843-8011-596009f64244","Type":"ContainerDied","Data":"7878b2eb3245dcad5f136832c65d6c29b866036f5359e20458283bb829e054c0"}
Jul 22 16:21:31.620144 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.620127    2580 scope.go:117] "RemoveContainer" containerID="7878b2eb3245dcad5f136832c65d6c29b866036f5359e20458283bb829e054c0"
Jul 22 16:21:31.819765 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.819733    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"]
Jul 22 16:21:31.822469 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.822454    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"
Jul 22 16:21:31.824557 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.824512    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 22 16:21:31.824671 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.824577    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 22 16:21:31.824671 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.824654    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 22 16:21:31.824771 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.824725    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 22 16:21:31.824771 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.824733    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fhfkd\""
Jul 22 16:21:31.835097 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.835078    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"]
Jul 22 16:21:31.903484 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.903386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3896ccdb-c971-43c1-bdcc-5b5b60f932c8-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-ft9q2\" (UID: \"3896ccdb-c971-43c1-bdcc-5b5b60f932c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"
Jul 22 16:21:31.903484 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.903450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4cb9\" (UniqueName: \"kubernetes.io/projected/3896ccdb-c971-43c1-bdcc-5b5b60f932c8-kube-api-access-l4cb9\") pod \"kube-storage-version-migrator-operator-7658d9b749-ft9q2\" (UID: \"3896ccdb-c971-43c1-bdcc-5b5b60f932c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"
Jul 22 16:21:31.903484 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.903481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.903743 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:31.903579    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 16:21:31.903743 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.903582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:31.903743 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:31.903617    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3896ccdb-c971-43c1-bdcc-5b5b60f932c8-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-ft9q2\" (UID: \"3896ccdb-c971-43c1-bdcc-5b5b60f932c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"
Jul 22 16:21:31.903743 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:31.903653    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls podName:c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:32.903634492 +0000 UTC m=+59.095837794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5phwh" (UID: "c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544") : secret "insights-runtime-extractor-tls" not found
Jul 22 16:21:31.903743 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:31.903691    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 16:21:31.903743 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:31.903745    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm podName:c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:32.903730773 +0000 UTC m=+59.095934087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5phwh" (UID: "c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544") : configmap "kube-rbac-proxy" not found
Jul 22 16:21:32.005035 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.004974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3896ccdb-c971-43c1-bdcc-5b5b60f932c8-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-ft9q2\" (UID: \"3896ccdb-c971-43c1-bdcc-5b5b60f932c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"
Jul 22 16:21:32.005035 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.005037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4cb9\" (UniqueName: \"kubernetes.io/projected/3896ccdb-c971-43c1-bdcc-5b5b60f932c8-kube-api-access-l4cb9\") pod \"kube-storage-version-migrator-operator-7658d9b749-ft9q2\" (UID: \"3896ccdb-c971-43c1-bdcc-5b5b60f932c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"
Jul 22 16:21:32.005390 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.005280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3896ccdb-c971-43c1-bdcc-5b5b60f932c8-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-ft9q2\" (UID: \"3896ccdb-c971-43c1-bdcc-5b5b60f932c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"
Jul 22 16:21:32.005793 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.005776    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3896ccdb-c971-43c1-bdcc-5b5b60f932c8-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-ft9q2\" (UID: \"3896ccdb-c971-43c1-bdcc-5b5b60f932c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"
Jul 22 16:21:32.007288 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.007268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3896ccdb-c971-43c1-bdcc-5b5b60f932c8-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-ft9q2\" (UID: \"3896ccdb-c971-43c1-bdcc-5b5b60f932c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"
Jul 22 16:21:32.013783 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.013760    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4cb9\" (UniqueName: \"kubernetes.io/projected/3896ccdb-c971-43c1-bdcc-5b5b60f932c8-kube-api-access-l4cb9\") pod \"kube-storage-version-migrator-operator-7658d9b749-ft9q2\" (UID: \"3896ccdb-c971-43c1-bdcc-5b5b60f932c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"
Jul 22 16:21:32.131520 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.131479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"
Jul 22 16:21:32.251566 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.251532    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2"]
Jul 22 16:21:32.254245 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:21:32.254204    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3896ccdb_c971_43c1_bdcc_5b5b60f932c8.slice/crio-2b071aeb88fcf92803656d669b98d0421e90e9bde6fe3e83e9c96be082e3595b WatchSource:0}: Error finding container 2b071aeb88fcf92803656d669b98d0421e90e9bde6fe3e83e9c96be082e3595b: Status 404 returned error can't find the container with id 2b071aeb88fcf92803656d669b98d0421e90e9bde6fe3e83e9c96be082e3595b
Jul 22 16:21:32.618427 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.618399    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2cr6p_3878f729-87e8-49d0-83bb-b172496e2119/dns-node-resolver/0.log"
Jul 22 16:21:32.623336 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.623301    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2" event={"ID":"3896ccdb-c971-43c1-bdcc-5b5b60f932c8","Type":"ContainerStarted","Data":"2b071aeb88fcf92803656d669b98d0421e90e9bde6fe3e83e9c96be082e3595b"}
Jul 22 16:21:32.624699 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.624682    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:21:32.625078 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.625064    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/0.log"
Jul 22 16:21:32.625131 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.625097    2580 generic.go:356] "Generic (PLEG): container finished" podID="a165dc47-9c65-4843-8011-596009f64244" containerID="8b1ddd3ab2b401ab415bba3bdc2e908677cec7c1af91782207d45ddb5e73ec37" exitCode=255
Jul 22 16:21:32.625131 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.625129    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt" event={"ID":"a165dc47-9c65-4843-8011-596009f64244","Type":"ContainerDied","Data":"8b1ddd3ab2b401ab415bba3bdc2e908677cec7c1af91782207d45ddb5e73ec37"}
Jul 22 16:21:32.625204 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.625161    2580 scope.go:117] "RemoveContainer" containerID="7878b2eb3245dcad5f136832c65d6c29b866036f5359e20458283bb829e054c0"
Jul 22 16:21:32.625427 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.625410    2580 scope.go:117] "RemoveContainer" containerID="8b1ddd3ab2b401ab415bba3bdc2e908677cec7c1af91782207d45ddb5e73ec37"
Jul 22 16:21:32.625600 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:32.625574    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-5x5qt_openshift-console-operator(a165dc47-9c65-4843-8011-596009f64244)\"" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt" podUID="a165dc47-9c65-4843-8011-596009f64244"
Jul 22 16:21:32.913378 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.913283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:32.913536 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:32.913386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:32.913536 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:32.913446    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 16:21:32.913536 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:32.913519    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls podName:c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:34.913500158 +0000 UTC m=+61.105703476 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5phwh" (UID: "c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544") : secret "insights-runtime-extractor-tls" not found
Jul 22 16:21:32.913536 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:32.913519    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 16:21:32.913788 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:32.913598    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm podName:c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:34.913571198 +0000 UTC m=+61.105774498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5phwh" (UID: "c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544") : configmap "kube-rbac-proxy" not found
Jul 22 16:21:33.630202 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:33.630169    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:21:33.630677 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:33.630594    2580 scope.go:117] "RemoveContainer" containerID="8b1ddd3ab2b401ab415bba3bdc2e908677cec7c1af91782207d45ddb5e73ec37"
Jul 22 16:21:33.630806 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:33.630785    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-5x5qt_openshift-console-operator(a165dc47-9c65-4843-8011-596009f64244)\"" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt" podUID="a165dc47-9c65-4843-8011-596009f64244"
Jul 22 16:21:33.818950 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:33.818879    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-smnmv_3318273d-8948-43bf-bee1-d2072dc02332/node-ca/0.log"
Jul 22 16:21:34.417950 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:34.417921    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pw65x_63e12931-5100-4df3-a0c6-6a9943036f02/serve-healthcheck-canary/0.log"
Jul 22 16:21:34.564843 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:34.564811    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-6k5t4"]
Jul 22 16:21:34.578668 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:34.578643    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-6k5t4"]
Jul 22 16:21:34.578818 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:34.578774    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6k5t4"
Jul 22 16:21:34.580897 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:34.580881    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-l8q2n\""
Jul 22 16:21:34.629981 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:34.629949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbt4j\" (UniqueName: \"kubernetes.io/projected/8de129db-9c98-47ff-abb3-e075caedb4f9-kube-api-access-kbt4j\") pod \"network-check-source-7bc5b6bf85-6k5t4\" (UID: \"8de129db-9c98-47ff-abb3-e075caedb4f9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6k5t4"
Jul 22 16:21:34.731057 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:34.730981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbt4j\" (UniqueName: \"kubernetes.io/projected/8de129db-9c98-47ff-abb3-e075caedb4f9-kube-api-access-kbt4j\") pod \"network-check-source-7bc5b6bf85-6k5t4\" (UID: \"8de129db-9c98-47ff-abb3-e075caedb4f9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6k5t4"
Jul 22 16:21:34.739283 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:34.739260    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 16:21:34.749995 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:34.749974    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 16:21:34.760913 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:34.760891    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbt4j\" (UniqueName: \"kubernetes.io/projected/8de129db-9c98-47ff-abb3-e075caedb4f9-kube-api-access-kbt4j\") pod \"network-check-source-7bc5b6bf85-6k5t4\" (UID: \"8de129db-9c98-47ff-abb3-e075caedb4f9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6k5t4"
Jul 22 16:21:34.887898 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:34.887871    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6k5t4"
Jul 22 16:21:34.932325 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:34.932287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:34.932500 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:34.932404    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 16:21:34.932500 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:34.932463    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm podName:c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:38.932446518 +0000 UTC m=+65.124649815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5phwh" (UID: "c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544") : configmap "kube-rbac-proxy" not found
Jul 22 16:21:34.932626 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:34.932527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:34.932626 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:34.932618    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 16:21:34.932777 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:34.932647    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls podName:c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:38.932639026 +0000 UTC m=+65.124842323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5phwh" (UID: "c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544") : secret "insights-runtime-extractor-tls" not found
Jul 22 16:21:35.034939 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:35.034904    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-6k5t4"]
Jul 22 16:21:35.038180 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:21:35.038151    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de129db_9c98_47ff_abb3_e075caedb4f9.slice/crio-e893cc19422ddbc0dcc92948a1ce9b09fac47ff7f9577405fd6ab9f1b8eeb579 WatchSource:0}: Error finding container e893cc19422ddbc0dcc92948a1ce9b09fac47ff7f9577405fd6ab9f1b8eeb579: Status 404 returned error can't find the container with id e893cc19422ddbc0dcc92948a1ce9b09fac47ff7f9577405fd6ab9f1b8eeb579
Jul 22 16:21:35.637067 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:35.637032    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2" event={"ID":"3896ccdb-c971-43c1-bdcc-5b5b60f932c8","Type":"ContainerStarted","Data":"32f1e9cd808595670124cb69f8a6717840bd7292dc6a6e1acede3e246365eec7"}
Jul 22 16:21:35.638634 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:35.638602    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6k5t4" event={"ID":"8de129db-9c98-47ff-abb3-e075caedb4f9","Type":"ContainerStarted","Data":"e893cc19422ddbc0dcc92948a1ce9b09fac47ff7f9577405fd6ab9f1b8eeb579"}
Jul 22 16:21:35.653667 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:35.653613    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2" podStartSLOduration=2.06564983 podStartE2EDuration="4.653600746s" totalImagesPullingTime="2.587950916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:35.653215727 +0000 UTC m=+61.845419071" watchObservedRunningTime="2026-07-22 16:21:35.653600746 +0000 UTC m=+61.845804048"
Jul 22 16:21:35.735116 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:35.735078    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dzbk"
Jul 22 16:21:36.846956 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:36.846914    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dwql2"]
Jul 22 16:21:36.851658 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:36.851623    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dwql2"
Jul 22 16:21:36.854426 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:36.854123    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 22 16:21:36.854426 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:36.854126    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 22 16:21:36.854907 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:36.854887    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7f9c2\""
Jul 22 16:21:36.860997 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:36.859912    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dwql2"]
Jul 22 16:21:36.947873 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:36.947837    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf5h8\" (UniqueName: \"kubernetes.io/projected/9eff726e-481c-44ee-afce-07e63cb934ad-kube-api-access-hf5h8\") pod \"migrator-7cc9c7ffd7-dwql2\" (UID: \"9eff726e-481c-44ee-afce-07e63cb934ad\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dwql2"
Jul 22 16:21:37.048431 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:37.048391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf5h8\" (UniqueName: \"kubernetes.io/projected/9eff726e-481c-44ee-afce-07e63cb934ad-kube-api-access-hf5h8\") pod \"migrator-7cc9c7ffd7-dwql2\" (UID: \"9eff726e-481c-44ee-afce-07e63cb934ad\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dwql2"
Jul 22 16:21:37.059119 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:37.059086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf5h8\" (UniqueName: \"kubernetes.io/projected/9eff726e-481c-44ee-afce-07e63cb934ad-kube-api-access-hf5h8\") pod \"migrator-7cc9c7ffd7-dwql2\" (UID: \"9eff726e-481c-44ee-afce-07e63cb934ad\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dwql2"
Jul 22 16:21:37.163052 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:37.162964    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dwql2"
Jul 22 16:21:37.777551 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:37.777522    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dwql2"]
Jul 22 16:21:37.781315 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:21:37.781287    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eff726e_481c_44ee_afce_07e63cb934ad.slice/crio-3d956f506b64c5d8a1150e90001833a27ea2f36b5564787f89b1cf1dce527c1a WatchSource:0}: Error finding container 3d956f506b64c5d8a1150e90001833a27ea2f36b5564787f89b1cf1dce527c1a: Status 404 returned error can't find the container with id 3d956f506b64c5d8a1150e90001833a27ea2f36b5564787f89b1cf1dce527c1a
Jul 22 16:21:38.140493 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:38.140457    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:38.140853 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:38.140519    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:38.140914 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:38.140898    2580 scope.go:117] "RemoveContainer" containerID="8b1ddd3ab2b401ab415bba3bdc2e908677cec7c1af91782207d45ddb5e73ec37"
Jul 22 16:21:38.141065 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:38.141046    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-5x5qt_openshift-console-operator(a165dc47-9c65-4843-8011-596009f64244)\"" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt" podUID="a165dc47-9c65-4843-8011-596009f64244"
Jul 22 16:21:38.649649 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:38.649612    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dwql2" event={"ID":"9eff726e-481c-44ee-afce-07e63cb934ad","Type":"ContainerStarted","Data":"3d956f506b64c5d8a1150e90001833a27ea2f36b5564787f89b1cf1dce527c1a"}
Jul 22 16:21:38.650919 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:38.650897    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6k5t4" event={"ID":"8de129db-9c98-47ff-abb3-e075caedb4f9","Type":"ContainerStarted","Data":"eb8a1c84470a034f24002e79e80e896eb3dea63058c237090a87edab10eb239c"}
Jul 22 16:21:38.669699 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:38.669657    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6k5t4" podStartSLOduration=2.001677524 podStartE2EDuration="4.669643556s" totalImagesPullingTime="2.667966032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:38.668826326 +0000 UTC m=+64.861029646" watchObservedRunningTime="2026-07-22 16:21:38.669643556 +0000 UTC m=+64.861846875"
Jul 22 16:21:38.965746 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:38.965667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:38.965900 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:38.965765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:38.965900 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:38.965787    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 16:21:38.965900 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:38.965860    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm podName:c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:46.965839294 +0000 UTC m=+73.158042592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5phwh" (UID: "c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544") : configmap "kube-rbac-proxy" not found
Jul 22 16:21:38.966070 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:38.965936    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 16:21:38.966070 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:38.966007    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls podName:c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:46.965987452 +0000 UTC m=+73.158190764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5phwh" (UID: "c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544") : secret "insights-runtime-extractor-tls" not found
Jul 22 16:21:39.655823 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:39.655786    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dwql2" event={"ID":"9eff726e-481c-44ee-afce-07e63cb934ad","Type":"ContainerStarted","Data":"92ba528166f6d125e19b27225997fbb812f129b4473acd30c0ec9a76b8b7d11b"}
Jul 22 16:21:39.656308 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:39.655845    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dwql2" event={"ID":"9eff726e-481c-44ee-afce-07e63cb934ad","Type":"ContainerStarted","Data":"3e597630067214bad77963e190c2cdb608001079c280e3e78e59a06b33df3903"}
Jul 22 16:21:39.673696 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:39.673651    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dwql2" podStartSLOduration=2.280938965 podStartE2EDuration="3.673635456s" totalImagesPullingTime="1.392696491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:39.67308166 +0000 UTC m=+65.865284979" watchObservedRunningTime="2026-07-22 16:21:39.673635456 +0000 UTC m=+65.865838977"
Jul 22 16:21:39.974533 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:39.974443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pd65\" (UniqueName: \"kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65\") pod \"network-check-target-rb879\" (UID: \"5fdd45e5-b1d4-4a66-996a-e35934bfeb30\") " pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:21:39.976958 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:39.976937    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pd65\" (UniqueName: \"kubernetes.io/projected/5fdd45e5-b1d4-4a66-996a-e35934bfeb30-kube-api-access-5pd65\") pod \"network-check-target-rb879\" (UID: \"5fdd45e5-b1d4-4a66-996a-e35934bfeb30\") " pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:21:40.023440 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.023415    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6qdrm\""
Jul 22 16:21:40.032087 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.032073    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:21:40.075341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.075285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:21:40.075511 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.075402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:21:40.077579 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.077537    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 16:21:40.077718 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.077581    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 16:21:40.085890 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:40.085868    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 16:21:40.086016 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:40.085946    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs podName:406ea80e-5332-40e8-8bda-8edf582a17c9 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:44.085925597 +0000 UTC m=+130.278128905 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs") pod "network-metrics-daemon-zdkhc" (UID: "406ea80e-5332-40e8-8bda-8edf582a17c9") : secret "metrics-daemon-secret" not found
Jul 22 16:21:40.088106 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.088079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1e45ac08-35b3-438f-8cbf-aa2f8f4950c3-original-pull-secret\") pod \"global-pull-secret-syncer-9xxgw\" (UID: \"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3\") " pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:21:40.154700 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.154668    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rb879"]
Jul 22 16:21:40.157568 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:21:40.157539    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdd45e5_b1d4_4a66_996a_e35934bfeb30.slice/crio-40ff07e26dd600d5cc53d3e1662ed88f1963aa55a02f5ed6334c997d456b2aa7 WatchSource:0}: Error finding container 40ff07e26dd600d5cc53d3e1662ed88f1963aa55a02f5ed6334c997d456b2aa7: Status 404 returned error can't find the container with id 40ff07e26dd600d5cc53d3e1662ed88f1963aa55a02f5ed6334c997d456b2aa7
Jul 22 16:21:40.316452 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.316372    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xxgw"
Jul 22 16:21:40.439145 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.439100    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9xxgw"]
Jul 22 16:21:40.442526 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:21:40.442499    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e45ac08_35b3_438f_8cbf_aa2f8f4950c3.slice/crio-1da64254d21531fde734f4e9f0f170f01d8c5131a30923ea44b0431eafd1d9b6 WatchSource:0}: Error finding container 1da64254d21531fde734f4e9f0f170f01d8c5131a30923ea44b0431eafd1d9b6: Status 404 returned error can't find the container with id 1da64254d21531fde734f4e9f0f170f01d8c5131a30923ea44b0431eafd1d9b6
Jul 22 16:21:40.580113 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.580036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:21:40.580294 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.580133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:21:40.580294 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:40.580183    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 16:21:40.580294 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:40.580204    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f7d8dc56-lct4l: secret "image-registry-tls" not found
Jul 22 16:21:40.580294 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:40.580238    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 16:21:40.580294 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:40.580281    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls podName:10be6c66-7f28-4c48-b071-f560ca3dbdcd nodeName:}" failed. No retries permitted until 2026-07-22 16:22:12.580264715 +0000 UTC m=+98.772468016 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls") pod "image-registry-58f7d8dc56-lct4l" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd") : secret "image-registry-tls" not found
Jul 22 16:21:40.580294 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:40.580295    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls podName:6b43f2cc-b438-4d0f-b109-14165ae92064 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:12.580289301 +0000 UTC m=+98.772492597 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls") pod "dns-default-5h2xr" (UID: "6b43f2cc-b438-4d0f-b109-14165ae92064") : secret "dns-default-metrics-tls" not found
Jul 22 16:21:40.663163 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.663129    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9xxgw" event={"ID":"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3","Type":"ContainerStarted","Data":"1da64254d21531fde734f4e9f0f170f01d8c5131a30923ea44b0431eafd1d9b6"}
Jul 22 16:21:40.664651 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.664625    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rb879" event={"ID":"5fdd45e5-b1d4-4a66-996a-e35934bfeb30","Type":"ContainerStarted","Data":"aa8d8442f9402c8de4b48c9f5f6e1149108e5170ff3b18c986b8e393bd2a7fdc"}
Jul 22 16:21:40.664763 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.664665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rb879" event={"ID":"5fdd45e5-b1d4-4a66-996a-e35934bfeb30","Type":"ContainerStarted","Data":"40ff07e26dd600d5cc53d3e1662ed88f1963aa55a02f5ed6334c997d456b2aa7"}
Jul 22 16:21:40.664763 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.664716    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:21:40.681561 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:40.681519    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rb879" podStartSLOduration=66.681505096 podStartE2EDuration="1m6.681505096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:20:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:40.680749024 +0000 UTC m=+66.872952357" watchObservedRunningTime="2026-07-22 16:21:40.681505096 +0000 UTC m=+66.873708393"
Jul 22 16:21:44.679742 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:44.679700    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9xxgw" event={"ID":"1e45ac08-35b3-438f-8cbf-aa2f8f4950c3","Type":"ContainerStarted","Data":"598ee1b400938a686cd4b2ed5a593e550a9c9d886316d52b3f7c3d735e36abd9"}
Jul 22 16:21:47.030356 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:47.030310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:47.030828 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:47.030382    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:47.030828 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:47.030466    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 16:21:47.030828 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:21:47.030563    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls podName:c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:03.030541313 +0000 UTC m=+89.222744611 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5phwh" (UID: "c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544") : secret "insights-runtime-extractor-tls" not found
Jul 22 16:21:47.030993 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:47.030973    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:21:53.403388 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:53.403348    2580 scope.go:117] "RemoveContainer" containerID="8b1ddd3ab2b401ab415bba3bdc2e908677cec7c1af91782207d45ddb5e73ec37"
Jul 22 16:21:53.709326 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:53.709241    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:21:53.709326 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:53.709320    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt" event={"ID":"a165dc47-9c65-4843-8011-596009f64244","Type":"ContainerStarted","Data":"8d8b87c06b37a7a78c3e8956a057df7f728e7386dbe53662e649eda97816304d"}
Jul 22 16:21:53.709651 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:53.709622    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:21:53.727486 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:53.727435    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9xxgw" podStartSLOduration=74.837026138 podStartE2EDuration="1m18.727420653s" totalImagesPullingTime="3.890394515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:20:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:44.697544232 +0000 UTC m=+70.889747552" watchObservedRunningTime="2026-07-22 16:21:53.727420653 +0000 UTC m=+79.919623980"
Jul 22 16:21:53.728022 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:53.727894    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt" podStartSLOduration=24.523931546 podStartE2EDuration="26.727879435s" totalImagesPullingTime="2.203947889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:53.727007101 +0000 UTC m=+79.919210421" watchObservedRunningTime="2026-07-22 16:21:53.727879435 +0000 UTC m=+79.920082755"
Jul 22 16:21:54.289251 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:21:54.289206    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-5x5qt"
Jul 22 16:22:02.216456 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.216339    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"]
Jul 22 16:22:02.222358 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.222335    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"
Jul 22 16:22:02.224470 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.224448    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 22 16:22:02.225378 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.225358    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 16:22:02.225754 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.225733    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 16:22:02.225832 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.225794    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 16:22:02.231570 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.231547    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"]
Jul 22 16:22:02.302349 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.302311    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9vmqw"]
Jul 22 16:22:02.306059 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.306035    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9vmqw"
Jul 22 16:22:02.308636 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.308617    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 22 16:22:02.308759 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.308622    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n6w2s\""
Jul 22 16:22:02.318915 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.318889    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9vmqw"]
Jul 22 16:22:02.357615 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.357577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h94np\" (UniqueName: \"kubernetes.io/projected/a9839771-55b3-47ad-b74a-90c9f9d92d0b-kube-api-access-h94np\") pod \"klusterlet-addon-workmgr-7b9fbfb84f-7zb82\" (UID: \"a9839771-55b3-47ad-b74a-90c9f9d92d0b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"
Jul 22 16:22:02.357615 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.357620    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a9839771-55b3-47ad-b74a-90c9f9d92d0b-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b9fbfb84f-7zb82\" (UID: \"a9839771-55b3-47ad-b74a-90c9f9d92d0b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"
Jul 22 16:22:02.357876 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.357769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9839771-55b3-47ad-b74a-90c9f9d92d0b-tmp\") pod \"klusterlet-addon-workmgr-7b9fbfb84f-7zb82\" (UID: \"a9839771-55b3-47ad-b74a-90c9f9d92d0b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"
Jul 22 16:22:02.459098 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.459054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h94np\" (UniqueName: \"kubernetes.io/projected/a9839771-55b3-47ad-b74a-90c9f9d92d0b-kube-api-access-h94np\") pod \"klusterlet-addon-workmgr-7b9fbfb84f-7zb82\" (UID: \"a9839771-55b3-47ad-b74a-90c9f9d92d0b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"
Jul 22 16:22:02.459098 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.459101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a9839771-55b3-47ad-b74a-90c9f9d92d0b-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b9fbfb84f-7zb82\" (UID: \"a9839771-55b3-47ad-b74a-90c9f9d92d0b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"
Jul 22 16:22:02.459359 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.459167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9839771-55b3-47ad-b74a-90c9f9d92d0b-tmp\") pod \"klusterlet-addon-workmgr-7b9fbfb84f-7zb82\" (UID: \"a9839771-55b3-47ad-b74a-90c9f9d92d0b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"
Jul 22 16:22:02.459359 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.459242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e45ca8ab-26ed-4a6b-a437-d399e3abf80e-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-9vmqw\" (UID: \"e45ca8ab-26ed-4a6b-a437-d399e3abf80e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9vmqw"
Jul 22 16:22:02.459609 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.459587    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9839771-55b3-47ad-b74a-90c9f9d92d0b-tmp\") pod \"klusterlet-addon-workmgr-7b9fbfb84f-7zb82\" (UID: \"a9839771-55b3-47ad-b74a-90c9f9d92d0b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"
Jul 22 16:22:02.461679 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.461651    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a9839771-55b3-47ad-b74a-90c9f9d92d0b-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b9fbfb84f-7zb82\" (UID: \"a9839771-55b3-47ad-b74a-90c9f9d92d0b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"
Jul 22 16:22:02.468691 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.468623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h94np\" (UniqueName: \"kubernetes.io/projected/a9839771-55b3-47ad-b74a-90c9f9d92d0b-kube-api-access-h94np\") pod \"klusterlet-addon-workmgr-7b9fbfb84f-7zb82\" (UID: \"a9839771-55b3-47ad-b74a-90c9f9d92d0b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"
Jul 22 16:22:02.531452 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.531414    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"
Jul 22 16:22:02.560187 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.560141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e45ca8ab-26ed-4a6b-a437-d399e3abf80e-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-9vmqw\" (UID: \"e45ca8ab-26ed-4a6b-a437-d399e3abf80e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9vmqw"
Jul 22 16:22:02.562498 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.562464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e45ca8ab-26ed-4a6b-a437-d399e3abf80e-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-9vmqw\" (UID: \"e45ca8ab-26ed-4a6b-a437-d399e3abf80e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9vmqw"
Jul 22 16:22:02.615648 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.615622    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9vmqw"
Jul 22 16:22:02.658388 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.658352    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"]
Jul 22 16:22:02.661564 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:22:02.661537    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9839771_55b3_47ad_b74a_90c9f9d92d0b.slice/crio-ddffb601be1063e62e62d61017cba31b63e4a46a2e2867a910c48a8c8b548fa0 WatchSource:0}: Error finding container ddffb601be1063e62e62d61017cba31b63e4a46a2e2867a910c48a8c8b548fa0: Status 404 returned error can't find the container with id ddffb601be1063e62e62d61017cba31b63e4a46a2e2867a910c48a8c8b548fa0
Jul 22 16:22:02.742102 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.742010    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82" event={"ID":"a9839771-55b3-47ad-b74a-90c9f9d92d0b","Type":"ContainerStarted","Data":"ddffb601be1063e62e62d61017cba31b63e4a46a2e2867a910c48a8c8b548fa0"}
Jul 22 16:22:02.750442 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:02.750414    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9vmqw"]
Jul 22 16:22:02.753056 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:22:02.753028    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45ca8ab_26ed_4a6b_a437_d399e3abf80e.slice/crio-9766347692b04677eb42486badbb410b4bf71fa5d0aa47786b46dc8953ac24ab WatchSource:0}: Error finding container 9766347692b04677eb42486badbb410b4bf71fa5d0aa47786b46dc8953ac24ab: Status 404 returned error can't find the container with id 9766347692b04677eb42486badbb410b4bf71fa5d0aa47786b46dc8953ac24ab
Jul 22 16:22:03.062902 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:03.062813    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:22:03.065050 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:03.065030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5phwh\" (UID: \"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544\") " pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:22:03.334502 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:03.334413    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-km9pf\""
Jul 22 16:22:03.342216 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:03.342188    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5phwh"
Jul 22 16:22:03.505780 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:03.505746    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5phwh"]
Jul 22 16:22:03.511402 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:22:03.511365    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc642f4e6_81ae_4a5b_9c08_a6f6ed5dd544.slice/crio-5ee2f94ff0f564749822511b32e8d56fc88787bc252a3d5028a6cf96202193f9 WatchSource:0}: Error finding container 5ee2f94ff0f564749822511b32e8d56fc88787bc252a3d5028a6cf96202193f9: Status 404 returned error can't find the container with id 5ee2f94ff0f564749822511b32e8d56fc88787bc252a3d5028a6cf96202193f9
Jul 22 16:22:03.748659 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:03.748617    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9vmqw" event={"ID":"e45ca8ab-26ed-4a6b-a437-d399e3abf80e","Type":"ContainerStarted","Data":"9766347692b04677eb42486badbb410b4bf71fa5d0aa47786b46dc8953ac24ab"}
Jul 22 16:22:03.750311 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:03.750281    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5phwh" event={"ID":"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544","Type":"ContainerStarted","Data":"5ee2f94ff0f564749822511b32e8d56fc88787bc252a3d5028a6cf96202193f9"}
Jul 22 16:22:04.757110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:04.756826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9vmqw" event={"ID":"e45ca8ab-26ed-4a6b-a437-d399e3abf80e","Type":"ContainerStarted","Data":"a20181e0b671c49af5773714a73a6eedb62a6315dcce1a03cc8cc89c33bf4474"}
Jul 22 16:22:04.757667 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:04.757353    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9vmqw"
Jul 22 16:22:04.764572 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:04.764547    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9vmqw"
Jul 22 16:22:04.776455 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:04.776408    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-9vmqw" podStartSLOduration=1.6317965970000001 podStartE2EDuration="2.776393313s" totalImagesPullingTime="1.144596716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:04.775258178 +0000 UTC m=+90.967461521" watchObservedRunningTime="2026-07-22 16:22:04.776393313 +0000 UTC m=+90.968596633"
Jul 22 16:22:05.777003 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.776971    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"]
Jul 22 16:22:05.779306 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.779283    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:05.782963 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.782753    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 16:22:05.782963 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.782768    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pk48v\""
Jul 22 16:22:05.782963 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.782791    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 22 16:22:05.782963 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.782851    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 16:22:05.782963 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.782768    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 22 16:22:05.783287 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.783132    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 16:22:05.791891 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.791869    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"]
Jul 22 16:22:05.890637 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.890596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7106b3b-d6b9-49f7-a07e-da76c5462883-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-jl65d\" (UID: \"e7106b3b-d6b9-49f7-a07e-da76c5462883\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:05.890820 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.890678    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn4d7\" (UniqueName: \"kubernetes.io/projected/e7106b3b-d6b9-49f7-a07e-da76c5462883-kube-api-access-gn4d7\") pod \"prometheus-operator-5945b5cfd-jl65d\" (UID: \"e7106b3b-d6b9-49f7-a07e-da76c5462883\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:05.890912 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.890836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7106b3b-d6b9-49f7-a07e-da76c5462883-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-jl65d\" (UID: \"e7106b3b-d6b9-49f7-a07e-da76c5462883\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:05.890912 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.890874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7106b3b-d6b9-49f7-a07e-da76c5462883-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-jl65d\" (UID: \"e7106b3b-d6b9-49f7-a07e-da76c5462883\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:05.992096 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.992062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7106b3b-d6b9-49f7-a07e-da76c5462883-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-jl65d\" (UID: \"e7106b3b-d6b9-49f7-a07e-da76c5462883\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:05.992285 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.992110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7106b3b-d6b9-49f7-a07e-da76c5462883-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-jl65d\" (UID: \"e7106b3b-d6b9-49f7-a07e-da76c5462883\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:05.992285 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.992154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7106b3b-d6b9-49f7-a07e-da76c5462883-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-jl65d\" (UID: \"e7106b3b-d6b9-49f7-a07e-da76c5462883\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:05.992285 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.992202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4d7\" (UniqueName: \"kubernetes.io/projected/e7106b3b-d6b9-49f7-a07e-da76c5462883-kube-api-access-gn4d7\") pod \"prometheus-operator-5945b5cfd-jl65d\" (UID: \"e7106b3b-d6b9-49f7-a07e-da76c5462883\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:05.992285 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:22:05.992237    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 22 16:22:05.992496 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:22:05.992317    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7106b3b-d6b9-49f7-a07e-da76c5462883-prometheus-operator-tls podName:e7106b3b-d6b9-49f7-a07e-da76c5462883 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:06.492284291 +0000 UTC m=+92.684487596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e7106b3b-d6b9-49f7-a07e-da76c5462883-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-jl65d" (UID: "e7106b3b-d6b9-49f7-a07e-da76c5462883") : secret "prometheus-operator-tls" not found
Jul 22 16:22:05.993163 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.993136    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7106b3b-d6b9-49f7-a07e-da76c5462883-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-jl65d\" (UID: \"e7106b3b-d6b9-49f7-a07e-da76c5462883\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:05.995427 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:05.995403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7106b3b-d6b9-49f7-a07e-da76c5462883-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-jl65d\" (UID: \"e7106b3b-d6b9-49f7-a07e-da76c5462883\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:06.005627 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:06.005605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn4d7\" (UniqueName: \"kubernetes.io/projected/e7106b3b-d6b9-49f7-a07e-da76c5462883-kube-api-access-gn4d7\") pod \"prometheus-operator-5945b5cfd-jl65d\" (UID: \"e7106b3b-d6b9-49f7-a07e-da76c5462883\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:06.497287 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:06.497246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7106b3b-d6b9-49f7-a07e-da76c5462883-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-jl65d\" (UID: \"e7106b3b-d6b9-49f7-a07e-da76c5462883\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:06.500044 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:06.500019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7106b3b-d6b9-49f7-a07e-da76c5462883-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-jl65d\" (UID: \"e7106b3b-d6b9-49f7-a07e-da76c5462883\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:06.690779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:06.690741    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"
Jul 22 16:22:09.680321 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:09.680291    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-jl65d"]
Jul 22 16:22:09.683667 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:22:09.683636    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7106b3b_d6b9_49f7_a07e_da76c5462883.slice/crio-c38bd59914c1cea117852194c77d16944edf3584d496528286ac4b7cc6ef9f1b WatchSource:0}: Error finding container c38bd59914c1cea117852194c77d16944edf3584d496528286ac4b7cc6ef9f1b: Status 404 returned error can't find the container with id c38bd59914c1cea117852194c77d16944edf3584d496528286ac4b7cc6ef9f1b
Jul 22 16:22:09.776148 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:09.776106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5phwh" event={"ID":"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544","Type":"ContainerStarted","Data":"5983d97387bf68f71b0f426449bf3c2876e0a0addcff0383115db059e070d6b2"}
Jul 22 16:22:09.777208 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:09.777186    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d" event={"ID":"e7106b3b-d6b9-49f7-a07e-da76c5462883","Type":"ContainerStarted","Data":"c38bd59914c1cea117852194c77d16944edf3584d496528286ac4b7cc6ef9f1b"}
Jul 22 16:22:09.778483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:09.778465    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82" event={"ID":"a9839771-55b3-47ad-b74a-90c9f9d92d0b","Type":"ContainerStarted","Data":"1fc2bdd9afbf8489fefd6716a1fe754dfbb7517aeb7bf4f74c4559616514e59f"}
Jul 22 16:22:09.778716 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:09.778700    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"
Jul 22 16:22:09.780250 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:09.780213    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82"
Jul 22 16:22:09.795577 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:09.795497    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9fbfb84f-7zb82" podStartSLOduration=0.914560797 podStartE2EDuration="7.795483991s" totalImagesPullingTime="6.880923194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:09.794560107 +0000 UTC m=+95.986763426" watchObservedRunningTime="2026-07-22 16:22:09.795483991 +0000 UTC m=+95.987687311"
Jul 22 16:22:11.671306 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:11.671270    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rb879"
Jul 22 16:22:11.976884 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:11.976807    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b5557b8bc-nqgnb"]
Jul 22 16:22:11.987055 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:11.987032    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:11.989424 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:11.989396    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 22 16:22:11.989956 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:11.989913    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 22 16:22:11.990072 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:11.989966    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 16:22:11.990072 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:11.990019    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5557b8bc-nqgnb"]
Jul 22 16:22:11.990397 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:11.990253    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 22 16:22:11.990397 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:11.990263    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 22 16:22:11.990397 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:11.990274    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 22 16:22:11.990397 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:11.990330    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bmnj5\""
Jul 22 16:22:11.990846 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:11.990828    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 16:22:12.000097 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.000063    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 22 16:22:12.145898 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.145863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmp22\" (UniqueName: \"kubernetes.io/projected/0eaff9fd-f454-49db-9aa6-b52286e34a73-kube-api-access-dmp22\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.146076 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.145924    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-oauth-serving-cert\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.146076 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.145993    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-service-ca\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.146076 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.146051    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-serving-cert\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.146248 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.146105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-config\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.146248 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.146148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-oauth-config\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.146333 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.146245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-trusted-ca-bundle\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.247570 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.247480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-oauth-serving-cert\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.247570 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.247532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-service-ca\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.247806 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.247572    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-serving-cert\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.247806 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.247613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-config\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.247806 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.247643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-oauth-config\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.247806 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.247675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-trusted-ca-bundle\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.247806 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.247721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmp22\" (UniqueName: \"kubernetes.io/projected/0eaff9fd-f454-49db-9aa6-b52286e34a73-kube-api-access-dmp22\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.248292 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.248263    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-oauth-serving-cert\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.248394 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.248305    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-service-ca\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.248394 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.248323    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-config\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.248826 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.248799    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-trusted-ca-bundle\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.250287 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.250262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-serving-cert\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.250755 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.250730    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-oauth-config\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.256382 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.256359    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmp22\" (UniqueName: \"kubernetes.io/projected/0eaff9fd-f454-49db-9aa6-b52286e34a73-kube-api-access-dmp22\") pod \"console-b5557b8bc-nqgnb\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") " pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.299254 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.299208    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:12.651148 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.651108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:22:12.651495 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.651184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:22:12.653926 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.653895    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b43f2cc-b438-4d0f-b109-14165ae92064-metrics-tls\") pod \"dns-default-5h2xr\" (UID: \"6b43f2cc-b438-4d0f-b109-14165ae92064\") " pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:22:12.654278 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.654257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls\") pod \"image-registry-58f7d8dc56-lct4l\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") " pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:22:12.903621 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.903586    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-88qfg\""
Jul 22 16:22:12.911298 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.911273    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:22:12.916547 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.916525    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4ntcb\""
Jul 22 16:22:12.924657 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:12.924629    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:22:13.321338 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:13.321100    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5557b8bc-nqgnb"]
Jul 22 16:22:13.325003 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:22:13.324873    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eaff9fd_f454_49db_9aa6_b52286e34a73.slice/crio-9893b3fc6bc684db938b42c078e2bc43f6acab5cb51e2740ff1d2fe16908360f WatchSource:0}: Error finding container 9893b3fc6bc684db938b42c078e2bc43f6acab5cb51e2740ff1d2fe16908360f: Status 404 returned error can't find the container with id 9893b3fc6bc684db938b42c078e2bc43f6acab5cb51e2740ff1d2fe16908360f
Jul 22 16:22:13.543977 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:13.543900    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58f7d8dc56-lct4l"]
Jul 22 16:22:13.545818 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:13.545732    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5h2xr"]
Jul 22 16:22:13.547938 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:22:13.547907    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10be6c66_7f28_4c48_b071_f560ca3dbdcd.slice/crio-0d2a900d6385fdfc1694759733ea93c3f469a03b7f48b90451f5189d4f44f578 WatchSource:0}: Error finding container 0d2a900d6385fdfc1694759733ea93c3f469a03b7f48b90451f5189d4f44f578: Status 404 returned error can't find the container with id 0d2a900d6385fdfc1694759733ea93c3f469a03b7f48b90451f5189d4f44f578
Jul 22 16:22:13.548694 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:22:13.548670    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b43f2cc_b438_4d0f_b109_14165ae92064.slice/crio-b8a31a5dded5c1efa55e7bfbce6ac4b66b48b119f55ead8c70c5a512729a7bc7 WatchSource:0}: Error finding container b8a31a5dded5c1efa55e7bfbce6ac4b66b48b119f55ead8c70c5a512729a7bc7: Status 404 returned error can't find the container with id b8a31a5dded5c1efa55e7bfbce6ac4b66b48b119f55ead8c70c5a512729a7bc7
Jul 22 16:22:13.798915 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:13.798823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5phwh" event={"ID":"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544","Type":"ContainerStarted","Data":"50a3c9bde9b1e6d30748c237a63f4dceaf61101baf6722a7fee3dde8985ca17a"}
Jul 22 16:22:13.802383 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:13.801837    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d" event={"ID":"e7106b3b-d6b9-49f7-a07e-da76c5462883","Type":"ContainerStarted","Data":"57e8a01ed486ebfc711fe290142133aec40c2cd68a919881f8c66981051e89db"}
Jul 22 16:22:13.802383 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:13.801890    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d" event={"ID":"e7106b3b-d6b9-49f7-a07e-da76c5462883","Type":"ContainerStarted","Data":"5772bc8d79509d7ac298108d370ce9a55490a5389f700ce36b1fbf54c0853625"}
Jul 22 16:22:13.805471 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:13.804888    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l" event={"ID":"10be6c66-7f28-4c48-b071-f560ca3dbdcd","Type":"ContainerStarted","Data":"7b7a6b4752a2abc86a616ff259c23ed9c69589961601b19573d602d077e0d5c6"}
Jul 22 16:22:13.805471 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:13.804941    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l" event={"ID":"10be6c66-7f28-4c48-b071-f560ca3dbdcd","Type":"ContainerStarted","Data":"0d2a900d6385fdfc1694759733ea93c3f469a03b7f48b90451f5189d4f44f578"}
Jul 22 16:22:13.805471 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:13.805385    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:22:13.807242 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:13.807196    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5557b8bc-nqgnb" event={"ID":"0eaff9fd-f454-49db-9aa6-b52286e34a73","Type":"ContainerStarted","Data":"9893b3fc6bc684db938b42c078e2bc43f6acab5cb51e2740ff1d2fe16908360f"}
Jul 22 16:22:13.808497 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:13.808475    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5h2xr" event={"ID":"6b43f2cc-b438-4d0f-b109-14165ae92064","Type":"ContainerStarted","Data":"b8a31a5dded5c1efa55e7bfbce6ac4b66b48b119f55ead8c70c5a512729a7bc7"}
Jul 22 16:22:13.821405 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:13.821350    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-jl65d" podStartSLOduration=5.350750216 podStartE2EDuration="8.821329136s" totalImagesPullingTime="3.47057892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:13.821091304 +0000 UTC m=+100.013294645" watchObservedRunningTime="2026-07-22 16:22:13.821329136 +0000 UTC m=+100.013532456"
Jul 22 16:22:13.843094 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:13.843028    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l" podStartSLOduration=98.843007532 podStartE2EDuration="1m38.843007532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:20:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:13.84241581 +0000 UTC m=+100.034619148" watchObservedRunningTime="2026-07-22 16:22:13.843007532 +0000 UTC m=+100.035210852"
Jul 22 16:22:16.127195 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.127158    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-lps96"]
Jul 22 16:22:16.132875 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.132843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.135254 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.135111    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 22 16:22:16.135254 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.135140    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9545v\""
Jul 22 16:22:16.136723 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.136514    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 22 16:22:16.136723 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.136570    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 22 16:22:16.143130 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.143111    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fzbwx"]
Jul 22 16:22:16.148241 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.148201    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-lps96"]
Jul 22 16:22:16.148336 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.148322    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.151027 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.151005    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 16:22:16.151147 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.151059    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 16:22:16.151147 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.151138    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 16:22:16.151285 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.151015    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pjncw\""
Jul 22 16:22:16.181369 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.181555 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181385    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-tls\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.181555 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181412    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-root\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.181555 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181505    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.181555 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-textfile\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.181774 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f1b74e4-767c-4d62-a8bd-430b856ed054-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.181774 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181620    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-wtmp\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.181774 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181661    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.181774 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.181926 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181781    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2f1b74e4-767c-4d62-a8bd-430b856ed054-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.181926 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nj7p\" (UniqueName: \"kubernetes.io/projected/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-kube-api-access-2nj7p\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.181926 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-sys\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.181926 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-metrics-client-ca\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.181926 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.182160 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.181977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skjbp\" (UniqueName: \"kubernetes.io/projected/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-api-access-skjbp\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.282817 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.282773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.282980 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.282840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2f1b74e4-767c-4d62-a8bd-430b856ed054-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.282980 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.282860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nj7p\" (UniqueName: \"kubernetes.io/projected/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-kube-api-access-2nj7p\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.282980 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.282878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-sys\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.282980 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.282900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-metrics-client-ca\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.282980 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.282916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.282980 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.282959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skjbp\" (UniqueName: \"kubernetes.io/projected/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-api-access-skjbp\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.283350 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.282994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.283350 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.283016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-tls\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.283350 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.283032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-root\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.283350 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.283070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.283350 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.283090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-textfile\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.283350 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.283114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f1b74e4-767c-4d62-a8bd-430b856ed054-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.283350 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.283142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-wtmp\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.283350 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.283159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.283350 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.283306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2f1b74e4-767c-4d62-a8bd-430b856ed054-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.283350 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:22:16.283334    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 16:22:16.283829 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:22:16.283391    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-tls podName:e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:16.78337217 +0000 UTC m=+102.975575474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-tls") pod "node-exporter-fzbwx" (UID: "e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0") : secret "node-exporter-tls" not found
Jul 22 16:22:16.283829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.283606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.283829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.282988    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-sys\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.283829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.283701    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-wtmp\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.283829 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:22:16.283727    2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 22 16:22:16.283829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.283757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-root\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.283829 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:22:16.283779    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-state-metrics-tls podName:2f1b74e4-767c-4d62-a8bd-430b856ed054 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:16.783762107 +0000 UTC m=+102.975965419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-lps96" (UID: "2f1b74e4-767c-4d62-a8bd-430b856ed054") : secret "kube-state-metrics-tls" not found
Jul 22 16:22:16.283829 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.283799    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.284207 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.283958    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f1b74e4-767c-4d62-a8bd-430b856ed054-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.284207 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.284014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-textfile\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.284207 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.284050    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-metrics-client-ca\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.286058 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.286033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.286524 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.286501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.294716 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.294690    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nj7p\" (UniqueName: \"kubernetes.io/projected/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-kube-api-access-2nj7p\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.294907 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.294808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skjbp\" (UniqueName: \"kubernetes.io/projected/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-api-access-skjbp\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.788367 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.788315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:16.788547 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.788389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-tls\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.790967 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.790941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0-node-exporter-tls\") pod \"node-exporter-fzbwx\" (UID: \"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0\") " pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:16.791112 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:16.791002    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f1b74e4-767c-4d62-a8bd-430b856ed054-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-lps96\" (UID: \"2f1b74e4-767c-4d62-a8bd-430b856ed054\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:17.045774 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:17.045694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96"
Jul 22 16:22:17.059154 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:17.059132    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fzbwx"
Jul 22 16:22:18.828362 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:18.828336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzbwx" event={"ID":"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0","Type":"ContainerStarted","Data":"13d6477c444fcfe8b845b3a96fe666e70c823166839c34d6ac81f41c473169e0"}
Jul 22 16:22:18.945528 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:18.945504    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-lps96"]
Jul 22 16:22:18.950083 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:22:18.949919    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1b74e4_767c_4d62_a8bd_430b856ed054.slice/crio-ef75e969b393ac5df10ca7b0459bdc381bf6c70238affdf8583b04a139eacd6a WatchSource:0}: Error finding container ef75e969b393ac5df10ca7b0459bdc381bf6c70238affdf8583b04a139eacd6a: Status 404 returned error can't find the container with id ef75e969b393ac5df10ca7b0459bdc381bf6c70238affdf8583b04a139eacd6a
Jul 22 16:22:19.835374 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:19.835338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5557b8bc-nqgnb" event={"ID":"0eaff9fd-f454-49db-9aa6-b52286e34a73","Type":"ContainerStarted","Data":"2fe290702ac95117e880011c53865678a2a445fdfccbe92c4b3cb327ea5fead1"}
Jul 22 16:22:19.837193 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:19.837161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96" event={"ID":"2f1b74e4-767c-4d62-a8bd-430b856ed054","Type":"ContainerStarted","Data":"ef75e969b393ac5df10ca7b0459bdc381bf6c70238affdf8583b04a139eacd6a"}
Jul 22 16:22:19.839434 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:19.839309    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5h2xr" event={"ID":"6b43f2cc-b438-4d0f-b109-14165ae92064","Type":"ContainerStarted","Data":"27b00dfc3ddc8254061e1724c12536d237d869d4f37d183fd2cb84be41f34517"}
Jul 22 16:22:19.839434 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:19.839357    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5h2xr" event={"ID":"6b43f2cc-b438-4d0f-b109-14165ae92064","Type":"ContainerStarted","Data":"4142d1529a054882d713a58e1e815f78ecb04cdafaa4082b3efe7a5aa2d3e848"}
Jul 22 16:22:19.839434 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:19.839406    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:22:19.841342 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:19.841318    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzbwx" event={"ID":"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0","Type":"ContainerStarted","Data":"17998c30390a327dd69e41b06a94f6c66928b702eed67ff3034f1807f56b0730"}
Jul 22 16:22:19.843832 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:19.843768    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5phwh" event={"ID":"c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544","Type":"ContainerStarted","Data":"89a0e714082a4b5b7ed51a81f6800b02ab86488847142f111d638720287bac23"}
Jul 22 16:22:19.856327 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:19.856285    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b5557b8bc-nqgnb" podStartSLOduration=3.379020983 podStartE2EDuration="8.856269243s" totalImagesPullingTime="5.47724826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:19.854400436 +0000 UTC m=+106.046603782" watchObservedRunningTime="2026-07-22 16:22:19.856269243 +0000 UTC m=+106.048472542"
Jul 22 16:22:19.891365 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:19.891315    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5h2xr" podStartSLOduration=66.637861836 podStartE2EDuration="1m11.891298857s" totalImagesPullingTime="5.253437021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:21:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:19.890988784 +0000 UTC m=+106.083192103" watchObservedRunningTime="2026-07-22 16:22:19.891298857 +0000 UTC m=+106.083502172"
Jul 22 16:22:19.908362 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:19.908310    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5phwh" podStartSLOduration=33.777455829 podStartE2EDuration="48.90828909s" totalImagesPullingTime="15.130833261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:21:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:19.90768097 +0000 UTC m=+106.099884288" watchObservedRunningTime="2026-07-22 16:22:19.90828909 +0000 UTC m=+106.100492410"
Jul 22 16:22:20.851646 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:20.850762    2580 generic.go:356] "Generic (PLEG): container finished" podID="e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0" containerID="17998c30390a327dd69e41b06a94f6c66928b702eed67ff3034f1807f56b0730" exitCode=0
Jul 22 16:22:20.851646 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:20.850925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzbwx" event={"ID":"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0","Type":"ContainerDied","Data":"17998c30390a327dd69e41b06a94f6c66928b702eed67ff3034f1807f56b0730"}
Jul 22 16:22:20.854421 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:20.854385    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96" event={"ID":"2f1b74e4-767c-4d62-a8bd-430b856ed054","Type":"ContainerStarted","Data":"0eaf3dc5f0855ba00f4e616ed14e30831f8d10f141df2770745393ec7c670161"}
Jul 22 16:22:20.854502 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:20.854444    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96" event={"ID":"2f1b74e4-767c-4d62-a8bd-430b856ed054","Type":"ContainerStarted","Data":"57dd0e9db8d464beea56e20bfa0a8763dc25fdc03a53248005ef9b6da450a979"}
Jul 22 16:22:20.854502 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:20.854469    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96" event={"ID":"2f1b74e4-767c-4d62-a8bd-430b856ed054","Type":"ContainerStarted","Data":"3485f58fd1161739e25ba71567133a62f8e2a77cdb2f9eda1b87684809d93ab7"}
Jul 22 16:22:20.904310 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:20.904249    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-lps96" podStartSLOduration=3.597958706 podStartE2EDuration="4.904212479s" totalImagesPullingTime="1.306253773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:20.902474894 +0000 UTC m=+107.094678213" watchObservedRunningTime="2026-07-22 16:22:20.904212479 +0000 UTC m=+107.096415799"
Jul 22 16:22:20.978161 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:20.978136    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5557b8bc-nqgnb"]
Jul 22 16:22:21.859922 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:21.859884    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzbwx" event={"ID":"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0","Type":"ContainerStarted","Data":"a9984d73b63885459270af5206f40a7f41ec476ce94c625769467d09a76fcb49"}
Jul 22 16:22:21.860332 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:21.859943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzbwx" event={"ID":"e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0","Type":"ContainerStarted","Data":"f4d2b7f52cda0565457df1e6af25b6b254b5fecffc4836416159c1473e949039"}
Jul 22 16:22:21.898447 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:21.898389    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fzbwx" podStartSLOduration=4.939384303 podStartE2EDuration="5.898368877s" totalImagesPullingTime="883.570854ms" totalInitContainerRuntime="75.41372ms" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:21.897762634 +0000 UTC m=+108.089965932" watchObservedRunningTime="2026-07-22 16:22:21.898368877 +0000 UTC m=+108.090572197"
Jul 22 16:22:22.300118 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.299992    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:22.332298 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.332260    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:22:22.336946 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.336914    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.339526 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.339506    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 16:22:22.339748 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.339729    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 16:22:22.339908 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.339791    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4kbkt\""
Jul 22 16:22:22.339908 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.339729    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 16:22:22.340146 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.340120    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 16:22:22.340146 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.340129    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 16:22:22.340307 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.340178    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 16:22:22.340307 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.340193    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 16:22:22.340707 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.340686    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 16:22:22.340707 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.340686    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 16:22:22.340871 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.340775    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 16:22:22.340871 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.340692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 16:22:22.341052 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.341036    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-845mkeclkm849\""
Jul 22 16:22:22.341127 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.341113    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 16:22:22.341127 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.341122    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 16:22:22.341283 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.341149    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 16:22:22.344109 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.343933    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 16:22:22.359824 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.359791    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:22:22.436167 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436167 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9rhs\" (UniqueName: \"kubernetes.io/projected/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-kube-api-access-b9rhs\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436438 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436438 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436438 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436438 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436354    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436438 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436429    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436529    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-web-config\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-config\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436655    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436898 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436898 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436731    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436898 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436755    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436898 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-config-out\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.436898 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436873    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.437104 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.437104 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.437104 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.436963    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538051 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-config-out\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538051 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538334 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538334 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538334 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538508 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538508 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9rhs\" (UniqueName: \"kubernetes.io/projected/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-kube-api-access-b9rhs\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538508 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538655 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538551    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538655 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538655 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538900 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538900 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538711    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538900 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538900 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-web-config\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538900 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538813    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-config\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538900 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.538900 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.539217 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.539217 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.539217 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.538960    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.539217 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.539038    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.540943 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.540904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.542081 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.541173    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.542081 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.541780    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.542296 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.542118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.547931 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.543714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.547931 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.543872    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.547931 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.544055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-config-out\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.547931 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.544168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.547931 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.544301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.547931 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.544779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.547931 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.546942    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.547931 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.547338    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.548481 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.548465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.549149 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.549127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-web-config\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.552207 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.552152    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-config\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.552658 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.552635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.553070 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.553046    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.554847 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.554823    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9rhs\" (UniqueName: \"kubernetes.io/projected/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-kube-api-access-b9rhs\") pod \"prometheus-k8s-0\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.649417 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.649384    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:22.829660 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.829583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:22:22.838669 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:22:22.838639    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3094cf48_3c6c_4cd6_a5c5_66b68e93ee7b.slice/crio-23250a56d6cc9eba5cfc4e17b64cf47e3e396f7b541d8f944a4d6dd4ece5a133 WatchSource:0}: Error finding container 23250a56d6cc9eba5cfc4e17b64cf47e3e396f7b541d8f944a4d6dd4ece5a133: Status 404 returned error can't find the container with id 23250a56d6cc9eba5cfc4e17b64cf47e3e396f7b541d8f944a4d6dd4ece5a133
Jul 22 16:22:22.864971 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:22.864939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerStarted","Data":"23250a56d6cc9eba5cfc4e17b64cf47e3e396f7b541d8f944a4d6dd4ece5a133"}
Jul 22 16:22:23.870916 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:23.870886    2580 generic.go:356] "Generic (PLEG): container finished" podID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerID="66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db" exitCode=0
Jul 22 16:22:23.871409 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:23.870968    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerDied","Data":"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"}
Jul 22 16:22:25.362804 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:25.362769    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58f7d8dc56-lct4l"]
Jul 22 16:22:27.890616 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:27.890571    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerStarted","Data":"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"}
Jul 22 16:22:27.891049 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:27.890669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerStarted","Data":"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"}
Jul 22 16:22:29.856777 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:29.856751    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5h2xr"
Jul 22 16:22:29.902530 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:29.902496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerStarted","Data":"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"}
Jul 22 16:22:29.902670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:29.902570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerStarted","Data":"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"}
Jul 22 16:22:29.902670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:29.902597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerStarted","Data":"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"}
Jul 22 16:22:29.902670 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:29.902620    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerStarted","Data":"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"}
Jul 22 16:22:29.936901 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:29.936844    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.953210891 podStartE2EDuration="7.936824285s" totalImagesPullingTime="5.970306938s" totalInitContainerRuntime="13.306456ms" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:29.934018856 +0000 UTC m=+116.126222203" watchObservedRunningTime="2026-07-22 16:22:29.936824285 +0000 UTC m=+116.129027602"
Jul 22 16:22:32.650117 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:32.650079    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:22:35.368353 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:35.368318    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:22:44.127375 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:44.127336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:22:44.129578 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:44.129558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406ea80e-5332-40e8-8bda-8edf582a17c9-metrics-certs\") pod \"network-metrics-daemon-zdkhc\" (UID: \"406ea80e-5332-40e8-8bda-8edf582a17c9\") " pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:22:44.315943 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:44.315912    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9mc4s\""
Jul 22 16:22:44.324725 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:44.324701    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdkhc"
Jul 22 16:22:44.581096 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:44.581067    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zdkhc"]
Jul 22 16:22:44.583834 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:22:44.583806    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406ea80e_5332_40e8_8bda_8edf582a17c9.slice/crio-63fbd6e98f9e64fcd5d3cacad25340528cd9d53dece9353bbf2efacfdee4b45c WatchSource:0}: Error finding container 63fbd6e98f9e64fcd5d3cacad25340528cd9d53dece9353bbf2efacfdee4b45c: Status 404 returned error can't find the container with id 63fbd6e98f9e64fcd5d3cacad25340528cd9d53dece9353bbf2efacfdee4b45c
Jul 22 16:22:44.962263 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:44.962208    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zdkhc" event={"ID":"406ea80e-5332-40e8-8bda-8edf582a17c9","Type":"ContainerStarted","Data":"63fbd6e98f9e64fcd5d3cacad25340528cd9d53dece9353bbf2efacfdee4b45c"}
Jul 22 16:22:46.879289 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:46.879214    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b5557b8bc-nqgnb" podUID="0eaff9fd-f454-49db-9aa6-b52286e34a73" containerName="console" containerID="cri-o://2fe290702ac95117e880011c53865678a2a445fdfccbe92c4b3cb327ea5fead1" gracePeriod=15
Jul 22 16:22:46.971866 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:46.971829    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zdkhc" event={"ID":"406ea80e-5332-40e8-8bda-8edf582a17c9","Type":"ContainerStarted","Data":"536b1dd9d82a0da2272eee7e4660c188576b4e19bb932bbc19279e8b1aeab1ce"}
Jul 22 16:22:46.972000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:46.971881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zdkhc" event={"ID":"406ea80e-5332-40e8-8bda-8edf582a17c9","Type":"ContainerStarted","Data":"066195a19bf90abe4e4c81d235103a9238da0ba30f4d666b845298dccaf8eccc"}
Jul 22 16:22:46.992303 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:46.992254    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zdkhc" podStartSLOduration=130.57125722 podStartE2EDuration="2m11.992234353s" totalImagesPullingTime="1.420977133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:20:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:46.99065237 +0000 UTC m=+133.182855714" watchObservedRunningTime="2026-07-22 16:22:46.992234353 +0000 UTC m=+133.184437665"
Jul 22 16:22:47.191661 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.191621    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:47.353847 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.353813    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmp22\" (UniqueName: \"kubernetes.io/projected/0eaff9fd-f454-49db-9aa6-b52286e34a73-kube-api-access-dmp22\") pod \"0eaff9fd-f454-49db-9aa6-b52286e34a73\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") "
Jul 22 16:22:47.354041 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.353879    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-oauth-config\") pod \"0eaff9fd-f454-49db-9aa6-b52286e34a73\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") "
Jul 22 16:22:47.354041 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.353910    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-serving-cert\") pod \"0eaff9fd-f454-49db-9aa6-b52286e34a73\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") "
Jul 22 16:22:47.354041 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.353952    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-oauth-serving-cert\") pod \"0eaff9fd-f454-49db-9aa6-b52286e34a73\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") "
Jul 22 16:22:47.354041 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.353978    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-service-ca\") pod \"0eaff9fd-f454-49db-9aa6-b52286e34a73\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") "
Jul 22 16:22:47.354041 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.354014    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-config\") pod \"0eaff9fd-f454-49db-9aa6-b52286e34a73\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") "
Jul 22 16:22:47.354322 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.354073    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-trusted-ca-bundle\") pod \"0eaff9fd-f454-49db-9aa6-b52286e34a73\" (UID: \"0eaff9fd-f454-49db-9aa6-b52286e34a73\") "
Jul 22 16:22:47.354406 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.354348    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0eaff9fd-f454-49db-9aa6-b52286e34a73" (UID: "0eaff9fd-f454-49db-9aa6-b52286e34a73"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:22:47.354467 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.354417    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-service-ca" (OuterVolumeSpecName: "service-ca") pod "0eaff9fd-f454-49db-9aa6-b52286e34a73" (UID: "0eaff9fd-f454-49db-9aa6-b52286e34a73"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:22:47.354673 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.354648    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-config" (OuterVolumeSpecName: "console-config") pod "0eaff9fd-f454-49db-9aa6-b52286e34a73" (UID: "0eaff9fd-f454-49db-9aa6-b52286e34a73"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:22:47.354752 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.354661    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0eaff9fd-f454-49db-9aa6-b52286e34a73" (UID: "0eaff9fd-f454-49db-9aa6-b52286e34a73"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:22:47.356197 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.356160    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0eaff9fd-f454-49db-9aa6-b52286e34a73" (UID: "0eaff9fd-f454-49db-9aa6-b52286e34a73"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:22:47.356197 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.356175    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0eaff9fd-f454-49db-9aa6-b52286e34a73" (UID: "0eaff9fd-f454-49db-9aa6-b52286e34a73"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:22:47.356429 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.356217    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eaff9fd-f454-49db-9aa6-b52286e34a73-kube-api-access-dmp22" (OuterVolumeSpecName: "kube-api-access-dmp22") pod "0eaff9fd-f454-49db-9aa6-b52286e34a73" (UID: "0eaff9fd-f454-49db-9aa6-b52286e34a73"). InnerVolumeSpecName "kube-api-access-dmp22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:22:47.455709 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.455624    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-oauth-serving-cert\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:47.455709 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.455656    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-service-ca\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:47.455709 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.455668    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-config\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:47.455709 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.455676    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eaff9fd-f454-49db-9aa6-b52286e34a73-trusted-ca-bundle\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:47.455709 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.455684    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmp22\" (UniqueName: \"kubernetes.io/projected/0eaff9fd-f454-49db-9aa6-b52286e34a73-kube-api-access-dmp22\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:47.455709 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.455693    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-oauth-config\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:47.455709 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.455702    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0eaff9fd-f454-49db-9aa6-b52286e34a73-console-serving-cert\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:47.976604 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.976560    2580 generic.go:356] "Generic (PLEG): container finished" podID="0eaff9fd-f454-49db-9aa6-b52286e34a73" containerID="2fe290702ac95117e880011c53865678a2a445fdfccbe92c4b3cb327ea5fead1" exitCode=0
Jul 22 16:22:47.976604 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.976610    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5557b8bc-nqgnb"
Jul 22 16:22:47.977101 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.976645    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5557b8bc-nqgnb" event={"ID":"0eaff9fd-f454-49db-9aa6-b52286e34a73","Type":"ContainerDied","Data":"2fe290702ac95117e880011c53865678a2a445fdfccbe92c4b3cb327ea5fead1"}
Jul 22 16:22:47.977101 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.976698    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5557b8bc-nqgnb" event={"ID":"0eaff9fd-f454-49db-9aa6-b52286e34a73","Type":"ContainerDied","Data":"9893b3fc6bc684db938b42c078e2bc43f6acab5cb51e2740ff1d2fe16908360f"}
Jul 22 16:22:47.977101 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.976720    2580 scope.go:117] "RemoveContainer" containerID="2fe290702ac95117e880011c53865678a2a445fdfccbe92c4b3cb327ea5fead1"
Jul 22 16:22:47.985519 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.985498    2580 scope.go:117] "RemoveContainer" containerID="2fe290702ac95117e880011c53865678a2a445fdfccbe92c4b3cb327ea5fead1"
Jul 22 16:22:47.985805 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:22:47.985787    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fe290702ac95117e880011c53865678a2a445fdfccbe92c4b3cb327ea5fead1\": container with ID starting with 2fe290702ac95117e880011c53865678a2a445fdfccbe92c4b3cb327ea5fead1 not found: ID does not exist" containerID="2fe290702ac95117e880011c53865678a2a445fdfccbe92c4b3cb327ea5fead1"
Jul 22 16:22:47.985876 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:47.985812    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fe290702ac95117e880011c53865678a2a445fdfccbe92c4b3cb327ea5fead1"} err="failed to get container status \"2fe290702ac95117e880011c53865678a2a445fdfccbe92c4b3cb327ea5fead1\": rpc error: code = NotFound desc = could not find container \"2fe290702ac95117e880011c53865678a2a445fdfccbe92c4b3cb327ea5fead1\": container with ID starting with 2fe290702ac95117e880011c53865678a2a445fdfccbe92c4b3cb327ea5fead1 not found: ID does not exist"
Jul 22 16:22:48.002810 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:48.002782    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5557b8bc-nqgnb"]
Jul 22 16:22:48.007101 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:48.007081    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b5557b8bc-nqgnb"]
Jul 22 16:22:48.407428 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:48.407390    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eaff9fd-f454-49db-9aa6-b52286e34a73" path="/var/lib/kubelet/pods/0eaff9fd-f454-49db-9aa6-b52286e34a73/volumes"
Jul 22 16:22:50.391065 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.391022    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l" podUID="10be6c66-7f28-4c48-b071-f560ca3dbdcd" containerName="registry" containerID="cri-o://7b7a6b4752a2abc86a616ff259c23ed9c69589961601b19573d602d077e0d5c6" gracePeriod=30
Jul 22 16:22:50.645515 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.645447    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:22:50.786956 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.786912    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10be6c66-7f28-4c48-b071-f560ca3dbdcd-trusted-ca\") pod \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") "
Jul 22 16:22:50.787165 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.786992    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-certificates\") pod \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") "
Jul 22 16:22:50.787165 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.787020    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10be6c66-7f28-4c48-b071-f560ca3dbdcd-installation-pull-secrets\") pod \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") "
Jul 22 16:22:50.787165 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.787057    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10be6c66-7f28-4c48-b071-f560ca3dbdcd-ca-trust-extracted\") pod \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") "
Jul 22 16:22:50.787165 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.787080    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78bts\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-kube-api-access-78bts\") pod \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") "
Jul 22 16:22:50.787165 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.787120    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls\") pod \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") "
Jul 22 16:22:50.787440 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.787177    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-bound-sa-token\") pod \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") "
Jul 22 16:22:50.787440 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.787204    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10be6c66-7f28-4c48-b071-f560ca3dbdcd-image-registry-private-configuration\") pod \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\" (UID: \"10be6c66-7f28-4c48-b071-f560ca3dbdcd\") "
Jul 22 16:22:50.787543 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.787475    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10be6c66-7f28-4c48-b071-f560ca3dbdcd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "10be6c66-7f28-4c48-b071-f560ca3dbdcd" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:22:50.787543 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.787503    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "10be6c66-7f28-4c48-b071-f560ca3dbdcd" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:22:50.790071 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.790044    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-kube-api-access-78bts" (OuterVolumeSpecName: "kube-api-access-78bts") pod "10be6c66-7f28-4c48-b071-f560ca3dbdcd" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd"). InnerVolumeSpecName "kube-api-access-78bts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:22:50.790194 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.790082    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10be6c66-7f28-4c48-b071-f560ca3dbdcd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "10be6c66-7f28-4c48-b071-f560ca3dbdcd" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:22:50.790194 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.790109    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "10be6c66-7f28-4c48-b071-f560ca3dbdcd" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:22:50.790194 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.790124    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "10be6c66-7f28-4c48-b071-f560ca3dbdcd" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:22:50.790381 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.790178    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10be6c66-7f28-4c48-b071-f560ca3dbdcd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "10be6c66-7f28-4c48-b071-f560ca3dbdcd" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:22:50.796091 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.796064    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10be6c66-7f28-4c48-b071-f560ca3dbdcd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "10be6c66-7f28-4c48-b071-f560ca3dbdcd" (UID: "10be6c66-7f28-4c48-b071-f560ca3dbdcd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:22:50.888214 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.888179    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-bound-sa-token\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:50.888214 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.888210    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10be6c66-7f28-4c48-b071-f560ca3dbdcd-image-registry-private-configuration\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:50.888214 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.888233    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10be6c66-7f28-4c48-b071-f560ca3dbdcd-trusted-ca\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:50.888487 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.888242    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-certificates\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:50.888487 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.888251    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10be6c66-7f28-4c48-b071-f560ca3dbdcd-installation-pull-secrets\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:50.888487 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.888260    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10be6c66-7f28-4c48-b071-f560ca3dbdcd-ca-trust-extracted\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:50.888487 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.888268    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78bts\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-kube-api-access-78bts\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:50.888487 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.888276    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10be6c66-7f28-4c48-b071-f560ca3dbdcd-registry-tls\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:22:50.990007 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.989938    2580 generic.go:356] "Generic (PLEG): container finished" podID="10be6c66-7f28-4c48-b071-f560ca3dbdcd" containerID="7b7a6b4752a2abc86a616ff259c23ed9c69589961601b19573d602d077e0d5c6" exitCode=0
Jul 22 16:22:50.990007 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.989979    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l"
Jul 22 16:22:50.990185 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.990009    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l" event={"ID":"10be6c66-7f28-4c48-b071-f560ca3dbdcd","Type":"ContainerDied","Data":"7b7a6b4752a2abc86a616ff259c23ed9c69589961601b19573d602d077e0d5c6"}
Jul 22 16:22:50.990185 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.990049    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f7d8dc56-lct4l" event={"ID":"10be6c66-7f28-4c48-b071-f560ca3dbdcd","Type":"ContainerDied","Data":"0d2a900d6385fdfc1694759733ea93c3f469a03b7f48b90451f5189d4f44f578"}
Jul 22 16:22:50.990185 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.990067    2580 scope.go:117] "RemoveContainer" containerID="7b7a6b4752a2abc86a616ff259c23ed9c69589961601b19573d602d077e0d5c6"
Jul 22 16:22:50.998327 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.998311    2580 scope.go:117] "RemoveContainer" containerID="7b7a6b4752a2abc86a616ff259c23ed9c69589961601b19573d602d077e0d5c6"
Jul 22 16:22:50.998593 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:22:50.998569    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b7a6b4752a2abc86a616ff259c23ed9c69589961601b19573d602d077e0d5c6\": container with ID starting with 7b7a6b4752a2abc86a616ff259c23ed9c69589961601b19573d602d077e0d5c6 not found: ID does not exist" containerID="7b7a6b4752a2abc86a616ff259c23ed9c69589961601b19573d602d077e0d5c6"
Jul 22 16:22:50.998646 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:50.998605    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b7a6b4752a2abc86a616ff259c23ed9c69589961601b19573d602d077e0d5c6"} err="failed to get container status \"7b7a6b4752a2abc86a616ff259c23ed9c69589961601b19573d602d077e0d5c6\": rpc error: code = NotFound desc = could not find container \"7b7a6b4752a2abc86a616ff259c23ed9c69589961601b19573d602d077e0d5c6\": container with ID starting with 7b7a6b4752a2abc86a616ff259c23ed9c69589961601b19573d602d077e0d5c6 not found: ID does not exist"
Jul 22 16:22:51.012213 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:51.012193    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58f7d8dc56-lct4l"]
Jul 22 16:22:51.017232 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:51.017198    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58f7d8dc56-lct4l"]
Jul 22 16:22:52.407480 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:22:52.407447    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10be6c66-7f28-4c48-b071-f560ca3dbdcd" path="/var/lib/kubelet/pods/10be6c66-7f28-4c48-b071-f560ca3dbdcd/volumes"
Jul 22 16:23:06.050875 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:06.050838    2580 generic.go:356] "Generic (PLEG): container finished" podID="3896ccdb-c971-43c1-bdcc-5b5b60f932c8" containerID="32f1e9cd808595670124cb69f8a6717840bd7292dc6a6e1acede3e246365eec7" exitCode=0
Jul 22 16:23:06.051255 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:06.050901    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2" event={"ID":"3896ccdb-c971-43c1-bdcc-5b5b60f932c8","Type":"ContainerDied","Data":"32f1e9cd808595670124cb69f8a6717840bd7292dc6a6e1acede3e246365eec7"}
Jul 22 16:23:06.051255 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:06.051241    2580 scope.go:117] "RemoveContainer" containerID="32f1e9cd808595670124cb69f8a6717840bd7292dc6a6e1acede3e246365eec7"
Jul 22 16:23:07.056762 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:07.056731    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-ft9q2" event={"ID":"3896ccdb-c971-43c1-bdcc-5b5b60f932c8","Type":"ContainerStarted","Data":"8f4139d4b29747c64a110a46b899c6d1dc12754914b84364cfd3f8e15f9119ac"}
Jul 22 16:23:22.650026 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:22.649991    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:22.668468 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:22.668446    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:23.134252 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:23.134209    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:40.845845 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:40.845809    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:23:40.846360 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:40.846098    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="prometheus" containerID="cri-o://eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7" gracePeriod=600
Jul 22 16:23:40.846360 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:40.846215    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f" gracePeriod=600
Jul 22 16:23:40.846360 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:40.846288    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="thanos-sidecar" containerID="cri-o://fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16" gracePeriod=600
Jul 22 16:23:40.846360 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:40.846316    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="config-reloader" containerID="cri-o://cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab" gracePeriod=600
Jul 22 16:23:40.846586 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:40.846426    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="kube-rbac-proxy" containerID="cri-o://238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b" gracePeriod=600
Jul 22 16:23:40.846586 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:40.846441    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="kube-rbac-proxy-web" containerID="cri-o://845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7" gracePeriod=600
Jul 22 16:23:41.101144 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.101067    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.193290 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193252    2580 generic.go:356] "Generic (PLEG): container finished" podID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerID="1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f" exitCode=0
Jul 22 16:23:41.193290 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193284    2580 generic.go:356] "Generic (PLEG): container finished" podID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerID="238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b" exitCode=0
Jul 22 16:23:41.193290 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193293    2580 generic.go:356] "Generic (PLEG): container finished" podID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerID="845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7" exitCode=0
Jul 22 16:23:41.193530 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193305    2580 generic.go:356] "Generic (PLEG): container finished" podID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerID="fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16" exitCode=0
Jul 22 16:23:41.193530 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193315    2580 generic.go:356] "Generic (PLEG): container finished" podID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerID="cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab" exitCode=0
Jul 22 16:23:41.193530 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193323    2580 generic.go:356] "Generic (PLEG): container finished" podID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerID="eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7" exitCode=0
Jul 22 16:23:41.193530 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193344    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.193530 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193367    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerDied","Data":"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"}
Jul 22 16:23:41.193530 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerDied","Data":"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"}
Jul 22 16:23:41.193530 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193512    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerDied","Data":"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"}
Jul 22 16:23:41.193809 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193532    2580 scope.go:117] "RemoveContainer" containerID="1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"
Jul 22 16:23:41.193809 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193551    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerDied","Data":"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"}
Jul 22 16:23:41.193809 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerDied","Data":"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"}
Jul 22 16:23:41.193809 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerDied","Data":"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"}
Jul 22 16:23:41.193809 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.193671    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b","Type":"ContainerDied","Data":"23250a56d6cc9eba5cfc4e17b64cf47e3e396f7b541d8f944a4d6dd4ece5a133"}
Jul 22 16:23:41.201498 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.201480    2580 scope.go:117] "RemoveContainer" containerID="238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"
Jul 22 16:23:41.207708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.207687    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-kube-rbac-proxy\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.207796 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.207720    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-0\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.207796 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.207741    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.207796 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.207767    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-db\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.207796 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.207787    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-web-config\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.207804    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-tls-assets\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.207827    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-metrics-client-ca\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.207846    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-2\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.207874    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-grpc-tls\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.207911    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-serving-certs-ca-bundle\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.207940    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-1\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.207979    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-kubelet-serving-ca-bundle\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.208003    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-config-out\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.208049    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-thanos-prometheus-http-client-file\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.208086    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-tls\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.208121    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.208145    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-trusted-ca-bundle\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.208169    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-config\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.208198    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9rhs\" (UniqueName: \"kubernetes.io/projected/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-kube-api-access-b9rhs\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.209341 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.208245    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-metrics-client-certs\") pod \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\" (UID: \"3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b\") "
Jul 22 16:23:41.210206 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.208410    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:23:41.210206 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.208505    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.210206 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.208927    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:23:41.210206 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.209003    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:23:41.210206 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.209099    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:23:41.210206 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.209106    2580 scope.go:117] "RemoveContainer" containerID="845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"
Jul 22 16:23:41.210206 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.209203    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:23:41.210206 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.209654    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:23:41.210939 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.210622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:23:41.210939 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.210711    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:23:41.211077 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.211046    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:23:41.212051 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.211994    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:23:41.212330 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.212305    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:23:41.212419 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.212396    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:23:41.212483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.212415    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:23:41.213144 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.213105    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-kube-api-access-b9rhs" (OuterVolumeSpecName: "kube-api-access-b9rhs") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "kube-api-access-b9rhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:23:41.213251 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.213188    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:23:41.213319 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.213291    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:23:41.213391 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.213368    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-config-out" (OuterVolumeSpecName: "config-out") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:23:41.214022 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.213989    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-config" (OuterVolumeSpecName: "config") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:23:41.214022 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.214005    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:23:41.220316 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.220292    2580 scope.go:117] "RemoveContainer" containerID="fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"
Jul 22 16:23:41.222534 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.222514    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-web-config" (OuterVolumeSpecName: "web-config") pod "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" (UID: "3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:23:41.227079 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.227063    2580 scope.go:117] "RemoveContainer" containerID="cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"
Jul 22 16:23:41.233460 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.233445    2580 scope.go:117] "RemoveContainer" containerID="eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"
Jul 22 16:23:41.240470 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.240455    2580 scope.go:117] "RemoveContainer" containerID="66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"
Jul 22 16:23:41.246682 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.246665    2580 scope.go:117] "RemoveContainer" containerID="1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"
Jul 22 16:23:41.246933 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:23:41.246900    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f\": container with ID starting with 1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f not found: ID does not exist" containerID="1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"
Jul 22 16:23:41.246976 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.246941    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"} err="failed to get container status \"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f\": rpc error: code = NotFound desc = could not find container \"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f\": container with ID starting with 1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f not found: ID does not exist"
Jul 22 16:23:41.246976 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.246959    2580 scope.go:117] "RemoveContainer" containerID="238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"
Jul 22 16:23:41.247160 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:23:41.247145    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b\": container with ID starting with 238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b not found: ID does not exist" containerID="238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"
Jul 22 16:23:41.247197 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.247163    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"} err="failed to get container status \"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b\": rpc error: code = NotFound desc = could not find container \"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b\": container with ID starting with 238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b not found: ID does not exist"
Jul 22 16:23:41.247197 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.247177    2580 scope.go:117] "RemoveContainer" containerID="845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"
Jul 22 16:23:41.247382 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:23:41.247365    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7\": container with ID starting with 845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7 not found: ID does not exist" containerID="845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"
Jul 22 16:23:41.247421 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.247386    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"} err="failed to get container status \"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7\": rpc error: code = NotFound desc = could not find container \"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7\": container with ID starting with 845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7 not found: ID does not exist"
Jul 22 16:23:41.247421 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.247398    2580 scope.go:117] "RemoveContainer" containerID="fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"
Jul 22 16:23:41.247581 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:23:41.247563    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16\": container with ID starting with fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16 not found: ID does not exist" containerID="fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"
Jul 22 16:23:41.247615 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.247585    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"} err="failed to get container status \"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16\": rpc error: code = NotFound desc = could not find container \"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16\": container with ID starting with fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16 not found: ID does not exist"
Jul 22 16:23:41.247615 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.247597    2580 scope.go:117] "RemoveContainer" containerID="cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"
Jul 22 16:23:41.247763 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:23:41.247746    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab\": container with ID starting with cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab not found: ID does not exist" containerID="cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"
Jul 22 16:23:41.247804 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.247767    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"} err="failed to get container status \"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab\": rpc error: code = NotFound desc = could not find container \"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab\": container with ID starting with cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab not found: ID does not exist"
Jul 22 16:23:41.247804 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.247779    2580 scope.go:117] "RemoveContainer" containerID="eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"
Jul 22 16:23:41.247966 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:23:41.247951    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7\": container with ID starting with eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7 not found: ID does not exist" containerID="eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"
Jul 22 16:23:41.248000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.247968    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"} err="failed to get container status \"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7\": rpc error: code = NotFound desc = could not find container \"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7\": container with ID starting with eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7 not found: ID does not exist"
Jul 22 16:23:41.248000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.247979    2580 scope.go:117] "RemoveContainer" containerID="66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"
Jul 22 16:23:41.248170 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:23:41.248152    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db\": container with ID starting with 66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db not found: ID does not exist" containerID="66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"
Jul 22 16:23:41.248208 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.248177    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"} err="failed to get container status \"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db\": rpc error: code = NotFound desc = could not find container \"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db\": container with ID starting with 66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db not found: ID does not exist"
Jul 22 16:23:41.248208 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.248193    2580 scope.go:117] "RemoveContainer" containerID="1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"
Jul 22 16:23:41.248522 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.248506    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"} err="failed to get container status \"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f\": rpc error: code = NotFound desc = could not find container \"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f\": container with ID starting with 1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f not found: ID does not exist"
Jul 22 16:23:41.248522 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.248522    2580 scope.go:117] "RemoveContainer" containerID="238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"
Jul 22 16:23:41.248760 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.248740    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"} err="failed to get container status \"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b\": rpc error: code = NotFound desc = could not find container \"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b\": container with ID starting with 238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b not found: ID does not exist"
Jul 22 16:23:41.248814 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.248760    2580 scope.go:117] "RemoveContainer" containerID="845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"
Jul 22 16:23:41.248973 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.248934    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"} err="failed to get container status \"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7\": rpc error: code = NotFound desc = could not find container \"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7\": container with ID starting with 845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7 not found: ID does not exist"
Jul 22 16:23:41.249018 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.248973    2580 scope.go:117] "RemoveContainer" containerID="fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"
Jul 22 16:23:41.249272 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.249209    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"} err="failed to get container status \"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16\": rpc error: code = NotFound desc = could not find container \"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16\": container with ID starting with fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16 not found: ID does not exist"
Jul 22 16:23:41.249272 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.249236    2580 scope.go:117] "RemoveContainer" containerID="cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"
Jul 22 16:23:41.249475 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.249452    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"} err="failed to get container status \"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab\": rpc error: code = NotFound desc = could not find container \"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab\": container with ID starting with cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab not found: ID does not exist"
Jul 22 16:23:41.249533 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.249478    2580 scope.go:117] "RemoveContainer" containerID="eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"
Jul 22 16:23:41.249741 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.249704    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"} err="failed to get container status \"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7\": rpc error: code = NotFound desc = could not find container \"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7\": container with ID starting with eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7 not found: ID does not exist"
Jul 22 16:23:41.249820 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.249742    2580 scope.go:117] "RemoveContainer" containerID="66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"
Jul 22 16:23:41.250002 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.249982    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"} err="failed to get container status \"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db\": rpc error: code = NotFound desc = could not find container \"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db\": container with ID starting with 66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db not found: ID does not exist"
Jul 22 16:23:41.250080 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.250014    2580 scope.go:117] "RemoveContainer" containerID="1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"
Jul 22 16:23:41.250264 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.250246    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"} err="failed to get container status \"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f\": rpc error: code = NotFound desc = could not find container \"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f\": container with ID starting with 1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f not found: ID does not exist"
Jul 22 16:23:41.250339 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.250266    2580 scope.go:117] "RemoveContainer" containerID="238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"
Jul 22 16:23:41.250483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.250456    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"} err="failed to get container status \"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b\": rpc error: code = NotFound desc = could not find container \"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b\": container with ID starting with 238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b not found: ID does not exist"
Jul 22 16:23:41.250483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.250482    2580 scope.go:117] "RemoveContainer" containerID="845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"
Jul 22 16:23:41.250727 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.250709    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"} err="failed to get container status \"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7\": rpc error: code = NotFound desc = could not find container \"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7\": container with ID starting with 845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7 not found: ID does not exist"
Jul 22 16:23:41.250795 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.250728    2580 scope.go:117] "RemoveContainer" containerID="fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"
Jul 22 16:23:41.250965 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.250948    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"} err="failed to get container status \"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16\": rpc error: code = NotFound desc = could not find container \"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16\": container with ID starting with fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16 not found: ID does not exist"
Jul 22 16:23:41.250965 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.250964    2580 scope.go:117] "RemoveContainer" containerID="cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"
Jul 22 16:23:41.251165 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.251148    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"} err="failed to get container status \"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab\": rpc error: code = NotFound desc = could not find container \"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab\": container with ID starting with cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab not found: ID does not exist"
Jul 22 16:23:41.251165 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.251172    2580 scope.go:117] "RemoveContainer" containerID="eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"
Jul 22 16:23:41.251392 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.251368    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"} err="failed to get container status \"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7\": rpc error: code = NotFound desc = could not find container \"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7\": container with ID starting with eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7 not found: ID does not exist"
Jul 22 16:23:41.251471 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.251398    2580 scope.go:117] "RemoveContainer" containerID="66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"
Jul 22 16:23:41.251621 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.251605    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"} err="failed to get container status \"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db\": rpc error: code = NotFound desc = could not find container \"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db\": container with ID starting with 66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db not found: ID does not exist"
Jul 22 16:23:41.251661 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.251621    2580 scope.go:117] "RemoveContainer" containerID="1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"
Jul 22 16:23:41.251826 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.251808    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"} err="failed to get container status \"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f\": rpc error: code = NotFound desc = could not find container \"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f\": container with ID starting with 1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f not found: ID does not exist"
Jul 22 16:23:41.251878 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.251826    2580 scope.go:117] "RemoveContainer" containerID="238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"
Jul 22 16:23:41.252014 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.252000    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"} err="failed to get container status \"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b\": rpc error: code = NotFound desc = could not find container \"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b\": container with ID starting with 238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b not found: ID does not exist"
Jul 22 16:23:41.252059 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.252015    2580 scope.go:117] "RemoveContainer" containerID="845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"
Jul 22 16:23:41.252245 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.252206    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"} err="failed to get container status \"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7\": rpc error: code = NotFound desc = could not find container \"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7\": container with ID starting with 845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7 not found: ID does not exist"
Jul 22 16:23:41.252245 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.252232    2580 scope.go:117] "RemoveContainer" containerID="fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"
Jul 22 16:23:41.252438 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.252419    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"} err="failed to get container status \"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16\": rpc error: code = NotFound desc = could not find container \"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16\": container with ID starting with fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16 not found: ID does not exist"
Jul 22 16:23:41.252485 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.252439    2580 scope.go:117] "RemoveContainer" containerID="cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"
Jul 22 16:23:41.252679 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.252664    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"} err="failed to get container status \"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab\": rpc error: code = NotFound desc = could not find container \"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab\": container with ID starting with cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab not found: ID does not exist"
Jul 22 16:23:41.252727 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.252679    2580 scope.go:117] "RemoveContainer" containerID="eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"
Jul 22 16:23:41.252883 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.252866    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"} err="failed to get container status \"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7\": rpc error: code = NotFound desc = could not find container \"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7\": container with ID starting with eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7 not found: ID does not exist"
Jul 22 16:23:41.252919 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.252884    2580 scope.go:117] "RemoveContainer" containerID="66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"
Jul 22 16:23:41.253077 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.253059    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"} err="failed to get container status \"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db\": rpc error: code = NotFound desc = could not find container \"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db\": container with ID starting with 66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db not found: ID does not exist"
Jul 22 16:23:41.253120 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.253077    2580 scope.go:117] "RemoveContainer" containerID="1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"
Jul 22 16:23:41.253282 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.253262    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"} err="failed to get container status \"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f\": rpc error: code = NotFound desc = could not find container \"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f\": container with ID starting with 1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f not found: ID does not exist"
Jul 22 16:23:41.253282 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.253284    2580 scope.go:117] "RemoveContainer" containerID="238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"
Jul 22 16:23:41.253492 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.253476    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"} err="failed to get container status \"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b\": rpc error: code = NotFound desc = could not find container \"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b\": container with ID starting with 238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b not found: ID does not exist"
Jul 22 16:23:41.253492 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.253491    2580 scope.go:117] "RemoveContainer" containerID="845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"
Jul 22 16:23:41.253678 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.253661    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"} err="failed to get container status \"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7\": rpc error: code = NotFound desc = could not find container \"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7\": container with ID starting with 845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7 not found: ID does not exist"
Jul 22 16:23:41.253761 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.253679    2580 scope.go:117] "RemoveContainer" containerID="fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"
Jul 22 16:23:41.253921 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.253902    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"} err="failed to get container status \"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16\": rpc error: code = NotFound desc = could not find container \"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16\": container with ID starting with fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16 not found: ID does not exist"
Jul 22 16:23:41.253963 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.253922    2580 scope.go:117] "RemoveContainer" containerID="cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"
Jul 22 16:23:41.254155 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.254139    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"} err="failed to get container status \"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab\": rpc error: code = NotFound desc = could not find container \"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab\": container with ID starting with cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab not found: ID does not exist"
Jul 22 16:23:41.254245 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.254156    2580 scope.go:117] "RemoveContainer" containerID="eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"
Jul 22 16:23:41.254406 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.254388    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"} err="failed to get container status \"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7\": rpc error: code = NotFound desc = could not find container \"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7\": container with ID starting with eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7 not found: ID does not exist"
Jul 22 16:23:41.254454 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.254406    2580 scope.go:117] "RemoveContainer" containerID="66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"
Jul 22 16:23:41.254607 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.254592    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"} err="failed to get container status \"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db\": rpc error: code = NotFound desc = could not find container \"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db\": container with ID starting with 66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db not found: ID does not exist"
Jul 22 16:23:41.254651 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.254607    2580 scope.go:117] "RemoveContainer" containerID="1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"
Jul 22 16:23:41.254818 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.254802    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f"} err="failed to get container status \"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f\": rpc error: code = NotFound desc = could not find container \"1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f\": container with ID starting with 1e84f8020939ba315c7d684022c8e38af5f51584fe124f002ccee7741fa6f31f not found: ID does not exist"
Jul 22 16:23:41.254854 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.254819    2580 scope.go:117] "RemoveContainer" containerID="238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"
Jul 22 16:23:41.254989 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.254974    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b"} err="failed to get container status \"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b\": rpc error: code = NotFound desc = could not find container \"238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b\": container with ID starting with 238bf160a20c88461bf57babb8452873261fb548b334f52d8a80d6a49065773b not found: ID does not exist"
Jul 22 16:23:41.254989 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.254988    2580 scope.go:117] "RemoveContainer" containerID="845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"
Jul 22 16:23:41.255157 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.255144    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7"} err="failed to get container status \"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7\": rpc error: code = NotFound desc = could not find container \"845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7\": container with ID starting with 845b58af5c72372a08e97d96584e7417fd3fbeb2478372fb58e6ffaca8b38fa7 not found: ID does not exist"
Jul 22 16:23:41.255196 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.255157    2580 scope.go:117] "RemoveContainer" containerID="fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"
Jul 22 16:23:41.255359 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.255340    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16"} err="failed to get container status \"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16\": rpc error: code = NotFound desc = could not find container \"fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16\": container with ID starting with fb4b204109f4cde1fb6cc678f27871dab7ab4d291c29fdd9a86db36f8faa0e16 not found: ID does not exist"
Jul 22 16:23:41.255403 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.255360    2580 scope.go:117] "RemoveContainer" containerID="cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"
Jul 22 16:23:41.255556 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.255538    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab"} err="failed to get container status \"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab\": rpc error: code = NotFound desc = could not find container \"cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab\": container with ID starting with cc48c9dd2a90965bce11fc67b2f05bf877e767dcec309d61a02bf7d7bbc4e8ab not found: ID does not exist"
Jul 22 16:23:41.255606 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.255556    2580 scope.go:117] "RemoveContainer" containerID="eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"
Jul 22 16:23:41.255753 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.255739    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7"} err="failed to get container status \"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7\": rpc error: code = NotFound desc = could not find container \"eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7\": container with ID starting with eabf91cd8ae7003c52aed0a940a5afdee644677941fb331b49310edead5895b7 not found: ID does not exist"
Jul 22 16:23:41.255802 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.255753    2580 scope.go:117] "RemoveContainer" containerID="66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"
Jul 22 16:23:41.255916 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.255901    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db"} err="failed to get container status \"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db\": rpc error: code = NotFound desc = could not find container \"66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db\": container with ID starting with 66d5c647a9086ba6d521d1b455c2af74c98593e052a5c09beb98c091702631db not found: ID does not exist"
Jul 22 16:23:41.309502 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309472    2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-kube-rbac-proxy\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309502 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309500    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309514    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309529    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-db\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309538    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-web-config\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309546    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-tls-assets\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309553    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-metrics-client-ca\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309563    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309570    2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-grpc-tls\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309580    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309588    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309602    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-config-out\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309614    2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309622    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309630    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309639    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309648    2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-config\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309655    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9rhs\" (UniqueName: \"kubernetes.io/projected/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-kube-api-access-b9rhs\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.309689 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.309663    2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b-secret-metrics-client-certs\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:23:41.527981 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.527951    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:23:41.534080 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.534055    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:23:41.572048 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572019    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:23:41.572321 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572309    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="kube-rbac-proxy"
Jul 22 16:23:41.572364 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572323    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="kube-rbac-proxy"
Jul 22 16:23:41.572364 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572334    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="kube-rbac-proxy-thanos"
Jul 22 16:23:41.572364 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572340    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="kube-rbac-proxy-thanos"
Jul 22 16:23:41.572364 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572351    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="init-config-reloader"
Jul 22 16:23:41.572364 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572356    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="init-config-reloader"
Jul 22 16:23:41.572364 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572365    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eaff9fd-f454-49db-9aa6-b52286e34a73" containerName="console"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572371    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eaff9fd-f454-49db-9aa6-b52286e34a73" containerName="console"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572378    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10be6c66-7f28-4c48-b071-f560ca3dbdcd" containerName="registry"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572383    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="10be6c66-7f28-4c48-b071-f560ca3dbdcd" containerName="registry"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572388    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="config-reloader"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572393    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="config-reloader"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572399    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="thanos-sidecar"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572404    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="thanos-sidecar"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572412    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="prometheus"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572418    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="prometheus"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572423    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="kube-rbac-proxy-web"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572428    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="kube-rbac-proxy-web"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572475    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="10be6c66-7f28-4c48-b071-f560ca3dbdcd" containerName="registry"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572481    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="thanos-sidecar"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572487    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="kube-rbac-proxy"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572492    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="kube-rbac-proxy-thanos"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572500    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="kube-rbac-proxy-web"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572505    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="prometheus"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572511    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eaff9fd-f454-49db-9aa6-b52286e34a73" containerName="console"
Jul 22 16:23:41.572531 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.572516    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" containerName="config-reloader"
Jul 22 16:23:41.577719 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.577703    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.585539 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.584610    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 16:23:41.585539 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.584628    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 16:23:41.585539 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.584764    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 16:23:41.585539 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.584821    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 16:23:41.585539 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.584937    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 16:23:41.585539 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.585032    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 16:23:41.585539 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.585109    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-845mkeclkm849\""
Jul 22 16:23:41.585539 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.585192    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 16:23:41.585539 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.585259    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 16:23:41.585539 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.585300    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 16:23:41.585539 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.584766    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 16:23:41.585539 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.584610    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 16:23:41.586386 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.586056    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4kbkt\""
Jul 22 16:23:41.586386 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.586382    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 16:23:41.586637 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.586609    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 16:23:41.595163 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.595142    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 16:23:41.596708 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.596689    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 16:23:41.598841 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.598822    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:23:41.713867 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.713831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.713867 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.713870    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppwpq\" (UniqueName: \"kubernetes.io/projected/c0f759cb-ae1d-469d-b4ca-68fe104088a9-kube-api-access-ppwpq\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714095 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.713888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714095 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.713911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714095 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.713930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714095 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.713945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714095 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.713959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714095 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.713973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714095 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.713990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714095 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.714006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714095 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.714022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714095 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.714041    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714095 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.714056    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0f759cb-ae1d-469d-b4ca-68fe104088a9-config-out\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714583 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.714130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-config\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714583 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.714185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714583 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.714289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714583 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.714334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714583 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.714360    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-web-config\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714583 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.714389    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.714583 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.714419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0f759cb-ae1d-469d-b4ca-68fe104088a9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815217 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0f759cb-ae1d-469d-b4ca-68fe104088a9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815217 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815168    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815460 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppwpq\" (UniqueName: \"kubernetes.io/projected/c0f759cb-ae1d-469d-b4ca-68fe104088a9-kube-api-access-ppwpq\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815460 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815460 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815460 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815460 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815460 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815740 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815740 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815740 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815740 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815740 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815740 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0f759cb-ae1d-469d-b4ca-68fe104088a9-config-out\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815740 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-config\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.815740 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.816097 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.816097 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.816097 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-web-config\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.816097 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.816097 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.815996    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.816353 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.816325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.816589 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.816563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.817300 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.817275    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.818408 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.818375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.818510 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.818445    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.818510 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.818500    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.819494 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.819003    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-config\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.819494 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.819068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0f759cb-ae1d-469d-b4ca-68fe104088a9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.819494 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.819103    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.819494 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.819105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.819494 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.819424    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.819494 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.819441    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.819835 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.819606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c0f759cb-ae1d-469d-b4ca-68fe104088a9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.819889 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.819868    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.820776 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.820754    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.820874 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.820853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0f759cb-ae1d-469d-b4ca-68fe104088a9-config-out\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.821040 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.821022    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.821394 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.821375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0f759cb-ae1d-469d-b4ca-68fe104088a9-web-config\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.826048 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.826031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppwpq\" (UniqueName: \"kubernetes.io/projected/c0f759cb-ae1d-469d-b4ca-68fe104088a9-kube-api-access-ppwpq\") pod \"prometheus-k8s-0\" (UID: \"c0f759cb-ae1d-469d-b4ca-68fe104088a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:41.888817 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:41.888788    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:23:42.036023 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:42.035991    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 16:23:42.038410 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:23:42.038382    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f759cb_ae1d_469d_b4ca_68fe104088a9.slice/crio-11131761a1f33a0f90f20e4c6755ac83b05b1b466496d8dadc8e0b9886b7d556 WatchSource:0}: Error finding container 11131761a1f33a0f90f20e4c6755ac83b05b1b466496d8dadc8e0b9886b7d556: Status 404 returned error can't find the container with id 11131761a1f33a0f90f20e4c6755ac83b05b1b466496d8dadc8e0b9886b7d556
Jul 22 16:23:42.199083 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:42.199054    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0f759cb-ae1d-469d-b4ca-68fe104088a9" containerID="bb8e92ec590ed46391c324bc095d5305e5bdcb4849360a6d593f133c118e6289" exitCode=0
Jul 22 16:23:42.199210 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:42.199144    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0f759cb-ae1d-469d-b4ca-68fe104088a9","Type":"ContainerDied","Data":"bb8e92ec590ed46391c324bc095d5305e5bdcb4849360a6d593f133c118e6289"}
Jul 22 16:23:42.199304 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:42.199252    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0f759cb-ae1d-469d-b4ca-68fe104088a9","Type":"ContainerStarted","Data":"11131761a1f33a0f90f20e4c6755ac83b05b1b466496d8dadc8e0b9886b7d556"}
Jul 22 16:23:42.416209 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:42.415456    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b" path="/var/lib/kubelet/pods/3094cf48-3c6c-4cd6-a5c5-66b68e93ee7b/volumes"
Jul 22 16:23:43.207001 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:43.206967    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0f759cb-ae1d-469d-b4ca-68fe104088a9","Type":"ContainerStarted","Data":"6383b483650f24c184013ca90a4647d5f781be7071a1ce95dc2584d94d2b440f"}
Jul 22 16:23:43.207453 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:43.207077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0f759cb-ae1d-469d-b4ca-68fe104088a9","Type":"ContainerStarted","Data":"bac1121c89449a109d12d4f1759d96be94661e6b03351634a5b3b06e4fc6d3d4"}
Jul 22 16:23:43.207453 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:43.207123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0f759cb-ae1d-469d-b4ca-68fe104088a9","Type":"ContainerStarted","Data":"2ba238c203cc1ca728c4a9c821eaa13d8a337ba30e32739af5c5d4565ce284fe"}
Jul 22 16:23:43.207453 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:43.207164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0f759cb-ae1d-469d-b4ca-68fe104088a9","Type":"ContainerStarted","Data":"0f4250cb2db0a80ca44e5209a6d65f6ed1f0e8a9f113e3c8ea574440b0b82eb6"}
Jul 22 16:23:43.207453 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:43.207199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0f759cb-ae1d-469d-b4ca-68fe104088a9","Type":"ContainerStarted","Data":"2f31ccccdb86cdd2e2f14b66f80d83450c1a769519088ba213b6fb0204a04bc4"}
Jul 22 16:23:43.207453 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:43.207253    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0f759cb-ae1d-469d-b4ca-68fe104088a9","Type":"ContainerStarted","Data":"4ce27107c051d060a63d9cabdeb654225efcdccded222722342f196900b1b38c"}
Jul 22 16:23:43.242058 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:43.242003    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.223062895 podStartE2EDuration="2.241984615s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.92172ms" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:43.240795119 +0000 UTC m=+189.432998449" watchObservedRunningTime="2026-07-22 16:23:43.241984615 +0000 UTC m=+189.434187932"
Jul 22 16:23:46.889264 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:23:46.889212    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:41.890352 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:24:41.890316    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:41.905143 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:24:41.905120    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:24:42.439311 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:24:42.439286    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 16:25:34.145092 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:25:34.145061    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:25:34.147818 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:25:34.147794    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:25:34.153844 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:25:34.153825    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 16:27:15.137724 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.137686    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lnbm8"]
Jul 22 16:27:15.140718 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.140703    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lnbm8"
Jul 22 16:27:15.143000 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.142979    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 22 16:27:15.143813 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.143799    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 22 16:27:15.143871 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.143808    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5t4f2\""
Jul 22 16:27:15.149762 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.149741    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lnbm8"]
Jul 22 16:27:15.235443 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.235413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lnbm8\" (UID: \"0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lnbm8"
Jul 22 16:27:15.235580 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.235496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ljtr\" (UniqueName: \"kubernetes.io/projected/0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b-kube-api-access-7ljtr\") pod \"cert-manager-webhook-6486ffd997-lnbm8\" (UID: \"0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lnbm8"
Jul 22 16:27:15.336160 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.336121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lnbm8\" (UID: \"0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lnbm8"
Jul 22 16:27:15.336305 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.336182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ljtr\" (UniqueName: \"kubernetes.io/projected/0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b-kube-api-access-7ljtr\") pod \"cert-manager-webhook-6486ffd997-lnbm8\" (UID: \"0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lnbm8"
Jul 22 16:27:15.355377 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.355359    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lnbm8\" (UID: \"0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lnbm8"
Jul 22 16:27:15.355529 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.355512    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ljtr\" (UniqueName: \"kubernetes.io/projected/0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b-kube-api-access-7ljtr\") pod \"cert-manager-webhook-6486ffd997-lnbm8\" (UID: \"0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lnbm8"
Jul 22 16:27:15.458998 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.458891    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lnbm8"
Jul 22 16:27:15.581475 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.581409    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lnbm8"]
Jul 22 16:27:15.583672 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:27:15.583647    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0079ba6b_ca62_4300_b5ce_c53e2ddb3a1b.slice/crio-f4346da1cd1573a3430598c75814afcd4e5162a1b5426d2fb7d1e52f9cc13dc6 WatchSource:0}: Error finding container f4346da1cd1573a3430598c75814afcd4e5162a1b5426d2fb7d1e52f9cc13dc6: Status 404 returned error can't find the container with id f4346da1cd1573a3430598c75814afcd4e5162a1b5426d2fb7d1e52f9cc13dc6
Jul 22 16:27:15.585509 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.585488    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 16:27:15.978603 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:15.978569    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lnbm8" event={"ID":"0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b","Type":"ContainerStarted","Data":"f4346da1cd1573a3430598c75814afcd4e5162a1b5426d2fb7d1e52f9cc13dc6"}
Jul 22 16:27:18.992462 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:18.992427    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lnbm8" event={"ID":"0079ba6b-ca62-4300-b5ce-c53e2ddb3a1b","Type":"ContainerStarted","Data":"7d8c889eb11b761afcc5e7e1f7201bb9ebf1798a0d387e9ee690ac0a6c3d07bb"}
Jul 22 16:27:18.992921 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:18.992550    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lnbm8"
Jul 22 16:27:19.010555 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:19.010508    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lnbm8" podStartSLOduration=0.804926804 podStartE2EDuration="4.010495178s" totalImagesPullingTime="3.205568374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:27:19.00958959 +0000 UTC m=+405.201792914" watchObservedRunningTime="2026-07-22 16:27:19.010495178 +0000 UTC m=+405.202698495"
Jul 22 16:27:25.002941 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:25.002908    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lnbm8"
Jul 22 16:27:47.703745 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.703703    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"]
Jul 22 16:27:47.707048 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.707030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.709767 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.709744    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 16:27:47.709871 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.709795    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mxznl\""
Jul 22 16:27:47.709928 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.709806    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 16:27:47.710030 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.710015    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 16:27:47.710084 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.710053    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 16:27:47.725274 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.725250    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"]
Jul 22 16:27:47.790346 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.790317    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c3fb72a-404b-41a7-b8b2-bec416ea307e-manifests\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.790466 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.790348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxhzk\" (UniqueName: \"kubernetes.io/projected/7c3fb72a-404b-41a7-b8b2-bec416ea307e-kube-api-access-bxhzk\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.790466 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.790449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c3fb72a-404b-41a7-b8b2-bec416ea307e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.790535 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.790494    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c3fb72a-404b-41a7-b8b2-bec416ea307e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.790535 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.790510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c3fb72a-404b-41a7-b8b2-bec416ea307e-tmp\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.891403 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.891368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c3fb72a-404b-41a7-b8b2-bec416ea307e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.891403 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.891408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c3fb72a-404b-41a7-b8b2-bec416ea307e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.891639 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.891424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c3fb72a-404b-41a7-b8b2-bec416ea307e-tmp\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.891639 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.891451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c3fb72a-404b-41a7-b8b2-bec416ea307e-manifests\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.891639 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.891467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxhzk\" (UniqueName: \"kubernetes.io/projected/7c3fb72a-404b-41a7-b8b2-bec416ea307e-kube-api-access-bxhzk\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.891894 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.891872    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c3fb72a-404b-41a7-b8b2-bec416ea307e-manifests\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.893721 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.893692    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c3fb72a-404b-41a7-b8b2-bec416ea307e-tmp\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.893811 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.893761    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c3fb72a-404b-41a7-b8b2-bec416ea307e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.893811 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.893797    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c3fb72a-404b-41a7-b8b2-bec416ea307e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:47.899931 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:47.899912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxhzk\" (UniqueName: \"kubernetes.io/projected/7c3fb72a-404b-41a7-b8b2-bec416ea307e-kube-api-access-bxhzk\") pod \"opendatahub-operator-controller-manager-6cb6494f8-ckzld\" (UID: \"7c3fb72a-404b-41a7-b8b2-bec416ea307e\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:48.017013 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:48.016947    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:27:48.155934 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:48.155912    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"]
Jul 22 16:27:48.158238 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:27:48.158199    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3fb72a_404b_41a7_b8b2_bec416ea307e.slice/crio-b74365f36acffa36a71ec1dd620c67934486d5453fb9b89ec04f1776a3bb5c52 WatchSource:0}: Error finding container b74365f36acffa36a71ec1dd620c67934486d5453fb9b89ec04f1776a3bb5c52: Status 404 returned error can't find the container with id b74365f36acffa36a71ec1dd620c67934486d5453fb9b89ec04f1776a3bb5c52
Jul 22 16:27:49.114039 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:49.114000    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld" event={"ID":"7c3fb72a-404b-41a7-b8b2-bec416ea307e","Type":"ContainerStarted","Data":"b74365f36acffa36a71ec1dd620c67934486d5453fb9b89ec04f1776a3bb5c52"}
Jul 22 16:27:52.128410 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:52.128375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld" event={"ID":"7c3fb72a-404b-41a7-b8b2-bec416ea307e","Type":"ContainerStarted","Data":"2838ba00f3b4edb13fd0730037eb7adafdf7d808b3d9e24c1703052faeacda2b"}
Jul 22 16:27:53.133291 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:53.133258    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c3fb72a-404b-41a7-b8b2-bec416ea307e" containerID="2838ba00f3b4edb13fd0730037eb7adafdf7d808b3d9e24c1703052faeacda2b" exitCode=0
Jul 22 16:27:53.133677 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:53.133341    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld" event={"ID":"7c3fb72a-404b-41a7-b8b2-bec416ea307e","Type":"ContainerDied","Data":"2838ba00f3b4edb13fd0730037eb7adafdf7d808b3d9e24c1703052faeacda2b"}
Jul 22 16:27:54.139479 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:54.139444    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld" event={"ID":"7c3fb72a-404b-41a7-b8b2-bec416ea307e","Type":"ContainerStarted","Data":"638eea5cba4f633a7a9120f33b40a4e5c172a8bb8d728ebaf3ce3fe59d49c33e"}
Jul 22 16:27:54.139839 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:27:54.139572    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:28:04.966410 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:04.966302    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld" podStartSLOduration=13.642804584 podStartE2EDuration="17.966262952s" totalImagesPullingTime="3.234555468s" totalInitContainerRuntime="1.0889029s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:27:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:27:54.164010921 +0000 UTC m=+440.356214238" watchObservedRunningTime="2026-07-22 16:28:04.966262952 +0000 UTC m=+451.158466271"
Jul 22 16:28:04.967249 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:04.967214    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"]
Jul 22 16:28:04.970609 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:04.970591    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:04.972907 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:04.972883    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 16:28:04.974449 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:04.974425    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cz4dk\""
Jul 22 16:28:04.974449 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:04.974443    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 16:28:04.974583 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:04.974430    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 16:28:04.974583 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:04.974485    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 16:28:04.974583 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:04.974547    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 16:28:04.978904 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:04.978883    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"]
Jul 22 16:28:05.021734 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.021698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a89bf05-77d1-46fc-8981-94dc65365989-cert\") pod \"lws-controller-manager-66c589788b-22fhh\" (UID: \"2a89bf05-77d1-46fc-8981-94dc65365989\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:05.021894 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.021745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2a89bf05-77d1-46fc-8981-94dc65365989-manager-config\") pod \"lws-controller-manager-66c589788b-22fhh\" (UID: \"2a89bf05-77d1-46fc-8981-94dc65365989\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:05.021894 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.021769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs5dr\" (UniqueName: \"kubernetes.io/projected/2a89bf05-77d1-46fc-8981-94dc65365989-kube-api-access-qs5dr\") pod \"lws-controller-manager-66c589788b-22fhh\" (UID: \"2a89bf05-77d1-46fc-8981-94dc65365989\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:05.021894 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.021864    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a89bf05-77d1-46fc-8981-94dc65365989-metrics-cert\") pod \"lws-controller-manager-66c589788b-22fhh\" (UID: \"2a89bf05-77d1-46fc-8981-94dc65365989\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:05.123319 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.123278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a89bf05-77d1-46fc-8981-94dc65365989-metrics-cert\") pod \"lws-controller-manager-66c589788b-22fhh\" (UID: \"2a89bf05-77d1-46fc-8981-94dc65365989\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:05.123489 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.123331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a89bf05-77d1-46fc-8981-94dc65365989-cert\") pod \"lws-controller-manager-66c589788b-22fhh\" (UID: \"2a89bf05-77d1-46fc-8981-94dc65365989\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:05.123489 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.123365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2a89bf05-77d1-46fc-8981-94dc65365989-manager-config\") pod \"lws-controller-manager-66c589788b-22fhh\" (UID: \"2a89bf05-77d1-46fc-8981-94dc65365989\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:05.123489 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.123386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs5dr\" (UniqueName: \"kubernetes.io/projected/2a89bf05-77d1-46fc-8981-94dc65365989-kube-api-access-qs5dr\") pod \"lws-controller-manager-66c589788b-22fhh\" (UID: \"2a89bf05-77d1-46fc-8981-94dc65365989\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:05.124086 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.124061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2a89bf05-77d1-46fc-8981-94dc65365989-manager-config\") pod \"lws-controller-manager-66c589788b-22fhh\" (UID: \"2a89bf05-77d1-46fc-8981-94dc65365989\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:05.125750 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.125723    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a89bf05-77d1-46fc-8981-94dc65365989-metrics-cert\") pod \"lws-controller-manager-66c589788b-22fhh\" (UID: \"2a89bf05-77d1-46fc-8981-94dc65365989\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:05.125835 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.125771    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a89bf05-77d1-46fc-8981-94dc65365989-cert\") pod \"lws-controller-manager-66c589788b-22fhh\" (UID: \"2a89bf05-77d1-46fc-8981-94dc65365989\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:05.132998 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.132977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs5dr\" (UniqueName: \"kubernetes.io/projected/2a89bf05-77d1-46fc-8981-94dc65365989-kube-api-access-qs5dr\") pod \"lws-controller-manager-66c589788b-22fhh\" (UID: \"2a89bf05-77d1-46fc-8981-94dc65365989\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:05.145351 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.145329    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-ckzld"
Jul 22 16:28:05.280906 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.280818    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:05.424726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:05.424687    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"]
Jul 22 16:28:05.429331 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:28:05.429288    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a89bf05_77d1_46fc_8981_94dc65365989.slice/crio-88239828324fe4ea593264a021dae43a9dc3603a8f81d262c337353286ea3c8c WatchSource:0}: Error finding container 88239828324fe4ea593264a021dae43a9dc3603a8f81d262c337353286ea3c8c: Status 404 returned error can't find the container with id 88239828324fe4ea593264a021dae43a9dc3603a8f81d262c337353286ea3c8c
Jul 22 16:28:06.189609 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:06.189565    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh" event={"ID":"2a89bf05-77d1-46fc-8981-94dc65365989","Type":"ContainerStarted","Data":"88239828324fe4ea593264a021dae43a9dc3603a8f81d262c337353286ea3c8c"}
Jul 22 16:28:07.498672 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.498636    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-788547964b-pn7d7"]
Jul 22 16:28:07.502549 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.502523    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7"
Jul 22 16:28:07.505157 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.505133    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-csw7k\""
Jul 22 16:28:07.506082 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.506057    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 16:28:07.506082 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.506075    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 16:28:07.506309 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.506093    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 16:28:07.506309 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.506258    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 16:28:07.517592 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.517573    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-788547964b-pn7d7"]
Jul 22 16:28:07.647380 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.647339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eac28e04-a397-4df2-8d39-1a1c95d2413d-tmp\") pod \"kube-auth-proxy-788547964b-pn7d7\" (UID: \"eac28e04-a397-4df2-8d39-1a1c95d2413d\") " pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7"
Jul 22 16:28:07.647553 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.647386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bdht\" (UniqueName: \"kubernetes.io/projected/eac28e04-a397-4df2-8d39-1a1c95d2413d-kube-api-access-2bdht\") pod \"kube-auth-proxy-788547964b-pn7d7\" (UID: \"eac28e04-a397-4df2-8d39-1a1c95d2413d\") " pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7"
Jul 22 16:28:07.647553 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.647449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eac28e04-a397-4df2-8d39-1a1c95d2413d-tls-certs\") pod \"kube-auth-proxy-788547964b-pn7d7\" (UID: \"eac28e04-a397-4df2-8d39-1a1c95d2413d\") " pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7"
Jul 22 16:28:07.748394 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.748352    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eac28e04-a397-4df2-8d39-1a1c95d2413d-tmp\") pod \"kube-auth-proxy-788547964b-pn7d7\" (UID: \"eac28e04-a397-4df2-8d39-1a1c95d2413d\") " pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7"
Jul 22 16:28:07.748394 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.748392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bdht\" (UniqueName: \"kubernetes.io/projected/eac28e04-a397-4df2-8d39-1a1c95d2413d-kube-api-access-2bdht\") pod \"kube-auth-proxy-788547964b-pn7d7\" (UID: \"eac28e04-a397-4df2-8d39-1a1c95d2413d\") " pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7"
Jul 22 16:28:07.748604 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.748531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eac28e04-a397-4df2-8d39-1a1c95d2413d-tls-certs\") pod \"kube-auth-proxy-788547964b-pn7d7\" (UID: \"eac28e04-a397-4df2-8d39-1a1c95d2413d\") " pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7"
Jul 22 16:28:07.750645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.750579    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eac28e04-a397-4df2-8d39-1a1c95d2413d-tmp\") pod \"kube-auth-proxy-788547964b-pn7d7\" (UID: \"eac28e04-a397-4df2-8d39-1a1c95d2413d\") " pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7"
Jul 22 16:28:07.750927 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.750909    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eac28e04-a397-4df2-8d39-1a1c95d2413d-tls-certs\") pod \"kube-auth-proxy-788547964b-pn7d7\" (UID: \"eac28e04-a397-4df2-8d39-1a1c95d2413d\") " pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7"
Jul 22 16:28:07.756631 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.756608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bdht\" (UniqueName: \"kubernetes.io/projected/eac28e04-a397-4df2-8d39-1a1c95d2413d-kube-api-access-2bdht\") pod \"kube-auth-proxy-788547964b-pn7d7\" (UID: \"eac28e04-a397-4df2-8d39-1a1c95d2413d\") " pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7"
Jul 22 16:28:07.815502 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.815476    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7"
Jul 22 16:28:07.956361 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:07.956335    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-788547964b-pn7d7"]
Jul 22 16:28:07.958574 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:28:07.958546    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeac28e04_a397_4df2_8d39_1a1c95d2413d.slice/crio-e66a49b5a0d39dcba347c6ac1138b39e7e4e892e945492375cb4cfa28ceda16e WatchSource:0}: Error finding container e66a49b5a0d39dcba347c6ac1138b39e7e4e892e945492375cb4cfa28ceda16e: Status 404 returned error can't find the container with id e66a49b5a0d39dcba347c6ac1138b39e7e4e892e945492375cb4cfa28ceda16e
Jul 22 16:28:08.199767 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:08.199732    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh" event={"ID":"2a89bf05-77d1-46fc-8981-94dc65365989","Type":"ContainerStarted","Data":"bf386f4dd40c73a3ffe5bf36183e3b5ac949c5c454f4cdf7b7b9d1ad30674e6e"}
Jul 22 16:28:08.199944 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:08.199831    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:28:08.200855 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:08.200835    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7" event={"ID":"eac28e04-a397-4df2-8d39-1a1c95d2413d","Type":"ContainerStarted","Data":"e66a49b5a0d39dcba347c6ac1138b39e7e4e892e945492375cb4cfa28ceda16e"}
Jul 22 16:28:08.228846 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:08.228802    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh" podStartSLOduration=1.907189034 podStartE2EDuration="4.228788196s" totalImagesPullingTime="2.321599162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:28:08.227964842 +0000 UTC m=+454.420168160" watchObservedRunningTime="2026-07-22 16:28:08.228788196 +0000 UTC m=+454.420991513"
Jul 22 16:28:11.214988 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:11.214898    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7" event={"ID":"eac28e04-a397-4df2-8d39-1a1c95d2413d","Type":"ContainerStarted","Data":"7d1e74e4f550d397df257a205eef0197e585194a53abeb8a88589e12b113e598"}
Jul 22 16:28:11.234845 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:11.234790    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-788547964b-pn7d7" podStartSLOduration=1.282842083 podStartE2EDuration="4.23477124s" totalImagesPullingTime="2.951929157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:28:11.234397235 +0000 UTC m=+457.426600554" watchObservedRunningTime="2026-07-22 16:28:11.23477124 +0000 UTC m=+457.426974558"
Jul 22 16:28:19.208014 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:28:19.207982    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66c589788b-22fhh"
Jul 22 16:29:44.868754 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:44.868716    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmg7t"]
Jul 22 16:29:44.872068 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:44.872045    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmg7t"
Jul 22 16:29:44.874312 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:44.874291    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 22 16:29:44.874418 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:44.874331    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 16:29:44.874418 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:44.874342    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 16:29:44.875160 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:44.875142    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-28q4g\""
Jul 22 16:29:44.884380 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:44.884358    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmg7t"]
Jul 22 16:29:44.937061 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:44.937025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcgkf\" (UniqueName: \"kubernetes.io/projected/79820e13-5f21-4e1c-adf5-b9d18914a15c-kube-api-access-zcgkf\") pod \"dns-operator-controller-manager-864dd78c4c-tmg7t\" (UID: \"79820e13-5f21-4e1c-adf5-b9d18914a15c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmg7t"
Jul 22 16:29:45.038198 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.038167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcgkf\" (UniqueName: \"kubernetes.io/projected/79820e13-5f21-4e1c-adf5-b9d18914a15c-kube-api-access-zcgkf\") pod \"dns-operator-controller-manager-864dd78c4c-tmg7t\" (UID: \"79820e13-5f21-4e1c-adf5-b9d18914a15c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmg7t"
Jul 22 16:29:45.047061 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.047019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcgkf\" (UniqueName: \"kubernetes.io/projected/79820e13-5f21-4e1c-adf5-b9d18914a15c-kube-api-access-zcgkf\") pod \"dns-operator-controller-manager-864dd78c4c-tmg7t\" (UID: \"79820e13-5f21-4e1c-adf5-b9d18914a15c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmg7t"
Jul 22 16:29:45.181822 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.181721    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmg7t"
Jul 22 16:29:45.310641 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.310609    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmg7t"]
Jul 22 16:29:45.312863 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:29:45.312835    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79820e13_5f21_4e1c_adf5_b9d18914a15c.slice/crio-d7c603f62698fab7c43d72afa70fd712cb91637a448223633c13577aa5fd9491 WatchSource:0}: Error finding container d7c603f62698fab7c43d72afa70fd712cb91637a448223633c13577aa5fd9491: Status 404 returned error can't find the container with id d7c603f62698fab7c43d72afa70fd712cb91637a448223633c13577aa5fd9491
Jul 22 16:29:45.588963 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.588888    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmg7t" event={"ID":"79820e13-5f21-4e1c-adf5-b9d18914a15c","Type":"ContainerStarted","Data":"d7c603f62698fab7c43d72afa70fd712cb91637a448223633c13577aa5fd9491"}
Jul 22 16:29:45.692809 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.692779    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"]
Jul 22 16:29:45.697285 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.697262    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"
Jul 22 16:29:45.700523 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.700502    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 22 16:29:45.700766 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.700752    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l6x57\""
Jul 22 16:29:45.701169 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.701150    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 22 16:29:45.707140 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.707121    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"]
Jul 22 16:29:45.743546 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.743526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz4z7\" (UniqueName: \"kubernetes.io/projected/9019f343-cf47-45f1-9690-98a0f033a951-kube-api-access-fz4z7\") pod \"kuadrant-console-plugin-66b5774985-pxwrz\" (UID: \"9019f343-cf47-45f1-9690-98a0f033a951\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"
Jul 22 16:29:45.743647 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.743588    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9019f343-cf47-45f1-9690-98a0f033a951-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pxwrz\" (UID: \"9019f343-cf47-45f1-9690-98a0f033a951\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"
Jul 22 16:29:45.743647 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.743622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9019f343-cf47-45f1-9690-98a0f033a951-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pxwrz\" (UID: \"9019f343-cf47-45f1-9690-98a0f033a951\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"
Jul 22 16:29:45.844546 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.844527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9019f343-cf47-45f1-9690-98a0f033a951-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pxwrz\" (UID: \"9019f343-cf47-45f1-9690-98a0f033a951\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"
Jul 22 16:29:45.844546 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.844555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9019f343-cf47-45f1-9690-98a0f033a951-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pxwrz\" (UID: \"9019f343-cf47-45f1-9690-98a0f033a951\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"
Jul 22 16:29:45.844726 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:29:45.844633    2580 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 22 16:29:45.844726 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.844640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz4z7\" (UniqueName: \"kubernetes.io/projected/9019f343-cf47-45f1-9690-98a0f033a951-kube-api-access-fz4z7\") pod \"kuadrant-console-plugin-66b5774985-pxwrz\" (UID: \"9019f343-cf47-45f1-9690-98a0f033a951\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"
Jul 22 16:29:45.844726 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:29:45.844688    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9019f343-cf47-45f1-9690-98a0f033a951-plugin-serving-cert podName:9019f343-cf47-45f1-9690-98a0f033a951 nodeName:}" failed. No retries permitted until 2026-07-22 16:29:46.344666086 +0000 UTC m=+552.536869396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/9019f343-cf47-45f1-9690-98a0f033a951-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-pxwrz" (UID: "9019f343-cf47-45f1-9690-98a0f033a951") : secret "plugin-serving-cert" not found
Jul 22 16:29:45.845104 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.845086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9019f343-cf47-45f1-9690-98a0f033a951-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pxwrz\" (UID: \"9019f343-cf47-45f1-9690-98a0f033a951\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"
Jul 22 16:29:45.858010 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:45.857988    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz4z7\" (UniqueName: \"kubernetes.io/projected/9019f343-cf47-45f1-9690-98a0f033a951-kube-api-access-fz4z7\") pod \"kuadrant-console-plugin-66b5774985-pxwrz\" (UID: \"9019f343-cf47-45f1-9690-98a0f033a951\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"
Jul 22 16:29:46.349207 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:46.349174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9019f343-cf47-45f1-9690-98a0f033a951-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pxwrz\" (UID: \"9019f343-cf47-45f1-9690-98a0f033a951\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"
Jul 22 16:29:46.352418 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:46.352391    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9019f343-cf47-45f1-9690-98a0f033a951-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pxwrz\" (UID: \"9019f343-cf47-45f1-9690-98a0f033a951\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"
Jul 22 16:29:46.606825 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:46.606756    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"
Jul 22 16:29:46.737098 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:46.737065    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz"]
Jul 22 16:29:46.739324 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:29:46.739291    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9019f343_cf47_45f1_9690_98a0f033a951.slice/crio-e5cf02cbee837a5eb3a9e677780569cd12bef06ab79985aaf516fea19043683c WatchSource:0}: Error finding container e5cf02cbee837a5eb3a9e677780569cd12bef06ab79985aaf516fea19043683c: Status 404 returned error can't find the container with id e5cf02cbee837a5eb3a9e677780569cd12bef06ab79985aaf516fea19043683c
Jul 22 16:29:47.597127 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:47.597092    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz" event={"ID":"9019f343-cf47-45f1-9690-98a0f033a951","Type":"ContainerStarted","Data":"e5cf02cbee837a5eb3a9e677780569cd12bef06ab79985aaf516fea19043683c"}
Jul 22 16:29:48.604827 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:48.604781    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmg7t" event={"ID":"79820e13-5f21-4e1c-adf5-b9d18914a15c","Type":"ContainerStarted","Data":"fff90bc7c1c7bf33235263805301567a6b12f0bf3931cf849bd4e1630a4aa55a"}
Jul 22 16:29:48.605345 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:48.605107    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmg7t"
Jul 22 16:29:48.626385 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:48.626311    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmg7t" podStartSLOduration=2.398020603 podStartE2EDuration="4.626293889s" totalImagesPullingTime="2.228273286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:29:48.625114488 +0000 UTC m=+554.817317827" watchObservedRunningTime="2026-07-22 16:29:48.626293889 +0000 UTC m=+554.818497206"
Jul 22 16:29:59.612895 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:29:59.612859    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmg7t"
Jul 22 16:30:07.700349 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:07.700312    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz" event={"ID":"9019f343-cf47-45f1-9690-98a0f033a951","Type":"ContainerStarted","Data":"b7ca43a6b8dc1c9100bbfb845e7046ef42e6a9c14e38b4a66a7ef3b183014ef6"}
Jul 22 16:30:07.722045 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:07.721993    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pxwrz" podStartSLOduration=2.141269368 podStartE2EDuration="22.721974212s" totalImagesPullingTime="20.580704844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:30:07.720452567 +0000 UTC m=+573.912655885" watchObservedRunningTime="2026-07-22 16:30:07.721974212 +0000 UTC m=+573.914177530"
Jul 22 16:30:29.104148 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.104110    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:30:29.120864 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.120831    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:30:29.121032 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.120941    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lxchf"
Jul 22 16:30:29.123463 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.123440    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 16:30:29.144525 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.144495    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:30:29.224768 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.224731    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g75x\" (UniqueName: \"kubernetes.io/projected/026a5e34-7776-4992-84f9-6eb7ad063e63-kube-api-access-8g75x\") pod \"limitador-limitador-54d6d988d5-lxchf\" (UID: \"026a5e34-7776-4992-84f9-6eb7ad063e63\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lxchf"
Jul 22 16:30:29.224768 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.224773    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/026a5e34-7776-4992-84f9-6eb7ad063e63-config-file\") pod \"limitador-limitador-54d6d988d5-lxchf\" (UID: \"026a5e34-7776-4992-84f9-6eb7ad063e63\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lxchf"
Jul 22 16:30:29.326153 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.326115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g75x\" (UniqueName: \"kubernetes.io/projected/026a5e34-7776-4992-84f9-6eb7ad063e63-kube-api-access-8g75x\") pod \"limitador-limitador-54d6d988d5-lxchf\" (UID: \"026a5e34-7776-4992-84f9-6eb7ad063e63\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lxchf"
Jul 22 16:30:29.326153 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.326159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/026a5e34-7776-4992-84f9-6eb7ad063e63-config-file\") pod \"limitador-limitador-54d6d988d5-lxchf\" (UID: \"026a5e34-7776-4992-84f9-6eb7ad063e63\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lxchf"
Jul 22 16:30:29.326780 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.326755    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/026a5e34-7776-4992-84f9-6eb7ad063e63-config-file\") pod \"limitador-limitador-54d6d988d5-lxchf\" (UID: \"026a5e34-7776-4992-84f9-6eb7ad063e63\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lxchf"
Jul 22 16:30:29.336915 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.336893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g75x\" (UniqueName: \"kubernetes.io/projected/026a5e34-7776-4992-84f9-6eb7ad063e63-kube-api-access-8g75x\") pod \"limitador-limitador-54d6d988d5-lxchf\" (UID: \"026a5e34-7776-4992-84f9-6eb7ad063e63\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lxchf"
Jul 22 16:30:29.431367 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.431285    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lxchf"
Jul 22 16:30:29.592535 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.592462    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:30:29.594700 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:30:29.594671    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod026a5e34_7776_4992_84f9_6eb7ad063e63.slice/crio-97823e4c656b3f6f6a07777ea39800527905a3c28271f08a12d9e6b797cdce9b WatchSource:0}: Error finding container 97823e4c656b3f6f6a07777ea39800527905a3c28271f08a12d9e6b797cdce9b: Status 404 returned error can't find the container with id 97823e4c656b3f6f6a07777ea39800527905a3c28271f08a12d9e6b797cdce9b
Jul 22 16:30:29.794369 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.794297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lxchf" event={"ID":"026a5e34-7776-4992-84f9-6eb7ad063e63","Type":"ContainerStarted","Data":"97823e4c656b3f6f6a07777ea39800527905a3c28271f08a12d9e6b797cdce9b"}
Jul 22 16:30:29.886615 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.886578    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-2c2bc"]
Jul 22 16:30:29.912097 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.912073    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2c2bc"]
Jul 22 16:30:29.912231 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.912151    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2c2bc"
Jul 22 16:30:29.914163 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:29.914137    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tfq9z\""
Jul 22 16:30:30.034215 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:30.034184    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5hwj\" (UniqueName: \"kubernetes.io/projected/2d6fb80d-4d13-4db4-a26f-1487819e17e9-kube-api-access-r5hwj\") pod \"authorino-75d556bd77-2c2bc\" (UID: \"2d6fb80d-4d13-4db4-a26f-1487819e17e9\") " pod="kuadrant-system/authorino-75d556bd77-2c2bc"
Jul 22 16:30:30.135434 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:30.135400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5hwj\" (UniqueName: \"kubernetes.io/projected/2d6fb80d-4d13-4db4-a26f-1487819e17e9-kube-api-access-r5hwj\") pod \"authorino-75d556bd77-2c2bc\" (UID: \"2d6fb80d-4d13-4db4-a26f-1487819e17e9\") " pod="kuadrant-system/authorino-75d556bd77-2c2bc"
Jul 22 16:30:30.145517 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:30.145478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5hwj\" (UniqueName: \"kubernetes.io/projected/2d6fb80d-4d13-4db4-a26f-1487819e17e9-kube-api-access-r5hwj\") pod \"authorino-75d556bd77-2c2bc\" (UID: \"2d6fb80d-4d13-4db4-a26f-1487819e17e9\") " pod="kuadrant-system/authorino-75d556bd77-2c2bc"
Jul 22 16:30:30.221186 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:30.221146    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2c2bc"
Jul 22 16:30:30.378365 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:30.378282    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2c2bc"]
Jul 22 16:30:30.381234 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:30:30.381190    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d6fb80d_4d13_4db4_a26f_1487819e17e9.slice/crio-a3d79ecbb681f3f7d8647ce353c8a61821329ded4e4c9c6e64611e65f5b88b92 WatchSource:0}: Error finding container a3d79ecbb681f3f7d8647ce353c8a61821329ded4e4c9c6e64611e65f5b88b92: Status 404 returned error can't find the container with id a3d79ecbb681f3f7d8647ce353c8a61821329ded4e4c9c6e64611e65f5b88b92
Jul 22 16:30:30.800852 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:30.800819    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2c2bc" event={"ID":"2d6fb80d-4d13-4db4-a26f-1487819e17e9","Type":"ContainerStarted","Data":"a3d79ecbb681f3f7d8647ce353c8a61821329ded4e4c9c6e64611e65f5b88b92"}
Jul 22 16:30:35.232877 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:35.232855    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:30:35.233641 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:35.233621    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:30:35.828551 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:35.828509    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2c2bc" event={"ID":"2d6fb80d-4d13-4db4-a26f-1487819e17e9","Type":"ContainerStarted","Data":"d9355189adffb1191cfd95ecec1aaf07d334c8d32412c6cc7c4032eb0099927c"}
Jul 22 16:30:35.830572 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:35.830546    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lxchf" event={"ID":"026a5e34-7776-4992-84f9-6eb7ad063e63","Type":"ContainerStarted","Data":"70853c8b7cfd6c47c9fee3d3403e4409efb256d4b2169ca7691fd102e49f08fd"}
Jul 22 16:30:35.830693 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:35.830678    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lxchf"
Jul 22 16:30:35.843270 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:35.843205    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-2c2bc" podStartSLOduration=2.000772076 podStartE2EDuration="6.843189058s" totalImagesPullingTime="4.842416982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:30:35.842860196 +0000 UTC m=+602.035063513" watchObservedRunningTime="2026-07-22 16:30:35.843189058 +0000 UTC m=+602.035392377"
Jul 22 16:30:35.860779 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:35.860730    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-lxchf" podStartSLOduration=1.230915504 podStartE2EDuration="6.860714918s" totalImagesPullingTime="5.629799414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:30:35.86003993 +0000 UTC m=+602.052243267" watchObservedRunningTime="2026-07-22 16:30:35.860714918 +0000 UTC m=+602.052918235"
Jul 22 16:30:46.837635 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:30:46.837602    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lxchf"
Jul 22 16:31:05.145013 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.144937    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2c2bc"]
Jul 22 16:31:05.145542 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.145109    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-2c2bc" podUID="2d6fb80d-4d13-4db4-a26f-1487819e17e9" containerName="authorino" containerID="cri-o://d9355189adffb1191cfd95ecec1aaf07d334c8d32412c6cc7c4032eb0099927c" gracePeriod=30
Jul 22 16:31:05.422908 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.422837    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2c2bc"
Jul 22 16:31:05.562600 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.562567    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5hwj\" (UniqueName: \"kubernetes.io/projected/2d6fb80d-4d13-4db4-a26f-1487819e17e9-kube-api-access-r5hwj\") pod \"2d6fb80d-4d13-4db4-a26f-1487819e17e9\" (UID: \"2d6fb80d-4d13-4db4-a26f-1487819e17e9\") "
Jul 22 16:31:05.564648 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.564619    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d6fb80d-4d13-4db4-a26f-1487819e17e9-kube-api-access-r5hwj" (OuterVolumeSpecName: "kube-api-access-r5hwj") pod "2d6fb80d-4d13-4db4-a26f-1487819e17e9" (UID: "2d6fb80d-4d13-4db4-a26f-1487819e17e9"). InnerVolumeSpecName "kube-api-access-r5hwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:31:05.664128 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.664099    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5hwj\" (UniqueName: \"kubernetes.io/projected/2d6fb80d-4d13-4db4-a26f-1487819e17e9-kube-api-access-r5hwj\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:31:05.959324 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.959291    2580 generic.go:356] "Generic (PLEG): container finished" podID="2d6fb80d-4d13-4db4-a26f-1487819e17e9" containerID="d9355189adffb1191cfd95ecec1aaf07d334c8d32412c6cc7c4032eb0099927c" exitCode=0
Jul 22 16:31:05.959485 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.959342    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2c2bc"
Jul 22 16:31:05.959485 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.959370    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2c2bc" event={"ID":"2d6fb80d-4d13-4db4-a26f-1487819e17e9","Type":"ContainerDied","Data":"d9355189adffb1191cfd95ecec1aaf07d334c8d32412c6cc7c4032eb0099927c"}
Jul 22 16:31:05.959485 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.959411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2c2bc" event={"ID":"2d6fb80d-4d13-4db4-a26f-1487819e17e9","Type":"ContainerDied","Data":"a3d79ecbb681f3f7d8647ce353c8a61821329ded4e4c9c6e64611e65f5b88b92"}
Jul 22 16:31:05.959485 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.959430    2580 scope.go:117] "RemoveContainer" containerID="d9355189adffb1191cfd95ecec1aaf07d334c8d32412c6cc7c4032eb0099927c"
Jul 22 16:31:05.968061 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.968045    2580 scope.go:117] "RemoveContainer" containerID="d9355189adffb1191cfd95ecec1aaf07d334c8d32412c6cc7c4032eb0099927c"
Jul 22 16:31:05.968335 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:31:05.968311    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9355189adffb1191cfd95ecec1aaf07d334c8d32412c6cc7c4032eb0099927c\": container with ID starting with d9355189adffb1191cfd95ecec1aaf07d334c8d32412c6cc7c4032eb0099927c not found: ID does not exist" containerID="d9355189adffb1191cfd95ecec1aaf07d334c8d32412c6cc7c4032eb0099927c"
Jul 22 16:31:05.968434 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.968344    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9355189adffb1191cfd95ecec1aaf07d334c8d32412c6cc7c4032eb0099927c"} err="failed to get container status \"d9355189adffb1191cfd95ecec1aaf07d334c8d32412c6cc7c4032eb0099927c\": rpc error: code = NotFound desc = could not find container \"d9355189adffb1191cfd95ecec1aaf07d334c8d32412c6cc7c4032eb0099927c\": container with ID starting with d9355189adffb1191cfd95ecec1aaf07d334c8d32412c6cc7c4032eb0099927c not found: ID does not exist"
Jul 22 16:31:05.979748 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.979726    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2c2bc"]
Jul 22 16:31:05.986452 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:05.986432    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2c2bc"]
Jul 22 16:31:06.408461 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:06.408422    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d6fb80d-4d13-4db4-a26f-1487819e17e9" path="/var/lib/kubelet/pods/2d6fb80d-4d13-4db4-a26f-1487819e17e9/volumes"
Jul 22 16:31:48.250318 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:31:48.250280    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:32:08.004235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:08.004192    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:32:16.387495 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.387459    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"]
Jul 22 16:32:16.387943 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.387923    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d6fb80d-4d13-4db4-a26f-1487819e17e9" containerName="authorino"
Jul 22 16:32:16.387943 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.387940    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d6fb80d-4d13-4db4-a26f-1487819e17e9" containerName="authorino"
Jul 22 16:32:16.388061 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.388047    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d6fb80d-4d13-4db4-a26f-1487819e17e9" containerName="authorino"
Jul 22 16:32:16.391420 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.391402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.393546 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.393526    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 16:32:16.394411 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.394391    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b2274\""
Jul 22 16:32:16.394481 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.394397    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 16:32:16.394481 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.394472    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 22 16:32:16.408109 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.408089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"]
Jul 22 16:32:16.462554 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.462523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.462701 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.462564    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.462701 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.462593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwr89\" (UniqueName: \"kubernetes.io/projected/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-kube-api-access-fwr89\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.462701 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.462666    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.462701 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.462692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.462830 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.462724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.563797 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.563763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.563797 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.563799    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.563993 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.563837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.563993 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.563895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.563993 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.563929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.563993 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.563958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwr89\" (UniqueName: \"kubernetes.io/projected/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-kube-api-access-fwr89\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.564296 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.564264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.564368 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.564335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.564368 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.564359    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.566059 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.566033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.566309 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.566291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.571677 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.571649    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwr89\" (UniqueName: \"kubernetes.io/projected/1fb998b5-cc8d-4c10-9bfa-5983a4822d3e-kube-api-access-fwr89\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zrvxz\" (UID: \"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.701343 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.701251    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:16.830060 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.830032    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"]
Jul 22 16:32:16.832259 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:32:16.832210    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb998b5_cc8d_4c10_9bfa_5983a4822d3e.slice/crio-28cb998b58ffb3e8950c388fb769916c95b90ab3fe9bc78e391afff5ae99ab1c WatchSource:0}: Error finding container 28cb998b58ffb3e8950c388fb769916c95b90ab3fe9bc78e391afff5ae99ab1c: Status 404 returned error can't find the container with id 28cb998b58ffb3e8950c388fb769916c95b90ab3fe9bc78e391afff5ae99ab1c
Jul 22 16:32:16.833528 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:16.833512    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 16:32:17.282546 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:17.282466    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz" event={"ID":"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e","Type":"ContainerStarted","Data":"28cb998b58ffb3e8950c388fb769916c95b90ab3fe9bc78e391afff5ae99ab1c"}
Jul 22 16:32:17.309818 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:17.309783    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:32:18.287912 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:18.287826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz" event={"ID":"1fb998b5-cc8d-4c10-9bfa-5983a4822d3e","Type":"ContainerStarted","Data":"c086941d058730d3fc404adb4877bccef82ff3abd2884b2b74804370796f9761"}
Jul 22 16:32:18.307172 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:18.307126    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz" podStartSLOduration=1.256021417 podStartE2EDuration="2.307111389s" totalImagesPullingTime="1.051089972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:32:18.305737894 +0000 UTC m=+704.497941238" watchObservedRunningTime="2026-07-22 16:32:18.307111389 +0000 UTC m=+704.499314725"
Jul 22 16:32:26.593870 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:26.593792    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:32:26.701728 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:26.701679    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:26.701897 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:26.701755    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:26.713894 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:26.713866    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:27.341943 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:27.341914    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zrvxz"
Jul 22 16:32:40.595984 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:40.595947    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:32:44.170861 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.170829    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"]
Jul 22 16:32:44.181329 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.181301    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.184039 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.184005    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 22 16:32:44.184877 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.184850    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"]
Jul 22 16:32:44.293903 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.293861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c94be51-e6d7-495e-ab62-887253e5bb53-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.294092 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.293943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rck5s\" (UniqueName: \"kubernetes.io/projected/7c94be51-e6d7-495e-ab62-887253e5bb53-kube-api-access-rck5s\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.294092 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.293981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c94be51-e6d7-495e-ab62-887253e5bb53-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.294092 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.293999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c94be51-e6d7-495e-ab62-887253e5bb53-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.294092 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.294016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c94be51-e6d7-495e-ab62-887253e5bb53-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.294092 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.294054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c94be51-e6d7-495e-ab62-887253e5bb53-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.394457 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.394422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c94be51-e6d7-495e-ab62-887253e5bb53-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.394637 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.394473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c94be51-e6d7-495e-ab62-887253e5bb53-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.394637 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.394523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rck5s\" (UniqueName: \"kubernetes.io/projected/7c94be51-e6d7-495e-ab62-887253e5bb53-kube-api-access-rck5s\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.394637 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.394559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c94be51-e6d7-495e-ab62-887253e5bb53-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.394637 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.394586    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c94be51-e6d7-495e-ab62-887253e5bb53-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.394637 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.394609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c94be51-e6d7-495e-ab62-887253e5bb53-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.394896 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.394867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c94be51-e6d7-495e-ab62-887253e5bb53-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.394951 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.394909    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c94be51-e6d7-495e-ab62-887253e5bb53-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.395067 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.395042    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c94be51-e6d7-495e-ab62-887253e5bb53-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.397026 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.397007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c94be51-e6d7-495e-ab62-887253e5bb53-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.397426 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.397404    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c94be51-e6d7-495e-ab62-887253e5bb53-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.403590 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.403567    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rck5s\" (UniqueName: \"kubernetes.io/projected/7c94be51-e6d7-495e-ab62-887253e5bb53-kube-api-access-rck5s\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f4n62\" (UID: \"7c94be51-e6d7-495e-ab62-887253e5bb53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.493384 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.493311    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:44.616937 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:44.616907    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"]
Jul 22 16:32:44.619891 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:32:44.619863    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c94be51_e6d7_495e_ab62_887253e5bb53.slice/crio-235475e1666d36a6f3d7de56c08ffcad7cf5461b5876771f32d838faa6f597ae WatchSource:0}: Error finding container 235475e1666d36a6f3d7de56c08ffcad7cf5461b5876771f32d838faa6f597ae: Status 404 returned error can't find the container with id 235475e1666d36a6f3d7de56c08ffcad7cf5461b5876771f32d838faa6f597ae
Jul 22 16:32:45.410846 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:45.410084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62" event={"ID":"7c94be51-e6d7-495e-ab62-887253e5bb53","Type":"ContainerStarted","Data":"7af3dce88aad5dd20dc0c611e2c3f822616d9d40749a48d5e9ada7081bb79439"}
Jul 22 16:32:45.410846 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:45.410148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62" event={"ID":"7c94be51-e6d7-495e-ab62-887253e5bb53","Type":"ContainerStarted","Data":"235475e1666d36a6f3d7de56c08ffcad7cf5461b5876771f32d838faa6f597ae"}
Jul 22 16:32:45.429040 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:45.428990    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62" podStartSLOduration=1.2318966709999999 podStartE2EDuration="1.428975298s" totalImagesPullingTime="197.078627ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:32:45.428842997 +0000 UTC m=+731.621046317" watchObservedRunningTime="2026-07-22 16:32:45.428975298 +0000 UTC m=+731.621178618"
Jul 22 16:32:46.592580 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:46.592545    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:32:53.586137 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.586095    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"]
Jul 22 16:32:53.591508 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.591487    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.593630 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.593609    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 22 16:32:53.603142 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.603121    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"]
Jul 22 16:32:53.660680 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.660654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6200a9a-ccd6-4b0b-9376-9778210d88d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.660778 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.660687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6200a9a-ccd6-4b0b-9376-9778210d88d0-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.660778 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.660740    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6200a9a-ccd6-4b0b-9376-9778210d88d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.660778 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.660774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6200a9a-ccd6-4b0b-9376-9778210d88d0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.660880 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.660792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkpl5\" (UniqueName: \"kubernetes.io/projected/b6200a9a-ccd6-4b0b-9376-9778210d88d0-kube-api-access-mkpl5\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.660880 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.660814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6200a9a-ccd6-4b0b-9376-9778210d88d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.761262 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.761210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6200a9a-ccd6-4b0b-9376-9778210d88d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.761419 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.761268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6200a9a-ccd6-4b0b-9376-9778210d88d0-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.761419 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.761310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6200a9a-ccd6-4b0b-9376-9778210d88d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.761419 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.761333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6200a9a-ccd6-4b0b-9376-9778210d88d0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.761580 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.761437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkpl5\" (UniqueName: \"kubernetes.io/projected/b6200a9a-ccd6-4b0b-9376-9778210d88d0-kube-api-access-mkpl5\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.761580 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.761488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6200a9a-ccd6-4b0b-9376-9778210d88d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.761736 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.761717    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6200a9a-ccd6-4b0b-9376-9778210d88d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.761786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.761746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6200a9a-ccd6-4b0b-9376-9778210d88d0-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.761786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.761767    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6200a9a-ccd6-4b0b-9376-9778210d88d0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.763426 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.763407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6200a9a-ccd6-4b0b-9376-9778210d88d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.763816 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.763799    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6200a9a-ccd6-4b0b-9376-9778210d88d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.770561 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.770539    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkpl5\" (UniqueName: \"kubernetes.io/projected/b6200a9a-ccd6-4b0b-9376-9778210d88d0-kube-api-access-mkpl5\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd\" (UID: \"b6200a9a-ccd6-4b0b-9376-9778210d88d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:53.900901 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:53.900863    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:32:54.026822 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:54.026795    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"]
Jul 22 16:32:54.028706 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:32:54.028678    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6200a9a_ccd6_4b0b_9376_9778210d88d0.slice/crio-601ad938c40fcbd0ccb3811e1bb4e2d4964b1f981024f5dc39c45ace335a55bb WatchSource:0}: Error finding container 601ad938c40fcbd0ccb3811e1bb4e2d4964b1f981024f5dc39c45ace335a55bb: Status 404 returned error can't find the container with id 601ad938c40fcbd0ccb3811e1bb4e2d4964b1f981024f5dc39c45ace335a55bb
Jul 22 16:32:54.452533 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:54.452497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd" event={"ID":"b6200a9a-ccd6-4b0b-9376-9778210d88d0","Type":"ContainerStarted","Data":"4ae4eeb0db641e3095b81f8761046c81e4e99ac0e0ec4037dc1fa4690034d567"}
Jul 22 16:32:54.452705 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:54.452541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd" event={"ID":"b6200a9a-ccd6-4b0b-9376-9778210d88d0","Type":"ContainerStarted","Data":"601ad938c40fcbd0ccb3811e1bb4e2d4964b1f981024f5dc39c45ace335a55bb"}
Jul 22 16:32:54.470913 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:54.470815    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd" podStartSLOduration=1.283060791 podStartE2EDuration="1.470800784s" totalImagesPullingTime="187.739993ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:32:54.468927356 +0000 UTC m=+740.661130673" watchObservedRunningTime="2026-07-22 16:32:54.470800784 +0000 UTC m=+740.663004080"
Jul 22 16:32:54.494335 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:54.494306    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:54.494447 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:54.494360    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:54.506760 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:54.506737    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:55.467692 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:55.467664    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f4n62"
Jul 22 16:32:56.698929 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:32:56.698891    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:33:03.901434 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:33:03.901401    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:33:03.901434 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:33:03.901443    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:33:03.913395 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:33:03.913370    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:33:04.505265 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:33:04.505236    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd"
Jul 22 16:35:01.404743 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:35:01.404707    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:35:11.292614 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:35:11.292575    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:35:22.593950 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:35:22.593913    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:35:35.263378 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:35:35.263341    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:35:35.264363 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:35:35.264342    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:37:07.194394 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:37:07.194317    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:37:15.492641 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:37:15.492602    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:37:48.698146 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:37:48.698103    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:37:58.192729 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:37:58.192690    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:38:08.589645 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:38:08.589601    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:38:16.188125 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:38:16.188093    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:38:26.395467 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:38:26.395432    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:38:42.201256 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:38:42.201198    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:38:48.692288 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:38:48.692252    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:38:56.389652 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:38:56.389617    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:39:18.988918 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:39:18.988885    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:39:31.286264 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:39:31.286230    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:39:54.494524 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:39:54.494491    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:40:05.089831 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:40:05.089749    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:40:20.303051 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:40:20.302998    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:40:32.592114 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:40:32.592079    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:40:35.289758 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:40:35.289725    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:40:35.291535 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:40:35.291514    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:40:47.295186 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:40:47.295152    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:42:49.799452 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:42:49.799416    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:42:59.694392 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:42:59.694308    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:43:12.797230 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:43:12.797199    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:43:24.697118 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:43:24.697083    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:43:36.194551 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:43:36.194514    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:43:46.085969 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:43:46.085931    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:43:55.493581 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:43:55.493540    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:44:06.692024 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:44:06.691988    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:44:17.989110 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:44:17.989076    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:44:26.201902 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:44:26.201863    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:44:36.987696 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:44:36.987659    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:45:01.899780 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:01.899748    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:45:09.299801 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:09.299763    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:45:32.887549 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:32.887515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:45:35.319550 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:35.319521    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:45:35.321179 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:35.321158    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:45:40.382237 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.382128    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"]
Jul 22 16:45:40.385608 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.385586    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.387866 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.387835    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-6257eb31-kserve-self-signed-certs\""
Jul 22 16:45:40.395541 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.395512    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"]
Jul 22 16:45:40.583723 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.583687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-dshm\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.583723 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.583737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-home\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.583944 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.583765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-model-cache\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.583944 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.583869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-tls-certs\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.583944 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.583922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-tmp-dir\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.583944 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.583940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t28c\" (UniqueName: \"kubernetes.io/projected/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-kube-api-access-9t28c\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.685254 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.685145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-tmp-dir\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.685254 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.685185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t28c\" (UniqueName: \"kubernetes.io/projected/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-kube-api-access-9t28c\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.685440 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.685265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-dshm\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.685440 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.685321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-home\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.685440 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.685359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-model-cache\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.685440 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.685405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-tls-certs\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.685691 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.685668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-tmp-dir\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.685762 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.685728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-home\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.685805 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.685767    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-model-cache\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.687483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.687462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-dshm\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.687783 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.687768    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-tls-certs\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.693931 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.693905    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t28c\" (UniqueName: \"kubernetes.io/projected/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-kube-api-access-9t28c\") pod \"e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") " pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.695710 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.695691    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:40.830229 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:40.830189    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"]
Jul 22 16:45:40.832758 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:45:40.832731    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4b7a18a_21a6_4868_a2d2_db8694fd8c24.slice/crio-03d3eea0710fb914a9868c4a1542ae1a6fab4c9e204a049e58f6c00a7d0ed6d6 WatchSource:0}: Error finding container 03d3eea0710fb914a9868c4a1542ae1a6fab4c9e204a049e58f6c00a7d0ed6d6: Status 404 returned error can't find the container with id 03d3eea0710fb914a9868c4a1542ae1a6fab4c9e204a049e58f6c00a7d0ed6d6
Jul 22 16:45:41.798109 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:41.798074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx" event={"ID":"e4b7a18a-21a6-4868-a2d2-db8694fd8c24","Type":"ContainerStarted","Data":"20470b2f485d26180e5f35b9520ab5b20e91dd691d46f2551172f35e0a5dd372"}
Jul 22 16:45:41.798536 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:41.798120    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx" event={"ID":"e4b7a18a-21a6-4868-a2d2-db8694fd8c24","Type":"ContainerStarted","Data":"03d3eea0710fb914a9868c4a1542ae1a6fab4c9e204a049e58f6c00a7d0ed6d6"}
Jul 22 16:45:41.817513 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:41.817460    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx" podStartSLOduration=1.817445543 podStartE2EDuration="1.817445543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:45:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:45:41.816048493 +0000 UTC m=+1508.008251826" watchObservedRunningTime="2026-07-22 16:45:41.817445543 +0000 UTC m=+1508.009648862"
Jul 22 16:45:50.696781 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:50.696737    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:50.697208 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:50.696794    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:50.710294 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:50.710261    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:50.849117 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:50.849085    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:45:52.685608 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:45:52.685557    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:46:34.980479 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:34.980437    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"]
Jul 22 16:46:37.995550 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:37.995514    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:46:50.000850 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.000808    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx" podUID="e4b7a18a-21a6-4868-a2d2-db8694fd8c24" containerName="main" containerID="cri-o://20470b2f485d26180e5f35b9520ab5b20e91dd691d46f2551172f35e0a5dd372" gracePeriod=45
Jul 22 16:46:50.249306 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.249284    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:46:50.302534 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.302462    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t28c\" (UniqueName: \"kubernetes.io/projected/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-kube-api-access-9t28c\") pod \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") "
Jul 22 16:46:50.302663 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.302559    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-dshm\") pod \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") "
Jul 22 16:46:50.302663 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.302585    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-tls-certs\") pod \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") "
Jul 22 16:46:50.302663 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.302646    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-home\") pod \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") "
Jul 22 16:46:50.302828 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.302793    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-tmp-dir\") pod \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") "
Jul 22 16:46:50.302890 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.302856    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-model-cache\") pod \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\" (UID: \"e4b7a18a-21a6-4868-a2d2-db8694fd8c24\") "
Jul 22 16:46:50.302890 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.302874    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-home" (OuterVolumeSpecName: "home") pod "e4b7a18a-21a6-4868-a2d2-db8694fd8c24" (UID: "e4b7a18a-21a6-4868-a2d2-db8694fd8c24"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:46:50.303065 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.303041    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e4b7a18a-21a6-4868-a2d2-db8694fd8c24" (UID: "e4b7a18a-21a6-4868-a2d2-db8694fd8c24"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:46:50.303159 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.303134    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-model-cache" (OuterVolumeSpecName: "model-cache") pod "e4b7a18a-21a6-4868-a2d2-db8694fd8c24" (UID: "e4b7a18a-21a6-4868-a2d2-db8694fd8c24"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:46:50.303211 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.303196    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-home\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:46:50.303284 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.303217    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-tmp-dir\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:46:50.304848 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.304825    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e4b7a18a-21a6-4868-a2d2-db8694fd8c24" (UID: "e4b7a18a-21a6-4868-a2d2-db8694fd8c24"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:46:50.305086 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.305064    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-dshm" (OuterVolumeSpecName: "dshm") pod "e4b7a18a-21a6-4868-a2d2-db8694fd8c24" (UID: "e4b7a18a-21a6-4868-a2d2-db8694fd8c24"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:46:50.305134 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.305080    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-kube-api-access-9t28c" (OuterVolumeSpecName: "kube-api-access-9t28c") pod "e4b7a18a-21a6-4868-a2d2-db8694fd8c24" (UID: "e4b7a18a-21a6-4868-a2d2-db8694fd8c24"). InnerVolumeSpecName "kube-api-access-9t28c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:46:50.404258 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.404204    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-model-cache\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:46:50.404258 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.404255    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t28c\" (UniqueName: \"kubernetes.io/projected/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-kube-api-access-9t28c\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:46:50.404445 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.404269    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-dshm\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:46:50.404445 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:50.404281    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b7a18a-21a6-4868-a2d2-db8694fd8c24-tls-certs\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:46:51.108375 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:51.108337    2580 generic.go:356] "Generic (PLEG): container finished" podID="e4b7a18a-21a6-4868-a2d2-db8694fd8c24" containerID="20470b2f485d26180e5f35b9520ab5b20e91dd691d46f2551172f35e0a5dd372" exitCode=0
Jul 22 16:46:51.108860 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:51.108382    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"
Jul 22 16:46:51.108860 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:51.108414    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx" event={"ID":"e4b7a18a-21a6-4868-a2d2-db8694fd8c24","Type":"ContainerDied","Data":"20470b2f485d26180e5f35b9520ab5b20e91dd691d46f2551172f35e0a5dd372"}
Jul 22 16:46:51.108860 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:51.108458    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx" event={"ID":"e4b7a18a-21a6-4868-a2d2-db8694fd8c24","Type":"ContainerDied","Data":"03d3eea0710fb914a9868c4a1542ae1a6fab4c9e204a049e58f6c00a7d0ed6d6"}
Jul 22 16:46:51.108860 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:51.108474    2580 scope.go:117] "RemoveContainer" containerID="20470b2f485d26180e5f35b9520ab5b20e91dd691d46f2551172f35e0a5dd372"
Jul 22 16:46:51.116944 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:51.116906    2580 scope.go:117] "RemoveContainer" containerID="20470b2f485d26180e5f35b9520ab5b20e91dd691d46f2551172f35e0a5dd372"
Jul 22 16:46:51.117174 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:46:51.117152    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20470b2f485d26180e5f35b9520ab5b20e91dd691d46f2551172f35e0a5dd372\": container with ID starting with 20470b2f485d26180e5f35b9520ab5b20e91dd691d46f2551172f35e0a5dd372 not found: ID does not exist" containerID="20470b2f485d26180e5f35b9520ab5b20e91dd691d46f2551172f35e0a5dd372"
Jul 22 16:46:51.117242 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:51.117181    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20470b2f485d26180e5f35b9520ab5b20e91dd691d46f2551172f35e0a5dd372"} err="failed to get container status \"20470b2f485d26180e5f35b9520ab5b20e91dd691d46f2551172f35e0a5dd372\": rpc error: code = NotFound desc = could not find container \"20470b2f485d26180e5f35b9520ab5b20e91dd691d46f2551172f35e0a5dd372\": container with ID starting with 20470b2f485d26180e5f35b9520ab5b20e91dd691d46f2551172f35e0a5dd372 not found: ID does not exist"
Jul 22 16:46:51.127789 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:51.127768    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"]
Jul 22 16:46:51.131360 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:51.131342    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-6257eb31-kserve-b96db999-5rwqx"]
Jul 22 16:46:52.408888 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:52.408854    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4b7a18a-21a6-4868-a2d2-db8694fd8c24" path="/var/lib/kubelet/pods/e4b7a18a-21a6-4868-a2d2-db8694fd8c24/volumes"
Jul 22 16:46:52.882384 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:46:52.882349    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:47:02.893363 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:47:02.893327    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:47:15.992581 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:47:15.992539    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:47:25.591957 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:47:25.591918    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:47:34.891230 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:47:34.891183    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:47:44.187902 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:47:44.187864    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:47:54.999310 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:47:54.999275    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:48:04.492648 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:48:04.492607    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:48:18.005867 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:48:18.005828    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:48:27.599834 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:48:27.599797    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:48:37.399910 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:48:37.399876    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:48:49.994244 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:48:49.994192    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:49:00.790981 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:49:00.790894    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:49:08.715208 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:49:08.715170    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:49:21.294335 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:49:21.294297    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:49:33.594385 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:49:33.594350    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:49:46.394765 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:49:46.394729    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:49:55.788213 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:49:55.788175    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:50:07.189541 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:50:07.189505    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:50:16.307528 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:50:16.307491    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:50:33.326103 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:50:33.326065    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:50:35.346427 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:50:35.346395    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:50:35.348539 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:50:35.348516    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:51:04.494607 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:51:04.494564    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:51:17.393281 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:51:17.393247    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:51:48.198727 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:51:48.198689    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:52:00.898952 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:52:00.898865    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:52:33.588849 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:52:33.588755    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:52:45.788253 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:52:45.787721    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:53:18.792177 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:53:18.792142    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:54:47.208018 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:54:47.207979    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:54:57.290098 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:54:57.290016    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:55:12.295384 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:55:12.295348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:55:30.386335 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:55:30.386303    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:55:35.371762 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:55:35.371733    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:55:35.375643 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:55:35.375612    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 16:56:09.788615 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:09.788581    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:56:22.888801 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.888768    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"]
Jul 22 16:56:22.889175 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.889104    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4b7a18a-21a6-4868-a2d2-db8694fd8c24" containerName="main"
Jul 22 16:56:22.889175 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.889115    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4b7a18a-21a6-4868-a2d2-db8694fd8c24" containerName="main"
Jul 22 16:56:22.889175 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.889167    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4b7a18a-21a6-4868-a2d2-db8694fd8c24" containerName="main"
Jul 22 16:56:22.892144 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.892125    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:22.894406 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.894382    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-db88bcf6\"/\"openshift-service-ca.crt\""
Jul 22 16:56:22.894525 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.894394    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-db88bcf6\"/\"kube-root-ca.crt\""
Jul 22 16:56:22.895056 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.895041    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-db88bcf6\"/\"default-dockercfg-zpm6m\""
Jul 22 16:56:22.895150 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.895134    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-db88bcf6\"/\"e2e-lifecycle-model-db88bcf6-kserve-self-signed-certs\""
Jul 22 16:56:22.900724 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.900695    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"]
Jul 22 16:56:22.995854 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.995823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-model-cache\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:22.995854 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.995858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-home\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:22.996040 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.995883    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-tls-certs\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:22.996040 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.995976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-tmp-dir\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:22.996040 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.996004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-dshm\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:22.996040 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:22.996037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqzp2\" (UniqueName: \"kubernetes.io/projected/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-kube-api-access-cqzp2\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.096900 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.096867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-model-cache\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.096900 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.096902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-home\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.097132 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.096923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-tls-certs\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.097132 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.096964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-tmp-dir\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.097132 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.096985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-dshm\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.097132 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.097014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqzp2\" (UniqueName: \"kubernetes.io/projected/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-kube-api-access-cqzp2\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.097364 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.097302    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-model-cache\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.097414 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.097352    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-home\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.097454 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.097420    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-tmp-dir\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.099357 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.099333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-dshm\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.099565 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.099548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-tls-certs\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.107235 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.107196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqzp2\" (UniqueName: \"kubernetes.io/projected/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-kube-api-access-cqzp2\") pod \"e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") " pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.201313 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.201259    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:23.331067 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.331036    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"]
Jul 22 16:56:23.333609 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:56:23.333581    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3e83f71_b345_46cc_b4a1_0038a2fd7a7f.slice/crio-3ff899e51b16c985cb0aaf17f6652d763fbe2a02cbfe53e7405a0f66a6b73ca2 WatchSource:0}: Error finding container 3ff899e51b16c985cb0aaf17f6652d763fbe2a02cbfe53e7405a0f66a6b73ca2: Status 404 returned error can't find the container with id 3ff899e51b16c985cb0aaf17f6652d763fbe2a02cbfe53e7405a0f66a6b73ca2
Jul 22 16:56:23.657050 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.657007    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl" event={"ID":"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f","Type":"ContainerStarted","Data":"049da1dddb5bbb23d7fa7b7b0d76ec4fd5361ed7912803aebbceb2fbb887679e"}
Jul 22 16:56:23.657211 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.657067    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl" event={"ID":"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f","Type":"ContainerStarted","Data":"3ff899e51b16c985cb0aaf17f6652d763fbe2a02cbfe53e7405a0f66a6b73ca2"}
Jul 22 16:56:23.675483 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:23.675441    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl" podStartSLOduration=1.67542747 podStartE2EDuration="1.67542747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:56:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:56:23.674367814 +0000 UTC m=+2149.866571148" watchObservedRunningTime="2026-07-22 16:56:23.67542747 +0000 UTC m=+2149.867630787"
Jul 22 16:56:26.488804 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:26.488767    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:56:33.202258 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:33.202205    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:33.202649 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:33.202273    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:33.214833 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:33.214808    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:33.713471 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:33.713443    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:56:45.097252 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:56:45.097204    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:57:05.497206 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:05.497169    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:57:15.692860 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:15.692823    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:57:19.115398 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:19.115361    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"]
Jul 22 16:57:34.135974 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.135921    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl" podUID="f3e83f71-b345-46cc-b4a1-0038a2fd7a7f" containerName="main" containerID="cri-o://049da1dddb5bbb23d7fa7b7b0d76ec4fd5361ed7912803aebbceb2fbb887679e" gracePeriod=45
Jul 22 16:57:34.383814 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.383789    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:57:34.510720 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.510641    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-home\") pod \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") "
Jul 22 16:57:34.510720 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.510671    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-dshm\") pod \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") "
Jul 22 16:57:34.510720 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.510718    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqzp2\" (UniqueName: \"kubernetes.io/projected/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-kube-api-access-cqzp2\") pod \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") "
Jul 22 16:57:34.510990 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.510768    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-tmp-dir\") pod \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") "
Jul 22 16:57:34.510990 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.510794    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-model-cache\") pod \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") "
Jul 22 16:57:34.510990 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.510841    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-tls-certs\") pod \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\" (UID: \"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f\") "
Jul 22 16:57:34.510990 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.510929    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-home" (OuterVolumeSpecName: "home") pod "f3e83f71-b345-46cc-b4a1-0038a2fd7a7f" (UID: "f3e83f71-b345-46cc-b4a1-0038a2fd7a7f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:57:34.511173 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.511018    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f3e83f71-b345-46cc-b4a1-0038a2fd7a7f" (UID: "f3e83f71-b345-46cc-b4a1-0038a2fd7a7f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:57:34.511173 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.511087    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-home\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:57:34.511173 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.511113    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-model-cache" (OuterVolumeSpecName: "model-cache") pod "f3e83f71-b345-46cc-b4a1-0038a2fd7a7f" (UID: "f3e83f71-b345-46cc-b4a1-0038a2fd7a7f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:57:34.512913 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.512885    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-dshm" (OuterVolumeSpecName: "dshm") pod "f3e83f71-b345-46cc-b4a1-0038a2fd7a7f" (UID: "f3e83f71-b345-46cc-b4a1-0038a2fd7a7f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:57:34.513024 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.512918    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-kube-api-access-cqzp2" (OuterVolumeSpecName: "kube-api-access-cqzp2") pod "f3e83f71-b345-46cc-b4a1-0038a2fd7a7f" (UID: "f3e83f71-b345-46cc-b4a1-0038a2fd7a7f"). InnerVolumeSpecName "kube-api-access-cqzp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:57:34.513024 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.512933    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f3e83f71-b345-46cc-b4a1-0038a2fd7a7f" (UID: "f3e83f71-b345-46cc-b4a1-0038a2fd7a7f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:57:34.612277 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.612212    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-tmp-dir\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:57:34.612277 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.612272    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-model-cache\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:57:34.612277 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.612281    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-tls-certs\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:57:34.612277 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.612289    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-dshm\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:57:34.612533 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.612298    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqzp2\" (UniqueName: \"kubernetes.io/projected/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f-kube-api-access-cqzp2\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 16:57:34.982195 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.982162    2580 generic.go:356] "Generic (PLEG): container finished" podID="f3e83f71-b345-46cc-b4a1-0038a2fd7a7f" containerID="049da1dddb5bbb23d7fa7b7b0d76ec4fd5361ed7912803aebbceb2fbb887679e" exitCode=0
Jul 22 16:57:34.982382 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.982208    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"
Jul 22 16:57:34.982382 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.982240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl" event={"ID":"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f","Type":"ContainerDied","Data":"049da1dddb5bbb23d7fa7b7b0d76ec4fd5361ed7912803aebbceb2fbb887679e"}
Jul 22 16:57:34.982382 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.982271    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl" event={"ID":"f3e83f71-b345-46cc-b4a1-0038a2fd7a7f","Type":"ContainerDied","Data":"3ff899e51b16c985cb0aaf17f6652d763fbe2a02cbfe53e7405a0f66a6b73ca2"}
Jul 22 16:57:34.982382 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.982287    2580 scope.go:117] "RemoveContainer" containerID="049da1dddb5bbb23d7fa7b7b0d76ec4fd5361ed7912803aebbceb2fbb887679e"
Jul 22 16:57:34.991849 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.991830    2580 scope.go:117] "RemoveContainer" containerID="049da1dddb5bbb23d7fa7b7b0d76ec4fd5361ed7912803aebbceb2fbb887679e"
Jul 22 16:57:34.992086 ip-10-0-136-140 kubenswrapper[2580]: E0722 16:57:34.992066    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"049da1dddb5bbb23d7fa7b7b0d76ec4fd5361ed7912803aebbceb2fbb887679e\": container with ID starting with 049da1dddb5bbb23d7fa7b7b0d76ec4fd5361ed7912803aebbceb2fbb887679e not found: ID does not exist" containerID="049da1dddb5bbb23d7fa7b7b0d76ec4fd5361ed7912803aebbceb2fbb887679e"
Jul 22 16:57:34.992152 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:34.992094    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049da1dddb5bbb23d7fa7b7b0d76ec4fd5361ed7912803aebbceb2fbb887679e"} err="failed to get container status \"049da1dddb5bbb23d7fa7b7b0d76ec4fd5361ed7912803aebbceb2fbb887679e\": rpc error: code = NotFound desc = could not find container \"049da1dddb5bbb23d7fa7b7b0d76ec4fd5361ed7912803aebbceb2fbb887679e\": container with ID starting with 049da1dddb5bbb23d7fa7b7b0d76ec4fd5361ed7912803aebbceb2fbb887679e not found: ID does not exist"
Jul 22 16:57:35.005117 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:35.005093    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"]
Jul 22 16:57:35.010024 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:35.010002    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-db88bcf6/e2e-lifecycle-model-db88bcf6-kserve-687747694c-8qgrl"]
Jul 22 16:57:36.408544 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:57:36.408510    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3e83f71-b345-46cc-b4a1-0038a2fd7a7f" path="/var/lib/kubelet/pods/f3e83f71-b345-46cc-b4a1-0038a2fd7a7f/volumes"
Jul 22 16:58:14.497147 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:58:14.497061    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:58:22.686249 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:58:22.686200    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:59:09.090411 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:09.090375    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:59:21.590916 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:21.590877    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:59:31.496810 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.496743    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"]
Jul 22 16:59:31.497376 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.497357    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3e83f71-b345-46cc-b4a1-0038a2fd7a7f" containerName="main"
Jul 22 16:59:31.497434 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.497380    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3e83f71-b345-46cc-b4a1-0038a2fd7a7f" containerName="main"
Jul 22 16:59:31.497484 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.497455    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3e83f71-b345-46cc-b4a1-0038a2fd7a7f" containerName="main"
Jul 22 16:59:31.500293 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.500280    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.503296 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.503274    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-314e2c\"/\"test-model-314e2c-kserve-self-signed-certs\""
Jul 22 16:59:31.503423 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.503274    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-314e2c\"/\"kube-root-ca.crt\""
Jul 22 16:59:31.503423 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.503275    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-314e2c\"/\"default-dockercfg-q55px\""
Jul 22 16:59:31.503423 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.503345    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-314e2c\"/\"openshift-service-ca.crt\""
Jul 22 16:59:31.509629 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.509593    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"]
Jul 22 16:59:31.626261 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.626210    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-home\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.626423 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.626305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-tls-certs\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.626423 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.626326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p7s4\" (UniqueName: \"kubernetes.io/projected/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-kube-api-access-5p7s4\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.626423 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.626342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-dshm\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.626423 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.626408    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-model-cache\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.626559 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.626444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-tmp-dir\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.727323 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.727289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-tls-certs\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.727323 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.727325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p7s4\" (UniqueName: \"kubernetes.io/projected/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-kube-api-access-5p7s4\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.727554 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.727342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-dshm\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.727554 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.727422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-model-cache\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.727554 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.727467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-tmp-dir\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.727554 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.727552    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-home\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.727881 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.727853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-model-cache\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.728008 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.727917    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-tmp-dir\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.728008 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.727950    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-home\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.729499 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.729481    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-dshm\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.729836 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.729821    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-tls-certs\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.735964 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.735937    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p7s4\" (UniqueName: \"kubernetes.io/projected/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-kube-api-access-5p7s4\") pod \"test-model-314e2c-kserve-6f699cc5b9-lzqbg\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") " pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.810703 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.810641    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:31.947465 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:31.947429    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"]
Jul 22 16:59:31.950646 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:59:31.950617    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b102c8d_c2ed_4323_a41e_2fef2bc052d0.slice/crio-2d4274d9385f9fc1d45d75fb742cfd533df17b752b6801305512a2522148b191 WatchSource:0}: Error finding container 2d4274d9385f9fc1d45d75fb742cfd533df17b752b6801305512a2522148b191: Status 404 returned error can't find the container with id 2d4274d9385f9fc1d45d75fb742cfd533df17b752b6801305512a2522148b191
Jul 22 16:59:32.515515 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:32.515472    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg" event={"ID":"9b102c8d-c2ed-4323-a41e-2fef2bc052d0","Type":"ContainerStarted","Data":"029abae65a7995b9f2103510918916e427c55a3ad5c882e7d7d46fb6e050695f"}
Jul 22 16:59:32.515515 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:32.515522    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg" event={"ID":"9b102c8d-c2ed-4323-a41e-2fef2bc052d0","Type":"ContainerStarted","Data":"2d4274d9385f9fc1d45d75fb742cfd533df17b752b6801305512a2522148b191"}
Jul 22 16:59:32.533436 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:32.533390    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg" podStartSLOduration=1.53337473 podStartE2EDuration="1.53337473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:59:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:59:32.532801965 +0000 UTC m=+2338.725005289" watchObservedRunningTime="2026-07-22 16:59:32.53337473 +0000 UTC m=+2338.725578048"
Jul 22 16:59:35.993461 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:35.993428    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 16:59:41.811382 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:41.811341    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:41.811981 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:41.811396    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:41.823945 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:41.823917    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:42.571786 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:42.571761    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 16:59:54.588943 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.588910    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"]
Jul 22 16:59:54.592822 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.592805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.595988 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.595966    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4b1cd3\"/\"default-dockercfg-pxll2\""
Jul 22 16:59:54.596115 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.595969    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4b1cd3\"/\"kube-root-ca.crt\""
Jul 22 16:59:54.596115 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.596055    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4b1cd3\"/\"openshift-service-ca.crt\""
Jul 22 16:59:54.596115 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.595970    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4b1cd3\"/\"test-model-4b1cd3-kserve-self-signed-certs\""
Jul 22 16:59:54.600614 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.600593    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"]
Jul 22 16:59:54.619409 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.619380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e029c58a-8f56-4990-959a-a894eb8455f3-tls-certs\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.619514 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.619447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-home\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.619514 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.619468    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-model-cache\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.619514 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.619489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-tmp-dir\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.619514 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.619506    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgk5x\" (UniqueName: \"kubernetes.io/projected/e029c58a-8f56-4990-959a-a894eb8455f3-kube-api-access-qgk5x\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.619680 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.619600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-dshm\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.720589 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.720561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-home\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.720589 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.720592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-model-cache\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.720753 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.720612    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-tmp-dir\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.720822 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.720804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgk5x\" (UniqueName: \"kubernetes.io/projected/e029c58a-8f56-4990-959a-a894eb8455f3-kube-api-access-qgk5x\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.720860 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.720847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-dshm\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.720915 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.720893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e029c58a-8f56-4990-959a-a894eb8455f3-tls-certs\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.720982 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.720963    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-tmp-dir\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.721037 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.720968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-model-cache\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.721037 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.721023    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-home\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.723036 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.723016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-dshm\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.723387 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.723371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e029c58a-8f56-4990-959a-a894eb8455f3-tls-certs\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.729453 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.729435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgk5x\" (UniqueName: \"kubernetes.io/projected/e029c58a-8f56-4990-959a-a894eb8455f3-kube-api-access-qgk5x\") pod \"test-model-4b1cd3-kserve-7876b8dbb7-qp8pz\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") " pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:54.902193 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:54.902171    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 16:59:55.030787 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:55.030759    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"]
Jul 22 16:59:55.032901 ip-10-0-136-140 kubenswrapper[2580]: W0722 16:59:55.032870    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode029c58a_8f56_4990_959a_a894eb8455f3.slice/crio-00e20c92cfbdc82960d8a904019be21b2410f4080e4714d5d7904179f3aa2aa2 WatchSource:0}: Error finding container 00e20c92cfbdc82960d8a904019be21b2410f4080e4714d5d7904179f3aa2aa2: Status 404 returned error can't find the container with id 00e20c92cfbdc82960d8a904019be21b2410f4080e4714d5d7904179f3aa2aa2
Jul 22 16:59:55.618205 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:55.618174    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz" event={"ID":"e029c58a-8f56-4990-959a-a894eb8455f3","Type":"ContainerStarted","Data":"36319c7731509508606a13e1a0f18a42e8c53388bcdae6d82a2a20d447e15f7c"}
Jul 22 16:59:55.618205 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:55.618211    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz" event={"ID":"e029c58a-8f56-4990-959a-a894eb8455f3","Type":"ContainerStarted","Data":"00e20c92cfbdc82960d8a904019be21b2410f4080e4714d5d7904179f3aa2aa2"}
Jul 22 16:59:55.635212 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:55.635165    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz" podStartSLOduration=1.63515051 podStartE2EDuration="1.63515051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:59:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:59:55.634035483 +0000 UTC m=+2361.826238802" watchObservedRunningTime="2026-07-22 16:59:55.63515051 +0000 UTC m=+2361.827353830"
Jul 22 16:59:58.493569 ip-10-0-136-140 kubenswrapper[2580]: I0722 16:59:58.493531    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:00:04.903234 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:04.903188    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 17:00:04.903618 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:04.903248    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 17:00:04.915673 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:04.915645    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 17:00:05.676470 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:05.676436    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 17:00:11.292815 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:11.292777    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:00:35.399548 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:35.399519    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 17:00:35.403013 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:35.402989    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 17:00:36.489770 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:36.489738    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"]
Jul 22 17:00:37.571708 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:37.571674    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"]
Jul 22 17:00:41.693793 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:41.693756    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:00:51.510111 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.510070    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg" podUID="9b102c8d-c2ed-4323-a41e-2fef2bc052d0" containerName="main" containerID="cri-o://029abae65a7995b9f2103510918916e427c55a3ad5c882e7d7d46fb6e050695f" gracePeriod=45
Jul 22 17:00:51.758929 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.758903    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 17:00:51.809096 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.809038    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-tmp-dir\") pod \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") "
Jul 22 17:00:51.809213 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.809104    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5p7s4\" (UniqueName: \"kubernetes.io/projected/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-kube-api-access-5p7s4\") pod \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") "
Jul 22 17:00:51.809213 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.809148    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-dshm\") pod \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") "
Jul 22 17:00:51.809213 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.809167    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-model-cache\") pod \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") "
Jul 22 17:00:51.809213 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.809193    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-home\") pod \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") "
Jul 22 17:00:51.809463 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.809216    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-tls-certs\") pod \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\" (UID: \"9b102c8d-c2ed-4323-a41e-2fef2bc052d0\") "
Jul 22 17:00:51.809463 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.809279    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9b102c8d-c2ed-4323-a41e-2fef2bc052d0" (UID: "9b102c8d-c2ed-4323-a41e-2fef2bc052d0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:51.809566 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.809465    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-tmp-dir\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:00:51.809566 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.809461    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-model-cache" (OuterVolumeSpecName: "model-cache") pod "9b102c8d-c2ed-4323-a41e-2fef2bc052d0" (UID: "9b102c8d-c2ed-4323-a41e-2fef2bc052d0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:51.809566 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.809472    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-home" (OuterVolumeSpecName: "home") pod "9b102c8d-c2ed-4323-a41e-2fef2bc052d0" (UID: "9b102c8d-c2ed-4323-a41e-2fef2bc052d0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:51.811384 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.811364    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9b102c8d-c2ed-4323-a41e-2fef2bc052d0" (UID: "9b102c8d-c2ed-4323-a41e-2fef2bc052d0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:00:51.811662 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.811647    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-dshm" (OuterVolumeSpecName: "dshm") pod "9b102c8d-c2ed-4323-a41e-2fef2bc052d0" (UID: "9b102c8d-c2ed-4323-a41e-2fef2bc052d0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:51.811729 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.811675    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-kube-api-access-5p7s4" (OuterVolumeSpecName: "kube-api-access-5p7s4") pod "9b102c8d-c2ed-4323-a41e-2fef2bc052d0" (UID: "9b102c8d-c2ed-4323-a41e-2fef2bc052d0"). InnerVolumeSpecName "kube-api-access-5p7s4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:00:51.882789 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.882756    2580 generic.go:356] "Generic (PLEG): container finished" podID="9b102c8d-c2ed-4323-a41e-2fef2bc052d0" containerID="029abae65a7995b9f2103510918916e427c55a3ad5c882e7d7d46fb6e050695f" exitCode=0
Jul 22 17:00:51.882951 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.882790    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg" event={"ID":"9b102c8d-c2ed-4323-a41e-2fef2bc052d0","Type":"ContainerDied","Data":"029abae65a7995b9f2103510918916e427c55a3ad5c882e7d7d46fb6e050695f"}
Jul 22 17:00:51.882951 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.882803    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"
Jul 22 17:00:51.882951 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.882842    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg" event={"ID":"9b102c8d-c2ed-4323-a41e-2fef2bc052d0","Type":"ContainerDied","Data":"2d4274d9385f9fc1d45d75fb742cfd533df17b752b6801305512a2522148b191"}
Jul 22 17:00:51.882951 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.882869    2580 scope.go:117] "RemoveContainer" containerID="029abae65a7995b9f2103510918916e427c55a3ad5c882e7d7d46fb6e050695f"
Jul 22 17:00:51.891646 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.891628    2580 scope.go:117] "RemoveContainer" containerID="029abae65a7995b9f2103510918916e427c55a3ad5c882e7d7d46fb6e050695f"
Jul 22 17:00:51.891895 ip-10-0-136-140 kubenswrapper[2580]: E0722 17:00:51.891875    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"029abae65a7995b9f2103510918916e427c55a3ad5c882e7d7d46fb6e050695f\": container with ID starting with 029abae65a7995b9f2103510918916e427c55a3ad5c882e7d7d46fb6e050695f not found: ID does not exist" containerID="029abae65a7995b9f2103510918916e427c55a3ad5c882e7d7d46fb6e050695f"
Jul 22 17:00:51.891946 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.891902    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"029abae65a7995b9f2103510918916e427c55a3ad5c882e7d7d46fb6e050695f"} err="failed to get container status \"029abae65a7995b9f2103510918916e427c55a3ad5c882e7d7d46fb6e050695f\": rpc error: code = NotFound desc = could not find container \"029abae65a7995b9f2103510918916e427c55a3ad5c882e7d7d46fb6e050695f\": container with ID starting with 029abae65a7995b9f2103510918916e427c55a3ad5c882e7d7d46fb6e050695f not found: ID does not exist"
Jul 22 17:00:51.908977 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.908954    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"]
Jul 22 17:00:51.910415 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.910396    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p7s4\" (UniqueName: \"kubernetes.io/projected/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-kube-api-access-5p7s4\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:00:51.910467 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.910418    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-dshm\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:00:51.910467 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.910429    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-model-cache\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:00:51.910467 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.910437    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-home\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:00:51.910467 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.910448    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b102c8d-c2ed-4323-a41e-2fef2bc052d0-tls-certs\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:00:51.918347 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:51.918326    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-314e2c/test-model-314e2c-kserve-6f699cc5b9-lzqbg"]
Jul 22 17:00:52.408334 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.408296    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b102c8d-c2ed-4323-a41e-2fef2bc052d0" path="/var/lib/kubelet/pods/9b102c8d-c2ed-4323-a41e-2fef2bc052d0/volumes"
Jul 22 17:00:52.592033 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.591999    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz" podUID="e029c58a-8f56-4990-959a-a894eb8455f3" containerName="main" containerID="cri-o://36319c7731509508606a13e1a0f18a42e8c53388bcdae6d82a2a20d447e15f7c" gracePeriod=45
Jul 22 17:00:52.844274 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.844251    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 17:00:52.888492 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.888461    2580 generic.go:356] "Generic (PLEG): container finished" podID="e029c58a-8f56-4990-959a-a894eb8455f3" containerID="36319c7731509508606a13e1a0f18a42e8c53388bcdae6d82a2a20d447e15f7c" exitCode=0
Jul 22 17:00:52.888668 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.888503    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"
Jul 22 17:00:52.888668 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.888498    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz" event={"ID":"e029c58a-8f56-4990-959a-a894eb8455f3","Type":"ContainerDied","Data":"36319c7731509508606a13e1a0f18a42e8c53388bcdae6d82a2a20d447e15f7c"}
Jul 22 17:00:52.888668 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.888625    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz" event={"ID":"e029c58a-8f56-4990-959a-a894eb8455f3","Type":"ContainerDied","Data":"00e20c92cfbdc82960d8a904019be21b2410f4080e4714d5d7904179f3aa2aa2"}
Jul 22 17:00:52.888668 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.888651    2580 scope.go:117] "RemoveContainer" containerID="36319c7731509508606a13e1a0f18a42e8c53388bcdae6d82a2a20d447e15f7c"
Jul 22 17:00:52.896765 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.896748    2580 scope.go:117] "RemoveContainer" containerID="36319c7731509508606a13e1a0f18a42e8c53388bcdae6d82a2a20d447e15f7c"
Jul 22 17:00:52.897030 ip-10-0-136-140 kubenswrapper[2580]: E0722 17:00:52.897009    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36319c7731509508606a13e1a0f18a42e8c53388bcdae6d82a2a20d447e15f7c\": container with ID starting with 36319c7731509508606a13e1a0f18a42e8c53388bcdae6d82a2a20d447e15f7c not found: ID does not exist" containerID="36319c7731509508606a13e1a0f18a42e8c53388bcdae6d82a2a20d447e15f7c"
Jul 22 17:00:52.897093 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.897037    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36319c7731509508606a13e1a0f18a42e8c53388bcdae6d82a2a20d447e15f7c"} err="failed to get container status \"36319c7731509508606a13e1a0f18a42e8c53388bcdae6d82a2a20d447e15f7c\": rpc error: code = NotFound desc = could not find container \"36319c7731509508606a13e1a0f18a42e8c53388bcdae6d82a2a20d447e15f7c\": container with ID starting with 36319c7731509508606a13e1a0f18a42e8c53388bcdae6d82a2a20d447e15f7c not found: ID does not exist"
Jul 22 17:00:52.918438 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.918419    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-tmp-dir\") pod \"e029c58a-8f56-4990-959a-a894eb8455f3\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") "
Jul 22 17:00:52.918534 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.918497    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-home\") pod \"e029c58a-8f56-4990-959a-a894eb8455f3\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") "
Jul 22 17:00:52.918584 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.918535    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgk5x\" (UniqueName: \"kubernetes.io/projected/e029c58a-8f56-4990-959a-a894eb8455f3-kube-api-access-qgk5x\") pod \"e029c58a-8f56-4990-959a-a894eb8455f3\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") "
Jul 22 17:00:52.918584 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.918560    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-model-cache\") pod \"e029c58a-8f56-4990-959a-a894eb8455f3\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") "
Jul 22 17:00:52.918667 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.918601    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e029c58a-8f56-4990-959a-a894eb8455f3" (UID: "e029c58a-8f56-4990-959a-a894eb8455f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:52.918667 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.918612    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e029c58a-8f56-4990-959a-a894eb8455f3-tls-certs\") pod \"e029c58a-8f56-4990-959a-a894eb8455f3\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") "
Jul 22 17:00:52.918761 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.918665    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-dshm\") pod \"e029c58a-8f56-4990-959a-a894eb8455f3\" (UID: \"e029c58a-8f56-4990-959a-a894eb8455f3\") "
Jul 22 17:00:52.918812 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.918764    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-home" (OuterVolumeSpecName: "home") pod "e029c58a-8f56-4990-959a-a894eb8455f3" (UID: "e029c58a-8f56-4990-959a-a894eb8455f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:52.918909 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.918882    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "e029c58a-8f56-4990-959a-a894eb8455f3" (UID: "e029c58a-8f56-4990-959a-a894eb8455f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:52.918993 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.918980    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-model-cache\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:00:52.919031 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.919001    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-tmp-dir\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:00:52.919031 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.919020    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-home\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:00:52.920682 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.920659    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-dshm" (OuterVolumeSpecName: "dshm") pod "e029c58a-8f56-4990-959a-a894eb8455f3" (UID: "e029c58a-8f56-4990-959a-a894eb8455f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:00:52.920752 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.920696    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e029c58a-8f56-4990-959a-a894eb8455f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e029c58a-8f56-4990-959a-a894eb8455f3" (UID: "e029c58a-8f56-4990-959a-a894eb8455f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:00:52.920815 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:52.920795    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e029c58a-8f56-4990-959a-a894eb8455f3-kube-api-access-qgk5x" (OuterVolumeSpecName: "kube-api-access-qgk5x") pod "e029c58a-8f56-4990-959a-a894eb8455f3" (UID: "e029c58a-8f56-4990-959a-a894eb8455f3"). InnerVolumeSpecName "kube-api-access-qgk5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:00:53.019750 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:53.019664    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e029c58a-8f56-4990-959a-a894eb8455f3-tls-certs\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:00:53.019750 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:53.019693    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e029c58a-8f56-4990-959a-a894eb8455f3-dshm\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:00:53.019750 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:53.019702    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgk5x\" (UniqueName: \"kubernetes.io/projected/e029c58a-8f56-4990-959a-a894eb8455f3-kube-api-access-qgk5x\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:00:53.210195 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:53.210166    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"]
Jul 22 17:00:53.218928 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:53.218902    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-4b1cd3/test-model-4b1cd3-kserve-7876b8dbb7-qp8pz"]
Jul 22 17:00:54.409040 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:54.409007    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e029c58a-8f56-4990-959a-a894eb8455f3" path="/var/lib/kubelet/pods/e029c58a-8f56-4990-959a-a894eb8455f3/volumes"
Jul 22 17:00:57.691895 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:00:57.691800    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:01:13.795674 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:13.795637    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:01:34.410159 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:34.410120    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:01:47.180371 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.180336    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc"]
Jul 22 17:01:47.180841 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.180692    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b102c8d-c2ed-4323-a41e-2fef2bc052d0" containerName="main"
Jul 22 17:01:47.180841 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.180704    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b102c8d-c2ed-4323-a41e-2fef2bc052d0" containerName="main"
Jul 22 17:01:47.180841 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.180717    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e029c58a-8f56-4990-959a-a894eb8455f3" containerName="main"
Jul 22 17:01:47.180841 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.180723    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e029c58a-8f56-4990-959a-a894eb8455f3" containerName="main"
Jul 22 17:01:47.180841 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.180792    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b102c8d-c2ed-4323-a41e-2fef2bc052d0" containerName="main"
Jul 22 17:01:47.180841 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.180801    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e029c58a-8f56-4990-959a-a894eb8455f3" containerName="main"
Jul 22 17:01:47.183769 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.183753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc"
Jul 22 17:01:47.185901 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.185876    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 17:01:47.186055 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.186036    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xmwmv\""
Jul 22 17:01:47.194409 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.194385    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc"]
Jul 22 17:01:47.269272 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.269242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f89a0545-27d8-4d2a-abb7-730a2d79b3e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc\" (UID: \"f89a0545-27d8-4d2a-abb7-730a2d79b3e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc"
Jul 22 17:01:47.370062 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.370033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f89a0545-27d8-4d2a-abb7-730a2d79b3e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc\" (UID: \"f89a0545-27d8-4d2a-abb7-730a2d79b3e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc"
Jul 22 17:01:47.370639 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.370619    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f89a0545-27d8-4d2a-abb7-730a2d79b3e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc\" (UID: \"f89a0545-27d8-4d2a-abb7-730a2d79b3e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc"
Jul 22 17:01:47.495160 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.495074    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc"
Jul 22 17:01:47.630292 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.630268    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc"]
Jul 22 17:01:47.632898 ip-10-0-136-140 kubenswrapper[2580]: W0722 17:01:47.632869    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89a0545_27d8_4d2a_abb7_730a2d79b3e2.slice/crio-b981d83fd26b192a4e9710afd7c91ace35859b6cb3da0d928762a0bfc0a59ea5 WatchSource:0}: Error finding container b981d83fd26b192a4e9710afd7c91ace35859b6cb3da0d928762a0bfc0a59ea5: Status 404 returned error can't find the container with id b981d83fd26b192a4e9710afd7c91ace35859b6cb3da0d928762a0bfc0a59ea5
Jul 22 17:01:47.634765 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:47.634749    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 17:01:48.098929 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:48.098889    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:01:48.141661 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:48.141626    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc" event={"ID":"f89a0545-27d8-4d2a-abb7-730a2d79b3e2","Type":"ContainerStarted","Data":"b981d83fd26b192a4e9710afd7c91ace35859b6cb3da0d928762a0bfc0a59ea5"}
Jul 22 17:01:51.157214 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:51.157179    2580 generic.go:356] "Generic (PLEG): container finished" podID="f89a0545-27d8-4d2a-abb7-730a2d79b3e2" containerID="dc579a63b222c6b54828c370de8642000be0d32fdd3977c0184a8ef83fc5a15b" exitCode=0
Jul 22 17:01:51.157579 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:51.157260    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc" event={"ID":"f89a0545-27d8-4d2a-abb7-730a2d79b3e2","Type":"ContainerDied","Data":"dc579a63b222c6b54828c370de8642000be0d32fdd3977c0184a8ef83fc5a15b"}
Jul 22 17:01:52.288060 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:52.288035    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc"
Jul 22 17:01:52.419694 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:52.419617    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f89a0545-27d8-4d2a-abb7-730a2d79b3e2-maas-api-service-ca\") pod \"f89a0545-27d8-4d2a-abb7-730a2d79b3e2\" (UID: \"f89a0545-27d8-4d2a-abb7-730a2d79b3e2\") "
Jul 22 17:01:52.419936 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:52.419912    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f89a0545-27d8-4d2a-abb7-730a2d79b3e2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f89a0545-27d8-4d2a-abb7-730a2d79b3e2" (UID: "f89a0545-27d8-4d2a-abb7-730a2d79b3e2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:01:52.520236 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:52.520196    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f89a0545-27d8-4d2a-abb7-730a2d79b3e2-maas-api-service-ca\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:01:53.167014 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:53.166974    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc" event={"ID":"f89a0545-27d8-4d2a-abb7-730a2d79b3e2","Type":"ContainerDied","Data":"b981d83fd26b192a4e9710afd7c91ace35859b6cb3da0d928762a0bfc0a59ea5"}
Jul 22 17:01:53.167014 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:53.167009    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc"
Jul 22 17:01:53.167253 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:01:53.167036    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b981d83fd26b192a4e9710afd7c91ace35859b6cb3da0d928762a0bfc0a59ea5"
Jul 22 17:02:05.195314 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:05.195277    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:02:07.286399 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:07.286358    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc"]
Jul 22 17:02:07.290953 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:07.290920    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf7663-fmcpc"]
Jul 22 17:02:08.408901 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:08.408866    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f89a0545-27d8-4d2a-abb7-730a2d79b3e2" path="/var/lib/kubelet/pods/f89a0545-27d8-4d2a-abb7-730a2d79b3e2/volumes"
Jul 22 17:02:14.687883 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:14.687845    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc"]
Jul 22 17:02:14.688287 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:14.688209    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89a0545-27d8-4d2a-abb7-730a2d79b3e2" containerName="revoke-keys"
Jul 22 17:02:14.688287 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:14.688234    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89a0545-27d8-4d2a-abb7-730a2d79b3e2" containerName="revoke-keys"
Jul 22 17:02:14.688370 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:14.688301    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f89a0545-27d8-4d2a-abb7-730a2d79b3e2" containerName="revoke-keys"
Jul 22 17:02:14.691212 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:14.691196    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc"
Jul 22 17:02:14.693233 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:14.693198    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 17:02:14.693479 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:14.693464    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xmwmv\""
Jul 22 17:02:14.699255 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:14.699214    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc"]
Jul 22 17:02:14.814030 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:14.813998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20dd8f00-7049-4ff7-95fc-cd09d160b7e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc\" (UID: \"20dd8f00-7049-4ff7-95fc-cd09d160b7e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc"
Jul 22 17:02:14.915052 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:14.915026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20dd8f00-7049-4ff7-95fc-cd09d160b7e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc\" (UID: \"20dd8f00-7049-4ff7-95fc-cd09d160b7e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc"
Jul 22 17:02:14.915693 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:14.915673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20dd8f00-7049-4ff7-95fc-cd09d160b7e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc\" (UID: \"20dd8f00-7049-4ff7-95fc-cd09d160b7e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc"
Jul 22 17:02:15.001548 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:15.001481    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc"
Jul 22 17:02:15.131626 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:15.131600    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc"]
Jul 22 17:02:15.133816 ip-10-0-136-140 kubenswrapper[2580]: W0722 17:02:15.133786    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20dd8f00_7049_4ff7_95fc_cd09d160b7e6.slice/crio-a0cd5e34e9549ff58612699943d83bccfb1c18a8168a9fedce936e586eb5ba2d WatchSource:0}: Error finding container a0cd5e34e9549ff58612699943d83bccfb1c18a8168a9fedce936e586eb5ba2d: Status 404 returned error can't find the container with id a0cd5e34e9549ff58612699943d83bccfb1c18a8168a9fedce936e586eb5ba2d
Jul 22 17:02:15.270106 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:15.270041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc" event={"ID":"20dd8f00-7049-4ff7-95fc-cd09d160b7e6","Type":"ContainerStarted","Data":"a0cd5e34e9549ff58612699943d83bccfb1c18a8168a9fedce936e586eb5ba2d"}
Jul 22 17:02:16.275594 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:16.275554    2580 generic.go:356] "Generic (PLEG): container finished" podID="20dd8f00-7049-4ff7-95fc-cd09d160b7e6" containerID="58c426da627b29b0d99c69c740970f32c10643655483a0fe8abff2e9e6078b9e" exitCode=0
Jul 22 17:02:16.276031 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:16.275638    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc" event={"ID":"20dd8f00-7049-4ff7-95fc-cd09d160b7e6","Type":"ContainerDied","Data":"58c426da627b29b0d99c69c740970f32c10643655483a0fe8abff2e9e6078b9e"}
Jul 22 17:02:17.416767 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:17.416742    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc"
Jul 22 17:02:17.538140 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:17.538057    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20dd8f00-7049-4ff7-95fc-cd09d160b7e6-maas-api-service-ca\") pod \"20dd8f00-7049-4ff7-95fc-cd09d160b7e6\" (UID: \"20dd8f00-7049-4ff7-95fc-cd09d160b7e6\") "
Jul 22 17:02:17.538462 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:17.538436    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20dd8f00-7049-4ff7-95fc-cd09d160b7e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "20dd8f00-7049-4ff7-95fc-cd09d160b7e6" (UID: "20dd8f00-7049-4ff7-95fc-cd09d160b7e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:02:17.639343 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:17.639313    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20dd8f00-7049-4ff7-95fc-cd09d160b7e6-maas-api-service-ca\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:02:18.285923 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:18.285896    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc"
Jul 22 17:02:18.286180 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:18.285897    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc" event={"ID":"20dd8f00-7049-4ff7-95fc-cd09d160b7e6","Type":"ContainerDied","Data":"a0cd5e34e9549ff58612699943d83bccfb1c18a8168a9fedce936e586eb5ba2d"}
Jul 22 17:02:18.286180 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:18.286020    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0cd5e34e9549ff58612699943d83bccfb1c18a8168a9fedce936e586eb5ba2d"
Jul 22 17:02:34.792822 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:34.792782    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc"]
Jul 22 17:02:34.799049 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:34.799024    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0f66aa-86dtc"]
Jul 22 17:02:35.287370 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:35.287328    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:02:36.408186 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:36.408145    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20dd8f00-7049-4ff7-95fc-cd09d160b7e6" path="/var/lib/kubelet/pods/20dd8f00-7049-4ff7-95fc-cd09d160b7e6/volumes"
Jul 22 17:02:53.188288 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:02:53.188248    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:03:03.690449 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:03.690403    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:03:07.403193 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.403158    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"]
Jul 22 17:03:07.403587 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.403511    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20dd8f00-7049-4ff7-95fc-cd09d160b7e6" containerName="revoke-keys"
Jul 22 17:03:07.403587 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.403524    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="20dd8f00-7049-4ff7-95fc-cd09d160b7e6" containerName="revoke-keys"
Jul 22 17:03:07.403660 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.403600    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="20dd8f00-7049-4ff7-95fc-cd09d160b7e6" containerName="revoke-keys"
Jul 22 17:03:07.406811 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.406791    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.409716 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.409689    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d6d924\"/\"openshift-service-ca.crt\""
Jul 22 17:03:07.409868 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.409727    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d6d924\"/\"kube-root-ca.crt\""
Jul 22 17:03:07.409868 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.409749    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d6d924\"/\"default-dockercfg-tf27g\""
Jul 22 17:03:07.409868 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.409726    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d6d924\"/\"auth-test-model-d6d924-kserve-self-signed-certs\""
Jul 22 17:03:07.414722 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.414695    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"]
Jul 22 17:03:07.579176 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.579134    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-home\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.579420 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.579208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-model-cache\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.579420 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.579269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-dshm\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.579420 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.579293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwtk5\" (UniqueName: \"kubernetes.io/projected/7bd3abc5-8de0-4af1-a1e6-731725122ce6-kube-api-access-kwtk5\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.579420 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.579327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-tmp-dir\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.579588 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.579416    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd3abc5-8de0-4af1-a1e6-731725122ce6-tls-certs\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.680254 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.680135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-model-cache\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.680254 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.680175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-dshm\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.680254 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.680194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwtk5\" (UniqueName: \"kubernetes.io/projected/7bd3abc5-8de0-4af1-a1e6-731725122ce6-kube-api-access-kwtk5\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.680254 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.680244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-tmp-dir\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.680587 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.680283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd3abc5-8de0-4af1-a1e6-731725122ce6-tls-certs\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.680587 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.680330    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-home\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.680696 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.680655    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-model-cache\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.680696 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.680673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-home\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.680809 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.680768    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-tmp-dir\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.682591 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.682564    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-dshm\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.682861 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.682843    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd3abc5-8de0-4af1-a1e6-731725122ce6-tls-certs\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.688204 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.688181    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwtk5\" (UniqueName: \"kubernetes.io/projected/7bd3abc5-8de0-4af1-a1e6-731725122ce6-kube-api-access-kwtk5\") pod \"auth-test-model-d6d924-kserve-59b7774879-hrx8q\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") " pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.717064 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.717031    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:07.852942 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:07.852849    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"]
Jul 22 17:03:07.855326 ip-10-0-136-140 kubenswrapper[2580]: W0722 17:03:07.855295    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7bd3abc5_8de0_4af1_a1e6_731725122ce6.slice/crio-273ef060f0d552f1739209f24927fb154fd04bd38f440b9b65bc9b586eec4deb WatchSource:0}: Error finding container 273ef060f0d552f1739209f24927fb154fd04bd38f440b9b65bc9b586eec4deb: Status 404 returned error can't find the container with id 273ef060f0d552f1739209f24927fb154fd04bd38f440b9b65bc9b586eec4deb
Jul 22 17:03:08.515701 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:08.515655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q" event={"ID":"7bd3abc5-8de0-4af1-a1e6-731725122ce6","Type":"ContainerStarted","Data":"7f6064c79e589a4facd139d34cc692038e0096af10e63826bb8be17319b45d13"}
Jul 22 17:03:08.515701 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:08.515710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q" event={"ID":"7bd3abc5-8de0-4af1-a1e6-731725122ce6","Type":"ContainerStarted","Data":"273ef060f0d552f1739209f24927fb154fd04bd38f440b9b65bc9b586eec4deb"}
Jul 22 17:03:08.535945 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:08.535877    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q" podStartSLOduration=1.535860788 podStartE2EDuration="1.535860788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:03:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:03:08.534309652 +0000 UTC m=+2554.726512972" watchObservedRunningTime="2026-07-22 17:03:08.535860788 +0000 UTC m=+2554.728064107"
Jul 22 17:03:11.891890 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:11.891844    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:03:17.717383 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:17.717349    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:17.717383 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:17.717389    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:17.730116 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:17.730090    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:18.581314 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:18.581282    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:03:45.791072 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.791035    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"]
Jul 22 17:03:45.795031 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.795010    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.797361 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.797342    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cfb31b\"/\"kube-root-ca.crt\""
Jul 22 17:03:45.798211 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.798186    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cfb31b\"/\"auth-test-model-cfb31b-kserve-self-signed-certs\""
Jul 22 17:03:45.798211 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.798204    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cfb31b\"/\"openshift-service-ca.crt\""
Jul 22 17:03:45.798399 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.798197    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cfb31b\"/\"default-dockercfg-86p4t\""
Jul 22 17:03:45.804537 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.804517    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"]
Jul 22 17:03:45.893633 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.893596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-home\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.893633 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.893626    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-tmp-dir\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.893821 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.893729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fefadd0-e324-4f3e-8fa2-6923fb692ada-tls-certs\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.893821 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.893761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-dshm\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.893821 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.893784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5p2j\" (UniqueName: \"kubernetes.io/projected/8fefadd0-e324-4f3e-8fa2-6923fb692ada-kube-api-access-h5p2j\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.893821 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.893804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-model-cache\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.994457 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.994423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fefadd0-e324-4f3e-8fa2-6923fb692ada-tls-certs\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.994457 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.994461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-dshm\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.994709 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.994480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5p2j\" (UniqueName: \"kubernetes.io/projected/8fefadd0-e324-4f3e-8fa2-6923fb692ada-kube-api-access-h5p2j\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.994709 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.994499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-model-cache\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.994709 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.994534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-home\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.994709 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.994549    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-tmp-dir\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.994983 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.994956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-tmp-dir\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.995056 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.994956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-model-cache\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.995056 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.994998    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-home\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.996766 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.996743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-dshm\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:45.997011 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:45.996992    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fefadd0-e324-4f3e-8fa2-6923fb692ada-tls-certs\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:46.002934 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:46.002911    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5p2j\" (UniqueName: \"kubernetes.io/projected/8fefadd0-e324-4f3e-8fa2-6923fb692ada-kube-api-access-h5p2j\") pod \"auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") " pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:46.105195 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:46.105164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:46.237245 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:46.237194    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"]
Jul 22 17:03:46.239629 ip-10-0-136-140 kubenswrapper[2580]: W0722 17:03:46.239599    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fefadd0_e324_4f3e_8fa2_6923fb692ada.slice/crio-034e78ca882b5e66083ea045912eb19d42edfb3f0f7c0f3a54c843e09bdb5180 WatchSource:0}: Error finding container 034e78ca882b5e66083ea045912eb19d42edfb3f0f7c0f3a54c843e09bdb5180: Status 404 returned error can't find the container with id 034e78ca882b5e66083ea045912eb19d42edfb3f0f7c0f3a54c843e09bdb5180
Jul 22 17:03:46.695768 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:46.695726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj" event={"ID":"8fefadd0-e324-4f3e-8fa2-6923fb692ada","Type":"ContainerStarted","Data":"6feb23dc257e6b1abaf271d6f3222c6ee8db2ababde371a7f93d23a32f230d97"}
Jul 22 17:03:46.695768 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:46.695773    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj" event={"ID":"8fefadd0-e324-4f3e-8fa2-6923fb692ada","Type":"ContainerStarted","Data":"034e78ca882b5e66083ea045912eb19d42edfb3f0f7c0f3a54c843e09bdb5180"}
Jul 22 17:03:46.713801 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:46.713751    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj" podStartSLOduration=1.713734132 podStartE2EDuration="1.713734132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:03:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:03:46.713006344 +0000 UTC m=+2592.905209658" watchObservedRunningTime="2026-07-22 17:03:46.713734132 +0000 UTC m=+2592.905937450"
Jul 22 17:03:49.789762 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:49.789728    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:03:56.106146 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:56.106113    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:56.106146 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:56.106160    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:56.118621 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:56.118592    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:03:56.754173 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:03:56.754141    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:04:33.690613 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:04:33.690576    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:04:51.907824 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:04:51.907789    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:05:08.809726 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:05:08.809669    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:05:24.990335 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:05:24.990298    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:05:35.430203 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:05:35.430173    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 17:05:35.434681 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:05:35.434658    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 17:05:45.001495 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:05:45.001457    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:06:01.506932 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:01.506888    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:06:16.985432 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:16.985395    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"]
Jul 22 17:06:17.889902 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:17.889861    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"]
Jul 22 17:06:19.991565 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:19.991518    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:06:32.005378 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.005333    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q" podUID="7bd3abc5-8de0-4af1-a1e6-731725122ce6" containerName="main" containerID="cri-o://7f6064c79e589a4facd139d34cc692038e0096af10e63826bb8be17319b45d13" gracePeriod=45
Jul 22 17:06:32.252772 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.252742    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:06:32.371855 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.371820    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-model-cache\") pod \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") "
Jul 22 17:06:32.372048 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.371863    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwtk5\" (UniqueName: \"kubernetes.io/projected/7bd3abc5-8de0-4af1-a1e6-731725122ce6-kube-api-access-kwtk5\") pod \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") "
Jul 22 17:06:32.372048 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.371903    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-dshm\") pod \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") "
Jul 22 17:06:32.372048 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.371957    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-home\") pod \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") "
Jul 22 17:06:32.372048 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.371980    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-tmp-dir\") pod \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") "
Jul 22 17:06:32.372048 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.371995    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd3abc5-8de0-4af1-a1e6-731725122ce6-tls-certs\") pod \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\" (UID: \"7bd3abc5-8de0-4af1-a1e6-731725122ce6\") "
Jul 22 17:06:32.372343 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.372192    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-model-cache" (OuterVolumeSpecName: "model-cache") pod "7bd3abc5-8de0-4af1-a1e6-731725122ce6" (UID: "7bd3abc5-8de0-4af1-a1e6-731725122ce6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:32.372343 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.372304    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-home" (OuterVolumeSpecName: "home") pod "7bd3abc5-8de0-4af1-a1e6-731725122ce6" (UID: "7bd3abc5-8de0-4af1-a1e6-731725122ce6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:32.372421 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.372341    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7bd3abc5-8de0-4af1-a1e6-731725122ce6" (UID: "7bd3abc5-8de0-4af1-a1e6-731725122ce6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:32.374394 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.374364    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bd3abc5-8de0-4af1-a1e6-731725122ce6-kube-api-access-kwtk5" (OuterVolumeSpecName: "kube-api-access-kwtk5") pod "7bd3abc5-8de0-4af1-a1e6-731725122ce6" (UID: "7bd3abc5-8de0-4af1-a1e6-731725122ce6"). InnerVolumeSpecName "kube-api-access-kwtk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:06:32.374394 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.374377    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd3abc5-8de0-4af1-a1e6-731725122ce6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7bd3abc5-8de0-4af1-a1e6-731725122ce6" (UID: "7bd3abc5-8de0-4af1-a1e6-731725122ce6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:06:32.374394 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.374369    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-dshm" (OuterVolumeSpecName: "dshm") pod "7bd3abc5-8de0-4af1-a1e6-731725122ce6" (UID: "7bd3abc5-8de0-4af1-a1e6-731725122ce6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:32.473044 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.473008    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-home\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:06:32.473044 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.473041    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-tmp-dir\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:06:32.473044 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.473052    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd3abc5-8de0-4af1-a1e6-731725122ce6-tls-certs\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:06:32.473377 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.473060    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-model-cache\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:06:32.473377 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.473070    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwtk5\" (UniqueName: \"kubernetes.io/projected/7bd3abc5-8de0-4af1-a1e6-731725122ce6-kube-api-access-kwtk5\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:06:32.473377 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.473078    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bd3abc5-8de0-4af1-a1e6-731725122ce6-dshm\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:06:32.492922 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.492893    2580 generic.go:356] "Generic (PLEG): container finished" podID="7bd3abc5-8de0-4af1-a1e6-731725122ce6" containerID="7f6064c79e589a4facd139d34cc692038e0096af10e63826bb8be17319b45d13" exitCode=0
Jul 22 17:06:32.493077 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.492937    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"
Jul 22 17:06:32.493077 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.492967    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q" event={"ID":"7bd3abc5-8de0-4af1-a1e6-731725122ce6","Type":"ContainerDied","Data":"7f6064c79e589a4facd139d34cc692038e0096af10e63826bb8be17319b45d13"}
Jul 22 17:06:32.493077 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.492997    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q" event={"ID":"7bd3abc5-8de0-4af1-a1e6-731725122ce6","Type":"ContainerDied","Data":"273ef060f0d552f1739209f24927fb154fd04bd38f440b9b65bc9b586eec4deb"}
Jul 22 17:06:32.493077 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.493014    2580 scope.go:117] "RemoveContainer" containerID="7f6064c79e589a4facd139d34cc692038e0096af10e63826bb8be17319b45d13"
Jul 22 17:06:32.501491 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.501472    2580 scope.go:117] "RemoveContainer" containerID="7f6064c79e589a4facd139d34cc692038e0096af10e63826bb8be17319b45d13"
Jul 22 17:06:32.501739 ip-10-0-136-140 kubenswrapper[2580]: E0722 17:06:32.501717    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f6064c79e589a4facd139d34cc692038e0096af10e63826bb8be17319b45d13\": container with ID starting with 7f6064c79e589a4facd139d34cc692038e0096af10e63826bb8be17319b45d13 not found: ID does not exist" containerID="7f6064c79e589a4facd139d34cc692038e0096af10e63826bb8be17319b45d13"
Jul 22 17:06:32.501796 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.501750    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f6064c79e589a4facd139d34cc692038e0096af10e63826bb8be17319b45d13"} err="failed to get container status \"7f6064c79e589a4facd139d34cc692038e0096af10e63826bb8be17319b45d13\": rpc error: code = NotFound desc = could not find container \"7f6064c79e589a4facd139d34cc692038e0096af10e63826bb8be17319b45d13\": container with ID starting with 7f6064c79e589a4facd139d34cc692038e0096af10e63826bb8be17319b45d13 not found: ID does not exist"
Jul 22 17:06:32.510678 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.510652    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"]
Jul 22 17:06:32.514780 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.514757    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/auth-test-model-d6d924-kserve-59b7774879-hrx8q"]
Jul 22 17:06:32.916996 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:32.916943    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj" podUID="8fefadd0-e324-4f3e-8fa2-6923fb692ada" containerName="main" containerID="cri-o://6feb23dc257e6b1abaf271d6f3222c6ee8db2ababde371a7f93d23a32f230d97" gracePeriod=45
Jul 22 17:06:33.159944 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.159915    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:06:33.279523 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.279430    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-dshm\") pod \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") "
Jul 22 17:06:33.279523 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.279472    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-tmp-dir\") pod \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") "
Jul 22 17:06:33.279523 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.279504    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-model-cache\") pod \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") "
Jul 22 17:06:33.279821 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.279530    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5p2j\" (UniqueName: \"kubernetes.io/projected/8fefadd0-e324-4f3e-8fa2-6923fb692ada-kube-api-access-h5p2j\") pod \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") "
Jul 22 17:06:33.279821 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.279564    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fefadd0-e324-4f3e-8fa2-6923fb692ada-tls-certs\") pod \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") "
Jul 22 17:06:33.279821 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.279605    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-home\") pod \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\" (UID: \"8fefadd0-e324-4f3e-8fa2-6923fb692ada\") "
Jul 22 17:06:33.279821 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.279751    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8fefadd0-e324-4f3e-8fa2-6923fb692ada" (UID: "8fefadd0-e324-4f3e-8fa2-6923fb692ada"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:33.280055 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.279840    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-model-cache" (OuterVolumeSpecName: "model-cache") pod "8fefadd0-e324-4f3e-8fa2-6923fb692ada" (UID: "8fefadd0-e324-4f3e-8fa2-6923fb692ada"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:33.280055 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.279907    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-home" (OuterVolumeSpecName: "home") pod "8fefadd0-e324-4f3e-8fa2-6923fb692ada" (UID: "8fefadd0-e324-4f3e-8fa2-6923fb692ada"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:33.280055 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.279978    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-tmp-dir\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:06:33.280055 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.279997    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-model-cache\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:06:33.280055 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.280010    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-home\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:06:33.281748 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.281713    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-dshm" (OuterVolumeSpecName: "dshm") pod "8fefadd0-e324-4f3e-8fa2-6923fb692ada" (UID: "8fefadd0-e324-4f3e-8fa2-6923fb692ada"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:06:33.281869 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.281809    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fefadd0-e324-4f3e-8fa2-6923fb692ada-kube-api-access-h5p2j" (OuterVolumeSpecName: "kube-api-access-h5p2j") pod "8fefadd0-e324-4f3e-8fa2-6923fb692ada" (UID: "8fefadd0-e324-4f3e-8fa2-6923fb692ada"). InnerVolumeSpecName "kube-api-access-h5p2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:06:33.281869 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.281807    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fefadd0-e324-4f3e-8fa2-6923fb692ada-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8fefadd0-e324-4f3e-8fa2-6923fb692ada" (UID: "8fefadd0-e324-4f3e-8fa2-6923fb692ada"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:06:33.381382 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.381343    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5p2j\" (UniqueName: \"kubernetes.io/projected/8fefadd0-e324-4f3e-8fa2-6923fb692ada-kube-api-access-h5p2j\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:06:33.381382 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.381374    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fefadd0-e324-4f3e-8fa2-6923fb692ada-tls-certs\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:06:33.381382 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.381387    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fefadd0-e324-4f3e-8fa2-6923fb692ada-dshm\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:06:33.498920 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.498882    2580 generic.go:356] "Generic (PLEG): container finished" podID="8fefadd0-e324-4f3e-8fa2-6923fb692ada" containerID="6feb23dc257e6b1abaf271d6f3222c6ee8db2ababde371a7f93d23a32f230d97" exitCode=0
Jul 22 17:06:33.499099 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.498925    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"
Jul 22 17:06:33.499099 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.498961    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj" event={"ID":"8fefadd0-e324-4f3e-8fa2-6923fb692ada","Type":"ContainerDied","Data":"6feb23dc257e6b1abaf271d6f3222c6ee8db2ababde371a7f93d23a32f230d97"}
Jul 22 17:06:33.499099 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.499008    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj" event={"ID":"8fefadd0-e324-4f3e-8fa2-6923fb692ada","Type":"ContainerDied","Data":"034e78ca882b5e66083ea045912eb19d42edfb3f0f7c0f3a54c843e09bdb5180"}
Jul 22 17:06:33.499099 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.499035    2580 scope.go:117] "RemoveContainer" containerID="6feb23dc257e6b1abaf271d6f3222c6ee8db2ababde371a7f93d23a32f230d97"
Jul 22 17:06:33.507986 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.507965    2580 scope.go:117] "RemoveContainer" containerID="6feb23dc257e6b1abaf271d6f3222c6ee8db2ababde371a7f93d23a32f230d97"
Jul 22 17:06:33.508300 ip-10-0-136-140 kubenswrapper[2580]: E0722 17:06:33.508281    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6feb23dc257e6b1abaf271d6f3222c6ee8db2ababde371a7f93d23a32f230d97\": container with ID starting with 6feb23dc257e6b1abaf271d6f3222c6ee8db2ababde371a7f93d23a32f230d97 not found: ID does not exist" containerID="6feb23dc257e6b1abaf271d6f3222c6ee8db2ababde371a7f93d23a32f230d97"
Jul 22 17:06:33.508355 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.508310    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6feb23dc257e6b1abaf271d6f3222c6ee8db2ababde371a7f93d23a32f230d97"} err="failed to get container status \"6feb23dc257e6b1abaf271d6f3222c6ee8db2ababde371a7f93d23a32f230d97\": rpc error: code = NotFound desc = could not find container \"6feb23dc257e6b1abaf271d6f3222c6ee8db2ababde371a7f93d23a32f230d97\": container with ID starting with 6feb23dc257e6b1abaf271d6f3222c6ee8db2ababde371a7f93d23a32f230d97 not found: ID does not exist"
Jul 22 17:06:33.521569 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.521540    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"]
Jul 22 17:06:33.526066 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:33.526037    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/auth-test-model-cfb31b-kserve-5b56dcb64c-wm5bj"]
Jul 22 17:06:34.408868 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:34.408833    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bd3abc5-8de0-4af1-a1e6-731725122ce6" path="/var/lib/kubelet/pods/7bd3abc5-8de0-4af1-a1e6-731725122ce6/volumes"
Jul 22 17:06:34.409263 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:34.409248    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fefadd0-e324-4f3e-8fa2-6923fb692ada" path="/var/lib/kubelet/pods/8fefadd0-e324-4f3e-8fa2-6923fb692ada/volumes"
Jul 22 17:06:39.707209 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.707174    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"]
Jul 22 17:06:39.707656 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.707553    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bd3abc5-8de0-4af1-a1e6-731725122ce6" containerName="main"
Jul 22 17:06:39.707656 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.707569    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd3abc5-8de0-4af1-a1e6-731725122ce6" containerName="main"
Jul 22 17:06:39.707656 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.707601    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fefadd0-e324-4f3e-8fa2-6923fb692ada" containerName="main"
Jul 22 17:06:39.707656 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.707607    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fefadd0-e324-4f3e-8fa2-6923fb692ada" containerName="main"
Jul 22 17:06:39.707812 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.707691    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bd3abc5-8de0-4af1-a1e6-731725122ce6" containerName="main"
Jul 22 17:06:39.707812 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.707700    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fefadd0-e324-4f3e-8fa2-6923fb692ada" containerName="main"
Jul 22 17:06:39.712166 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.712148    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.714465 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.714441    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d6d924\"/\"kube-root-ca.crt\""
Jul 22 17:06:39.715253 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.715234    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d6d924\"/\"sub-test-model-d6d924-kserve-self-signed-certs\""
Jul 22 17:06:39.715339 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.715286    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d6d924\"/\"default-dockercfg-tf27g\""
Jul 22 17:06:39.715339 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.715292    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d6d924\"/\"openshift-service-ca.crt\""
Jul 22 17:06:39.719974 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.719949    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"]
Jul 22 17:06:39.835450 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.835404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-home\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.835643 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.835460    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnm2q\" (UniqueName: \"kubernetes.io/projected/c2205233-b9ef-47aa-98d2-4d78e41441d0-kube-api-access-jnm2q\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.835643 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.835545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-model-cache\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.835643 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.835583    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-tmp-dir\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.835643 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.835607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2205233-b9ef-47aa-98d2-4d78e41441d0-tls-certs\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.835799 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.835682    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-dshm\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.936708 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.936664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnm2q\" (UniqueName: \"kubernetes.io/projected/c2205233-b9ef-47aa-98d2-4d78e41441d0-kube-api-access-jnm2q\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.936921 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.936729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-model-cache\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.936921 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.936753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-tmp-dir\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.936921 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.936770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2205233-b9ef-47aa-98d2-4d78e41441d0-tls-certs\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.936921 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.936804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-dshm\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.936921 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.936838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-home\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.937284 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.937260    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-tmp-dir\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.937359 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.937288    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-model-cache\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.937359 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.937315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-home\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.939111 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.939091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-dshm\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.939427 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.939409    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2205233-b9ef-47aa-98d2-4d78e41441d0-tls-certs\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:39.946620 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:39.946596    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnm2q\" (UniqueName: \"kubernetes.io/projected/c2205233-b9ef-47aa-98d2-4d78e41441d0-kube-api-access-jnm2q\") pod \"sub-test-model-d6d924-kserve-5959f8d657-vmkxr\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") " pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:40.022270 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:40.022149    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:40.162136 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:40.162111    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"]
Jul 22 17:06:40.164765 ip-10-0-136-140 kubenswrapper[2580]: W0722 17:06:40.164736    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2205233_b9ef_47aa_98d2_4d78e41441d0.slice/crio-3bd756e303325765a93cfbecf2fc32e4369a38bba656b8bcdea6f6b38fd3e010 WatchSource:0}: Error finding container 3bd756e303325765a93cfbecf2fc32e4369a38bba656b8bcdea6f6b38fd3e010: Status 404 returned error can't find the container with id 3bd756e303325765a93cfbecf2fc32e4369a38bba656b8bcdea6f6b38fd3e010
Jul 22 17:06:40.534473 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:40.534434    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr" event={"ID":"c2205233-b9ef-47aa-98d2-4d78e41441d0","Type":"ContainerStarted","Data":"6c99eb237ea774c0c9a25e28d5499a25ecb30edbe5a02b14f71a4444314d53ce"}
Jul 22 17:06:40.534657 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:40.534484    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr" event={"ID":"c2205233-b9ef-47aa-98d2-4d78e41441d0","Type":"ContainerStarted","Data":"3bd756e303325765a93cfbecf2fc32e4369a38bba656b8bcdea6f6b38fd3e010"}
Jul 22 17:06:40.552033 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:40.551980    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr" podStartSLOduration=1.5519638439999999 podStartE2EDuration="1.551963844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:06:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:06:40.549847258 +0000 UTC m=+2766.742050576" watchObservedRunningTime="2026-07-22 17:06:40.551963844 +0000 UTC m=+2766.744167162"
Jul 22 17:06:43.199570 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:43.199526    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:06:50.022307 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:50.022270    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:50.022776 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:50.022330    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:50.035426 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:50.035395    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:06:50.594791 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:06:50.594762    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:07:00.192964 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.192879    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"]
Jul 22 17:07:00.196357 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.196337    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.198478 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.198438    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cfb31b\"/\"kube-root-ca.crt\""
Jul 22 17:07:00.198675 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.198651    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cfb31b\"/\"openshift-service-ca.crt\""
Jul 22 17:07:00.199430 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.199411    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cfb31b\"/\"sub-test-model-cfb31b-kserve-self-signed-certs\""
Jul 22 17:07:00.199430 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.199425    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cfb31b\"/\"default-dockercfg-86p4t\""
Jul 22 17:07:00.206416 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.206391    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"]
Jul 22 17:07:00.288198 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.288159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-model-cache\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.288198 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.288201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kcj2\" (UniqueName: \"kubernetes.io/projected/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-kube-api-access-6kcj2\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.288441 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.288291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-tls-certs\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.288441 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.288382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-dshm\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.288441 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.288407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-home\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.288441 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.288428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-tmp-dir\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.389605 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.389566    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-dshm\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.389776 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.389609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-home\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.389776 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.389647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-tmp-dir\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.389776 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.389689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-model-cache\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.389776 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.389722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kcj2\" (UniqueName: \"kubernetes.io/projected/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-kube-api-access-6kcj2\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.389974 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.389865    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-tls-certs\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.390099 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.390075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-model-cache\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.390099 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.390093    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-home\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.390240 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.390153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-tmp-dir\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.391962 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.391934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-dshm\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.392307 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.392287    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-tls-certs\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.400131 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.400109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kcj2\" (UniqueName: \"kubernetes.io/projected/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-kube-api-access-6kcj2\") pod \"sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") " pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.506772 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.506676    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:00.646302 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:00.646275    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"]
Jul 22 17:07:00.648588 ip-10-0-136-140 kubenswrapper[2580]: W0722 17:07:00.648555    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdc9e8c5_9f28_4f48_bba0_6ff56fa1599f.slice/crio-43e786503f38cbec450db08fe69e15bac2950fde08fecd33069ba200f6b2cfe9 WatchSource:0}: Error finding container 43e786503f38cbec450db08fe69e15bac2950fde08fecd33069ba200f6b2cfe9: Status 404 returned error can't find the container with id 43e786503f38cbec450db08fe69e15bac2950fde08fecd33069ba200f6b2cfe9
Jul 22 17:07:01.637609 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:01.637572    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df" event={"ID":"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f","Type":"ContainerStarted","Data":"f762f3709c67ab772854e732250e0339cfa02773d92aa5ff637aaa5bae01eaf4"}
Jul 22 17:07:01.637609 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:01.637615    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df" event={"ID":"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f","Type":"ContainerStarted","Data":"43e786503f38cbec450db08fe69e15bac2950fde08fecd33069ba200f6b2cfe9"}
Jul 22 17:07:01.656680 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:01.656607    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df" podStartSLOduration=1.6565840280000002 podStartE2EDuration="1.656584028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:07:01.655904053 +0000 UTC m=+2787.848107374" watchObservedRunningTime="2026-07-22 17:07:01.656584028 +0000 UTC m=+2787.848787350"
Jul 22 17:07:04.093988 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:04.093944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:07:10.506832 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:10.506792    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:10.506832 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:10.506840    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:10.519692 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:10.519662    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:10.690656 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:10.690617    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:07:28.300449 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:28.300407    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:07:45.597271 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:45.597230    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:07:52.802500 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:52.802459    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"]
Jul 22 17:07:53.604418 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:07:53.604385    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"]
Jul 22 17:08:04.791040 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:04.791006    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:08:07.823491 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:07.823416    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr" podUID="c2205233-b9ef-47aa-98d2-4d78e41441d0" containerName="main" containerID="cri-o://6c99eb237ea774c0c9a25e28d5499a25ecb30edbe5a02b14f71a4444314d53ce" gracePeriod=45
Jul 22 17:08:07.965928 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:07.965893    2580 generic.go:356] "Generic (PLEG): container finished" podID="c2205233-b9ef-47aa-98d2-4d78e41441d0" containerID="6c99eb237ea774c0c9a25e28d5499a25ecb30edbe5a02b14f71a4444314d53ce" exitCode=0
Jul 22 17:08:07.965928 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:07.965933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr" event={"ID":"c2205233-b9ef-47aa-98d2-4d78e41441d0","Type":"ContainerDied","Data":"6c99eb237ea774c0c9a25e28d5499a25ecb30edbe5a02b14f71a4444314d53ce"}
Jul 22 17:08:08.069912 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.069883    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:08:08.208880 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.208847    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-model-cache\") pod \"c2205233-b9ef-47aa-98d2-4d78e41441d0\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") "
Jul 22 17:08:08.208880 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.208881    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-tmp-dir\") pod \"c2205233-b9ef-47aa-98d2-4d78e41441d0\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") "
Jul 22 17:08:08.209126 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.208931    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnm2q\" (UniqueName: \"kubernetes.io/projected/c2205233-b9ef-47aa-98d2-4d78e41441d0-kube-api-access-jnm2q\") pod \"c2205233-b9ef-47aa-98d2-4d78e41441d0\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") "
Jul 22 17:08:08.209126 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.208966    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-dshm\") pod \"c2205233-b9ef-47aa-98d2-4d78e41441d0\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") "
Jul 22 17:08:08.209126 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.208989    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-home\") pod \"c2205233-b9ef-47aa-98d2-4d78e41441d0\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") "
Jul 22 17:08:08.209126 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.209021    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2205233-b9ef-47aa-98d2-4d78e41441d0-tls-certs\") pod \"c2205233-b9ef-47aa-98d2-4d78e41441d0\" (UID: \"c2205233-b9ef-47aa-98d2-4d78e41441d0\") "
Jul 22 17:08:08.209380 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.209199    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c2205233-b9ef-47aa-98d2-4d78e41441d0" (UID: "c2205233-b9ef-47aa-98d2-4d78e41441d0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:08.209380 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.209203    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-model-cache" (OuterVolumeSpecName: "model-cache") pod "c2205233-b9ef-47aa-98d2-4d78e41441d0" (UID: "c2205233-b9ef-47aa-98d2-4d78e41441d0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:08.209380 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.209346    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-home" (OuterVolumeSpecName: "home") pod "c2205233-b9ef-47aa-98d2-4d78e41441d0" (UID: "c2205233-b9ef-47aa-98d2-4d78e41441d0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:08.211306 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.211276    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2205233-b9ef-47aa-98d2-4d78e41441d0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c2205233-b9ef-47aa-98d2-4d78e41441d0" (UID: "c2205233-b9ef-47aa-98d2-4d78e41441d0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:08:08.211425 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.211309    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-dshm" (OuterVolumeSpecName: "dshm") pod "c2205233-b9ef-47aa-98d2-4d78e41441d0" (UID: "c2205233-b9ef-47aa-98d2-4d78e41441d0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:08.211425 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.211332    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2205233-b9ef-47aa-98d2-4d78e41441d0-kube-api-access-jnm2q" (OuterVolumeSpecName: "kube-api-access-jnm2q") pod "c2205233-b9ef-47aa-98d2-4d78e41441d0" (UID: "c2205233-b9ef-47aa-98d2-4d78e41441d0"). InnerVolumeSpecName "kube-api-access-jnm2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:08:08.310051 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.310019    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2205233-b9ef-47aa-98d2-4d78e41441d0-tls-certs\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:08:08.310051 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.310048    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-model-cache\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:08:08.310051 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.310057    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-tmp-dir\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:08:08.310320 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.310066    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnm2q\" (UniqueName: \"kubernetes.io/projected/c2205233-b9ef-47aa-98d2-4d78e41441d0-kube-api-access-jnm2q\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:08:08.310320 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.310076    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-dshm\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:08:08.310320 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.310085    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2205233-b9ef-47aa-98d2-4d78e41441d0-home\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:08:08.624550 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.624490    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df" podUID="fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f" containerName="main" containerID="cri-o://f762f3709c67ab772854e732250e0339cfa02773d92aa5ff637aaa5bae01eaf4" gracePeriod=45
Jul 22 17:08:08.882132 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.882059    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:08:08.971644 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.971612    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"
Jul 22 17:08:08.971854 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.971651    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr" event={"ID":"c2205233-b9ef-47aa-98d2-4d78e41441d0","Type":"ContainerDied","Data":"3bd756e303325765a93cfbecf2fc32e4369a38bba656b8bcdea6f6b38fd3e010"}
Jul 22 17:08:08.971854 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.971714    2580 scope.go:117] "RemoveContainer" containerID="6c99eb237ea774c0c9a25e28d5499a25ecb30edbe5a02b14f71a4444314d53ce"
Jul 22 17:08:08.973201 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.973172    2580 generic.go:356] "Generic (PLEG): container finished" podID="fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f" containerID="f762f3709c67ab772854e732250e0339cfa02773d92aa5ff637aaa5bae01eaf4" exitCode=0
Jul 22 17:08:08.973342 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.973210    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"
Jul 22 17:08:08.973342 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.973321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df" event={"ID":"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f","Type":"ContainerDied","Data":"f762f3709c67ab772854e732250e0339cfa02773d92aa5ff637aaa5bae01eaf4"}
Jul 22 17:08:08.973451 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.973357    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df" event={"ID":"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f","Type":"ContainerDied","Data":"43e786503f38cbec450db08fe69e15bac2950fde08fecd33069ba200f6b2cfe9"}
Jul 22 17:08:08.980396 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.980377    2580 scope.go:117] "RemoveContainer" containerID="f762f3709c67ab772854e732250e0339cfa02773d92aa5ff637aaa5bae01eaf4"
Jul 22 17:08:08.988051 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.988032    2580 scope.go:117] "RemoveContainer" containerID="f762f3709c67ab772854e732250e0339cfa02773d92aa5ff637aaa5bae01eaf4"
Jul 22 17:08:08.988320 ip-10-0-136-140 kubenswrapper[2580]: E0722 17:08:08.988300    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f762f3709c67ab772854e732250e0339cfa02773d92aa5ff637aaa5bae01eaf4\": container with ID starting with f762f3709c67ab772854e732250e0339cfa02773d92aa5ff637aaa5bae01eaf4 not found: ID does not exist" containerID="f762f3709c67ab772854e732250e0339cfa02773d92aa5ff637aaa5bae01eaf4"
Jul 22 17:08:08.988371 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.988330    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f762f3709c67ab772854e732250e0339cfa02773d92aa5ff637aaa5bae01eaf4"} err="failed to get container status \"f762f3709c67ab772854e732250e0339cfa02773d92aa5ff637aaa5bae01eaf4\": rpc error: code = NotFound desc = could not find container \"f762f3709c67ab772854e732250e0339cfa02773d92aa5ff637aaa5bae01eaf4\": container with ID starting with f762f3709c67ab772854e732250e0339cfa02773d92aa5ff637aaa5bae01eaf4 not found: ID does not exist"
Jul 22 17:08:08.993985 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:08.993960    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"]
Jul 22 17:08:09.002395 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.002375    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/sub-test-model-d6d924-kserve-5959f8d657-vmkxr"]
Jul 22 17:08:09.016750 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.016727    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-dshm\") pod \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") "
Jul 22 17:08:09.016863 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.016798    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-tmp-dir\") pod \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") "
Jul 22 17:08:09.016863 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.016823    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-model-cache\") pod \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") "
Jul 22 17:08:09.016863 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.016846    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-tls-certs\") pod \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") "
Jul 22 17:08:09.017026 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.016903    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kcj2\" (UniqueName: \"kubernetes.io/projected/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-kube-api-access-6kcj2\") pod \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") "
Jul 22 17:08:09.017026 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.016928    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-home\") pod \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\" (UID: \"fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f\") "
Jul 22 17:08:09.017125 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.017035    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f" (UID: "fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:09.017184 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.017146    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-model-cache" (OuterVolumeSpecName: "model-cache") pod "fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f" (UID: "fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:09.017276 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.017255    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-home" (OuterVolumeSpecName: "home") pod "fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f" (UID: "fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:09.017276 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.017268    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-tmp-dir\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:08:09.017361 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.017287    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-model-cache\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:08:09.018960 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.018928    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-dshm" (OuterVolumeSpecName: "dshm") pod "fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f" (UID: "fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:08:09.019053 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.018953    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f" (UID: "fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:08:09.019053 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.019011    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-kube-api-access-6kcj2" (OuterVolumeSpecName: "kube-api-access-6kcj2") pod "fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f" (UID: "fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f"). InnerVolumeSpecName "kube-api-access-6kcj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:08:09.118577 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.118535    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-tls-certs\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:08:09.118577 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.118570    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kcj2\" (UniqueName: \"kubernetes.io/projected/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-kube-api-access-6kcj2\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:08:09.118577 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.118579    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-home\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:08:09.118577 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.118588    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f-dshm\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:08:09.295475 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.295442    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"]
Jul 22 17:08:09.298046 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:09.298020    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/sub-test-model-cfb31b-kserve-84d5fbf6fc-jb8df"]
Jul 22 17:08:10.408880 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:10.408835    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2205233-b9ef-47aa-98d2-4d78e41441d0" path="/var/lib/kubelet/pods/c2205233-b9ef-47aa-98d2-4d78e41441d0/volumes"
Jul 22 17:08:10.409471 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:10.409450    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f" path="/var/lib/kubelet/pods/fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f/volumes"
Jul 22 17:08:34.473108 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:34.473074    2580 scope.go:117] "RemoveContainer" containerID="58c426da627b29b0d99c69c740970f32c10643655483a0fe8abff2e9e6078b9e"
Jul 22 17:08:34.481263 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:34.481243    2580 scope.go:117] "RemoveContainer" containerID="dc579a63b222c6b54828c370de8642000be0d32fdd3977c0184a8ef83fc5a15b"
Jul 22 17:08:51.394113 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.394080    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"]
Jul 22 17:08:51.394560 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.394434    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2205233-b9ef-47aa-98d2-4d78e41441d0" containerName="main"
Jul 22 17:08:51.394560 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.394446    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2205233-b9ef-47aa-98d2-4d78e41441d0" containerName="main"
Jul 22 17:08:51.394560 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.394462    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f" containerName="main"
Jul 22 17:08:51.394560 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.394468    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f" containerName="main"
Jul 22 17:08:51.394560 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.394529    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2205233-b9ef-47aa-98d2-4d78e41441d0" containerName="main"
Jul 22 17:08:51.394560 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.394541    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdc9e8c5-9f28-4f48-bba0-6ff56fa1599f" containerName="main"
Jul 22 17:08:51.397428 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.397411    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.399633 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.399606    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cfb31b\"/\"kube-root-ca.crt\""
Jul 22 17:08:51.400508 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.400479    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cfb31b\"/\"openshift-service-ca.crt\""
Jul 22 17:08:51.400613 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.400570    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cfb31b\"/\"rate-test-model-cfb31b-kserve-self-signed-certs\""
Jul 22 17:08:51.400683 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.400670    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cfb31b\"/\"default-dockercfg-86p4t\""
Jul 22 17:08:51.406849 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.406826    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"]
Jul 22 17:08:51.489396 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.489360    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-model-cache\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.489396 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.489396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-tmp-dir\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.489679 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.489423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-home\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.489679 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.489537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk2bc\" (UniqueName: \"kubernetes.io/projected/8ab86956-8a0c-4149-9320-18b6c716594f-kube-api-access-qk2bc\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.489679 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.489607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-dshm\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.489679 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.489654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ab86956-8a0c-4149-9320-18b6c716594f-tls-certs\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.591154 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.591118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk2bc\" (UniqueName: \"kubernetes.io/projected/8ab86956-8a0c-4149-9320-18b6c716594f-kube-api-access-qk2bc\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.591373 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.591181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-dshm\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.591373 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.591215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ab86956-8a0c-4149-9320-18b6c716594f-tls-certs\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.591373 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.591298    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-model-cache\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.591373 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.591324    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-tmp-dir\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.591614 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.591578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-home\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.591742 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.591725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-model-cache\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.591790 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.591767    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-tmp-dir\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.591903 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.591882    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-home\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.593529 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.593502    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-dshm\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.593788 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.593767    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ab86956-8a0c-4149-9320-18b6c716594f-tls-certs\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.601960 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.601939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk2bc\" (UniqueName: \"kubernetes.io/projected/8ab86956-8a0c-4149-9320-18b6c716594f-kube-api-access-qk2bc\") pod \"rate-test-model-cfb31b-kserve-b64b466cf-vrzrq\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") " pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.707924 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.707839    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:08:51.839810 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:51.839650    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"]
Jul 22 17:08:51.841988 ip-10-0-136-140 kubenswrapper[2580]: W0722 17:08:51.841960    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ab86956_8a0c_4149_9320_18b6c716594f.slice/crio-00850fa1c5db9e10ec7033d050fbc5ffe813227f4cf1a96a53a58b0f3935bc42 WatchSource:0}: Error finding container 00850fa1c5db9e10ec7033d050fbc5ffe813227f4cf1a96a53a58b0f3935bc42: Status 404 returned error can't find the container with id 00850fa1c5db9e10ec7033d050fbc5ffe813227f4cf1a96a53a58b0f3935bc42
Jul 22 17:08:52.175216 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:52.175176    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq" event={"ID":"8ab86956-8a0c-4149-9320-18b6c716594f","Type":"ContainerStarted","Data":"4bf86c9f2134a88f29b1bb9deb503bd7b6ce3e3db5f61dc2262ae284d04ae12b"}
Jul 22 17:08:52.175216 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:52.175243    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq" event={"ID":"8ab86956-8a0c-4149-9320-18b6c716594f","Type":"ContainerStarted","Data":"00850fa1c5db9e10ec7033d050fbc5ffe813227f4cf1a96a53a58b0f3935bc42"}
Jul 22 17:08:52.198262 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:52.198191    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq" podStartSLOduration=1.198175292 podStartE2EDuration="1.198175292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:08:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:08:52.196634744 +0000 UTC m=+2898.388838060" watchObservedRunningTime="2026-07-22 17:08:52.198175292 +0000 UTC m=+2898.390378680"
Jul 22 17:08:54.987014 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:08:54.986973    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:09:01.708896 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:01.708862    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:09:01.709412 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:01.708912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:09:01.721359 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:01.721326    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:09:02.231360 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:02.231333    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:09:13.893437 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:13.893397    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:09:29.194427 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:29.194389    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:09:36.803356 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:36.803313    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"]
Jul 22 17:09:49.192547 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:49.192505    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:09:51.823096 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:51.823052    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq" podUID="8ab86956-8a0c-4149-9320-18b6c716594f" containerName="main" containerID="cri-o://4bf86c9f2134a88f29b1bb9deb503bd7b6ce3e3db5f61dc2262ae284d04ae12b" gracePeriod=45
Jul 22 17:09:52.072507 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.072481    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:09:52.231153 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.231122    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-tmp-dir\") pod \"8ab86956-8a0c-4149-9320-18b6c716594f\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") "
Jul 22 17:09:52.231324 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.231182    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-model-cache\") pod \"8ab86956-8a0c-4149-9320-18b6c716594f\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") "
Jul 22 17:09:52.231324 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.231243    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-dshm\") pod \"8ab86956-8a0c-4149-9320-18b6c716594f\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") "
Jul 22 17:09:52.231324 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.231289    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qk2bc\" (UniqueName: \"kubernetes.io/projected/8ab86956-8a0c-4149-9320-18b6c716594f-kube-api-access-qk2bc\") pod \"8ab86956-8a0c-4149-9320-18b6c716594f\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") "
Jul 22 17:09:52.231324 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.231321    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ab86956-8a0c-4149-9320-18b6c716594f-tls-certs\") pod \"8ab86956-8a0c-4149-9320-18b6c716594f\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") "
Jul 22 17:09:52.231489 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.231386    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-home\") pod \"8ab86956-8a0c-4149-9320-18b6c716594f\" (UID: \"8ab86956-8a0c-4149-9320-18b6c716594f\") "
Jul 22 17:09:52.231536 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.231474    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-model-cache" (OuterVolumeSpecName: "model-cache") pod "8ab86956-8a0c-4149-9320-18b6c716594f" (UID: "8ab86956-8a0c-4149-9320-18b6c716594f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:09:52.231536 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.231484    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8ab86956-8a0c-4149-9320-18b6c716594f" (UID: "8ab86956-8a0c-4149-9320-18b6c716594f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:09:52.231672 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.231651    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-model-cache\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:09:52.231672 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.231674    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-tmp-dir\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:09:52.231867 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.231689    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-home" (OuterVolumeSpecName: "home") pod "8ab86956-8a0c-4149-9320-18b6c716594f" (UID: "8ab86956-8a0c-4149-9320-18b6c716594f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:09:52.233445 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.233417    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-dshm" (OuterVolumeSpecName: "dshm") pod "8ab86956-8a0c-4149-9320-18b6c716594f" (UID: "8ab86956-8a0c-4149-9320-18b6c716594f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 17:09:52.233445 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.233427    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ab86956-8a0c-4149-9320-18b6c716594f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8ab86956-8a0c-4149-9320-18b6c716594f" (UID: "8ab86956-8a0c-4149-9320-18b6c716594f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 17:09:52.233560 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.233451    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ab86956-8a0c-4149-9320-18b6c716594f-kube-api-access-qk2bc" (OuterVolumeSpecName: "kube-api-access-qk2bc") pod "8ab86956-8a0c-4149-9320-18b6c716594f" (UID: "8ab86956-8a0c-4149-9320-18b6c716594f"). InnerVolumeSpecName "kube-api-access-qk2bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 17:09:52.332981 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.332944    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ab86956-8a0c-4149-9320-18b6c716594f-tls-certs\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:09:52.332981 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.332975    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-home\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:09:52.332981 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.332983    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ab86956-8a0c-4149-9320-18b6c716594f-dshm\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:09:52.332981 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.332991    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk2bc\" (UniqueName: \"kubernetes.io/projected/8ab86956-8a0c-4149-9320-18b6c716594f-kube-api-access-qk2bc\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:09:52.451550 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.451520    2580 generic.go:356] "Generic (PLEG): container finished" podID="8ab86956-8a0c-4149-9320-18b6c716594f" containerID="4bf86c9f2134a88f29b1bb9deb503bd7b6ce3e3db5f61dc2262ae284d04ae12b" exitCode=0
Jul 22 17:09:52.451704 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.451564    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"
Jul 22 17:09:52.451704 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.451596    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq" event={"ID":"8ab86956-8a0c-4149-9320-18b6c716594f","Type":"ContainerDied","Data":"4bf86c9f2134a88f29b1bb9deb503bd7b6ce3e3db5f61dc2262ae284d04ae12b"}
Jul 22 17:09:52.451704 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.451641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq" event={"ID":"8ab86956-8a0c-4149-9320-18b6c716594f","Type":"ContainerDied","Data":"00850fa1c5db9e10ec7033d050fbc5ffe813227f4cf1a96a53a58b0f3935bc42"}
Jul 22 17:09:52.451704 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.451663    2580 scope.go:117] "RemoveContainer" containerID="4bf86c9f2134a88f29b1bb9deb503bd7b6ce3e3db5f61dc2262ae284d04ae12b"
Jul 22 17:09:52.460079 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.460061    2580 scope.go:117] "RemoveContainer" containerID="4bf86c9f2134a88f29b1bb9deb503bd7b6ce3e3db5f61dc2262ae284d04ae12b"
Jul 22 17:09:52.460335 ip-10-0-136-140 kubenswrapper[2580]: E0722 17:09:52.460316    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bf86c9f2134a88f29b1bb9deb503bd7b6ce3e3db5f61dc2262ae284d04ae12b\": container with ID starting with 4bf86c9f2134a88f29b1bb9deb503bd7b6ce3e3db5f61dc2262ae284d04ae12b not found: ID does not exist" containerID="4bf86c9f2134a88f29b1bb9deb503bd7b6ce3e3db5f61dc2262ae284d04ae12b"
Jul 22 17:09:52.460391 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.460349    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bf86c9f2134a88f29b1bb9deb503bd7b6ce3e3db5f61dc2262ae284d04ae12b"} err="failed to get container status \"4bf86c9f2134a88f29b1bb9deb503bd7b6ce3e3db5f61dc2262ae284d04ae12b\": rpc error: code = NotFound desc = could not find container \"4bf86c9f2134a88f29b1bb9deb503bd7b6ce3e3db5f61dc2262ae284d04ae12b\": container with ID starting with 4bf86c9f2134a88f29b1bb9deb503bd7b6ce3e3db5f61dc2262ae284d04ae12b not found: ID does not exist"
Jul 22 17:09:52.468863 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.468839    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"]
Jul 22 17:09:52.474774 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:52.474753    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-cfb31b/rate-test-model-cfb31b-kserve-b64b466cf-vrzrq"]
Jul 22 17:09:54.409023 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:54.408986    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ab86956-8a0c-4149-9320-18b6c716594f" path="/var/lib/kubelet/pods/8ab86956-8a0c-4149-9320-18b6c716594f/volumes"
Jul 22 17:09:56.680437 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:56.680343    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8"]
Jul 22 17:09:56.681001 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:56.680855    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab86956-8a0c-4149-9320-18b6c716594f" containerName="main"
Jul 22 17:09:56.681001 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:56.680878    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab86956-8a0c-4149-9320-18b6c716594f" containerName="main"
Jul 22 17:09:56.681001 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:56.680974    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ab86956-8a0c-4149-9320-18b6c716594f" containerName="main"
Jul 22 17:09:56.685209 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:56.685186    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8"
Jul 22 17:09:56.687504 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:56.687478    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xmwmv\""
Jul 22 17:09:56.687622 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:56.687553    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 17:09:56.691917 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:56.691896    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8"]
Jul 22 17:09:56.773976 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:56.773944    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6adb4f4a-7a24-4114-8b2b-ee0493634872-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8\" (UID: \"6adb4f4a-7a24-4114-8b2b-ee0493634872\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8"
Jul 22 17:09:56.875140 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:56.875103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6adb4f4a-7a24-4114-8b2b-ee0493634872-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8\" (UID: \"6adb4f4a-7a24-4114-8b2b-ee0493634872\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8"
Jul 22 17:09:56.875825 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:56.875796    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6adb4f4a-7a24-4114-8b2b-ee0493634872-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8\" (UID: \"6adb4f4a-7a24-4114-8b2b-ee0493634872\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8"
Jul 22 17:09:56.996376 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:56.996293    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8"
Jul 22 17:09:57.129563 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:57.129534    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8"]
Jul 22 17:09:57.132079 ip-10-0-136-140 kubenswrapper[2580]: W0722 17:09:57.132041    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6adb4f4a_7a24_4114_8b2b_ee0493634872.slice/crio-58453c49fc3dd2987b732bb9351a9d9068f51e2161f5432ef2c32f9345188952 WatchSource:0}: Error finding container 58453c49fc3dd2987b732bb9351a9d9068f51e2161f5432ef2c32f9345188952: Status 404 returned error can't find the container with id 58453c49fc3dd2987b732bb9351a9d9068f51e2161f5432ef2c32f9345188952
Jul 22 17:09:57.476856 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:57.476822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8" event={"ID":"6adb4f4a-7a24-4114-8b2b-ee0493634872","Type":"ContainerStarted","Data":"3222829e68a7620fee78c9b63a427eca23acd1d5c7c84b1ee9f3422515970cd0"}
Jul 22 17:09:57.477019 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:57.476880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8" event={"ID":"6adb4f4a-7a24-4114-8b2b-ee0493634872","Type":"ContainerStarted","Data":"58453c49fc3dd2987b732bb9351a9d9068f51e2161f5432ef2c32f9345188952"}
Jul 22 17:09:57.493372 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:57.493321    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8" podStartSLOduration=1.493307103 podStartE2EDuration="1.493307103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:09:57.491827109 +0000 UTC m=+2963.684030453" watchObservedRunningTime="2026-07-22 17:09:57.493307103 +0000 UTC m=+2963.685510421"
Jul 22 17:09:58.482236 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:58.482194    2580 generic.go:356] "Generic (PLEG): container finished" podID="6adb4f4a-7a24-4114-8b2b-ee0493634872" containerID="3222829e68a7620fee78c9b63a427eca23acd1d5c7c84b1ee9f3422515970cd0" exitCode=0
Jul 22 17:09:58.482641 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:58.482279    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8" event={"ID":"6adb4f4a-7a24-4114-8b2b-ee0493634872","Type":"ContainerDied","Data":"3222829e68a7620fee78c9b63a427eca23acd1d5c7c84b1ee9f3422515970cd0"}
Jul 22 17:09:59.620455 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:59.620427    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8"
Jul 22 17:09:59.800881 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:59.800787    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6adb4f4a-7a24-4114-8b2b-ee0493634872-maas-api-service-ca\") pod \"6adb4f4a-7a24-4114-8b2b-ee0493634872\" (UID: \"6adb4f4a-7a24-4114-8b2b-ee0493634872\") "
Jul 22 17:09:59.801163 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:59.801139    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6adb4f4a-7a24-4114-8b2b-ee0493634872-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6adb4f4a-7a24-4114-8b2b-ee0493634872" (UID: "6adb4f4a-7a24-4114-8b2b-ee0493634872"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:09:59.902322 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:09:59.902281    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6adb4f4a-7a24-4114-8b2b-ee0493634872-maas-api-service-ca\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:10:00.492193 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:00.492161    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8"
Jul 22 17:10:00.492377 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:00.492167    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8" event={"ID":"6adb4f4a-7a24-4114-8b2b-ee0493634872","Type":"ContainerDied","Data":"58453c49fc3dd2987b732bb9351a9d9068f51e2161f5432ef2c32f9345188952"}
Jul 22 17:10:00.492377 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:00.492275    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58453c49fc3dd2987b732bb9351a9d9068f51e2161f5432ef2c32f9345188952"
Jul 22 17:10:10.097101 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:10.097064    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:10:11.773141 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:11.773105    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8"]
Jul 22 17:10:11.775700 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:11.775674    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d6d924-ddwr8"]
Jul 22 17:10:12.408758 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:12.408722    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6adb4f4a-7a24-4114-8b2b-ee0493634872" path="/var/lib/kubelet/pods/6adb4f4a-7a24-4114-8b2b-ee0493634872/volumes"
Jul 22 17:10:19.436004 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:19.435970    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg"]
Jul 22 17:10:19.436423 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:19.436317    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6adb4f4a-7a24-4114-8b2b-ee0493634872" containerName="revoke-keys"
Jul 22 17:10:19.436423 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:19.436330    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6adb4f4a-7a24-4114-8b2b-ee0493634872" containerName="revoke-keys"
Jul 22 17:10:19.436423 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:19.436399    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6adb4f4a-7a24-4114-8b2b-ee0493634872" containerName="revoke-keys"
Jul 22 17:10:19.439254 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:19.439216    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg"
Jul 22 17:10:19.441366 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:19.441343    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 17:10:19.441473 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:19.441402    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xmwmv\""
Jul 22 17:10:19.448959 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:19.448937    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg"]
Jul 22 17:10:19.493448 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:19.493408    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca684728-fb75-4c2e-ac7c-cabe6e4de652-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg\" (UID: \"ca684728-fb75-4c2e-ac7c-cabe6e4de652\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg"
Jul 22 17:10:19.594517 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:19.594485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca684728-fb75-4c2e-ac7c-cabe6e4de652-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg\" (UID: \"ca684728-fb75-4c2e-ac7c-cabe6e4de652\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg"
Jul 22 17:10:19.595079 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:19.595060    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca684728-fb75-4c2e-ac7c-cabe6e4de652-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg\" (UID: \"ca684728-fb75-4c2e-ac7c-cabe6e4de652\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg"
Jul 22 17:10:19.750362 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:19.750290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg"
Jul 22 17:10:19.877351 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:19.877313    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg"]
Jul 22 17:10:19.880743 ip-10-0-136-140 kubenswrapper[2580]: W0722 17:10:19.880713    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca684728_fb75_4c2e_ac7c_cabe6e4de652.slice/crio-d4aa619dd7120d909799bce5c49173747d555b70815f99636cf44a9eee157685 WatchSource:0}: Error finding container d4aa619dd7120d909799bce5c49173747d555b70815f99636cf44a9eee157685: Status 404 returned error can't find the container with id d4aa619dd7120d909799bce5c49173747d555b70815f99636cf44a9eee157685
Jul 22 17:10:20.583102 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:20.583073    2580 generic.go:356] "Generic (PLEG): container finished" podID="ca684728-fb75-4c2e-ac7c-cabe6e4de652" containerID="9558d9da5b04fe4b4cb0a01b0beec45f07a80b1e97b7a840c75c84084dfb4a4f" exitCode=0
Jul 22 17:10:20.583459 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:20.583142    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg" event={"ID":"ca684728-fb75-4c2e-ac7c-cabe6e4de652","Type":"ContainerDied","Data":"9558d9da5b04fe4b4cb0a01b0beec45f07a80b1e97b7a840c75c84084dfb4a4f"}
Jul 22 17:10:20.583459 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:20.583197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg" event={"ID":"ca684728-fb75-4c2e-ac7c-cabe6e4de652","Type":"ContainerStarted","Data":"d4aa619dd7120d909799bce5c49173747d555b70815f99636cf44a9eee157685"}
Jul 22 17:10:21.717465 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:21.717441    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg"
Jul 22 17:10:21.813019 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:21.812979    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca684728-fb75-4c2e-ac7c-cabe6e4de652-maas-api-service-ca\") pod \"ca684728-fb75-4c2e-ac7c-cabe6e4de652\" (UID: \"ca684728-fb75-4c2e-ac7c-cabe6e4de652\") "
Jul 22 17:10:21.813347 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:21.813326    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca684728-fb75-4c2e-ac7c-cabe6e4de652-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ca684728-fb75-4c2e-ac7c-cabe6e4de652" (UID: "ca684728-fb75-4c2e-ac7c-cabe6e4de652"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 17:10:21.913803 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:21.913779    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca684728-fb75-4c2e-ac7c-cabe6e4de652-maas-api-service-ca\") on node \"ip-10-0-136-140.ec2.internal\" DevicePath \"\""
Jul 22 17:10:22.593560 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:22.593530    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg"
Jul 22 17:10:22.593746 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:22.593539    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg" event={"ID":"ca684728-fb75-4c2e-ac7c-cabe6e4de652","Type":"ContainerDied","Data":"d4aa619dd7120d909799bce5c49173747d555b70815f99636cf44a9eee157685"}
Jul 22 17:10:22.593746 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:22.593664    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4aa619dd7120d909799bce5c49173747d555b70815f99636cf44a9eee157685"
Jul 22 17:10:32.791190 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:32.791145    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lxchf"]
Jul 22 17:10:34.531617 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:34.531589    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg"]
Jul 22 17:10:34.534639 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:34.534611    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-cfb31b-774cg"]
Jul 22 17:10:35.457602 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:35.457575    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 17:10:35.463488 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:35.463466    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 17:10:36.408499 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:36.408465    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca684728-fb75-4c2e-ac7c-cabe6e4de652" path="/var/lib/kubelet/pods/ca684728-fb75-4c2e-ac7c-cabe6e4de652/volumes"
Jul 22 17:10:49.000911 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:49.000881    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cb6494f8-ckzld_7c3fb72a-404b-41a7-b8b2-bec416ea307e/copy-manifests/0.log"
Jul 22 17:10:49.008458 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:49.008419    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cb6494f8-ckzld_7c3fb72a-404b-41a7-b8b2-bec416ea307e/manager/0.log"
Jul 22 17:10:51.826117 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:51.826081    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tmg7t_79820e13-5f21-4e1c-adf5-b9d18914a15c/manager/0.log"
Jul 22 17:10:51.949128 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:51.949096    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pxwrz_9019f343-cf47-45f1-9690-98a0f033a951/kuadrant-console-plugin/0.log"
Jul 22 17:10:52.384326 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:52.384293    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lxchf_026a5e34-7776-4992-84f9-6eb7ad063e63/limitador/0.log"
Jul 22 17:10:53.306300 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:53.306265    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-788547964b-pn7d7_eac28e04-a397-4df2-8d39-1a1c95d2413d/kube-auth-proxy/0.log"
Jul 22 17:10:54.406660 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:54.406608    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-zrvxz_1fb998b5-cc8d-4c10-9bfa-5983a4822d3e/main/0.log"
Jul 22 17:10:54.779104 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:54.779013    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-f4n62_7c94be51-e6d7-495e-ab62-887253e5bb53/main/0.log"
Jul 22 17:10:54.894349 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:10:54.894319    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-xlhpd_b6200a9a-ccd6-4b0b-9376-9778210d88d0/main/0.log"
Jul 22 17:11:04.528158 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:04.528103    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9xxgw_1e45ac08-35b3-438f-8cbf-aa2f8f4950c3/global-pull-secret-syncer/0.log"
Jul 22 17:11:04.927061 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:04.927006    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vbrfq_73b2362e-2c49-4a00-aaa8-0e1bb2203a52/konnectivity-agent/0.log"
Jul 22 17:11:05.085269 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:05.085206    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-140.ec2.internal_0914649e35306a68df1632ae34f49b6b/haproxy/0.log"
Jul 22 17:11:10.909832 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:10.909802    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tmg7t_79820e13-5f21-4e1c-adf5-b9d18914a15c/manager/0.log"
Jul 22 17:11:10.951605 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:10.951578    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pxwrz_9019f343-cf47-45f1-9690-98a0f033a951/kuadrant-console-plugin/0.log"
Jul 22 17:11:11.269622 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:11.269594    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lxchf_026a5e34-7776-4992-84f9-6eb7ad063e63/limitador/0.log"
Jul 22 17:11:13.140019 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.139989    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-lps96_2f1b74e4-767c-4d62-a8bd-430b856ed054/kube-state-metrics/0.log"
Jul 22 17:11:13.158961 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.158936    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-lps96_2f1b74e4-767c-4d62-a8bd-430b856ed054/kube-rbac-proxy-main/0.log"
Jul 22 17:11:13.183501 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.183474    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-lps96_2f1b74e4-767c-4d62-a8bd-430b856ed054/kube-rbac-proxy-self/0.log"
Jul 22 17:11:13.397466 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.397386    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzbwx_e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0/node-exporter/0.log"
Jul 22 17:11:13.427207 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.427178    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzbwx_e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0/kube-rbac-proxy/0.log"
Jul 22 17:11:13.450657 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.450633    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzbwx_e5a9ba8a-a42d-409e-94d5-1f4dbc5481b0/init-textfile/0.log"
Jul 22 17:11:13.669119 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.669037    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0f759cb-ae1d-469d-b4ca-68fe104088a9/prometheus/0.log"
Jul 22 17:11:13.690461 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.690433    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0f759cb-ae1d-469d-b4ca-68fe104088a9/config-reloader/0.log"
Jul 22 17:11:13.714612 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.714580    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0f759cb-ae1d-469d-b4ca-68fe104088a9/thanos-sidecar/0.log"
Jul 22 17:11:13.742261 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.742210    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0f759cb-ae1d-469d-b4ca-68fe104088a9/kube-rbac-proxy-web/0.log"
Jul 22 17:11:13.764754 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.764727    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0f759cb-ae1d-469d-b4ca-68fe104088a9/kube-rbac-proxy/0.log"
Jul 22 17:11:13.788153 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.788125    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0f759cb-ae1d-469d-b4ca-68fe104088a9/kube-rbac-proxy-thanos/0.log"
Jul 22 17:11:13.816689 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.816657    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0f759cb-ae1d-469d-b4ca-68fe104088a9/init-config-reloader/0.log"
Jul 22 17:11:13.844665 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.844633    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-jl65d_e7106b3b-d6b9-49f7-a07e-da76c5462883/prometheus-operator/0.log"
Jul 22 17:11:13.864933 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.864906    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-jl65d_e7106b3b-d6b9-49f7-a07e-da76c5462883/kube-rbac-proxy/0.log"
Jul 22 17:11:13.892023 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:13.891993    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-9vmqw_e45ca8ab-26ed-4a6b-a437-d399e3abf80e/prometheus-operator-admission-webhook/0.log"
Jul 22 17:11:14.208234 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.208193    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"]
Jul 22 17:11:14.208668 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.208649    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca684728-fb75-4c2e-ac7c-cabe6e4de652" containerName="revoke-keys"
Jul 22 17:11:14.208714 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.208671    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca684728-fb75-4c2e-ac7c-cabe6e4de652" containerName="revoke-keys"
Jul 22 17:11:14.208755 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.208742    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca684728-fb75-4c2e-ac7c-cabe6e4de652" containerName="revoke-keys"
Jul 22 17:11:14.211925 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.211905    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.214122 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.214097    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dg96g\"/\"default-dockercfg-jwkq6\""
Jul 22 17:11:14.214267 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.214140    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dg96g\"/\"openshift-service-ca.crt\""
Jul 22 17:11:14.214845 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.214827    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dg96g\"/\"kube-root-ca.crt\""
Jul 22 17:11:14.218516 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.218495    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"]
Jul 22 17:11:14.272480 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.272442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16478739-adc6-44e5-870c-dc2f7e737d9c-podres\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.272671 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.272486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16478739-adc6-44e5-870c-dc2f7e737d9c-lib-modules\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.272671 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.272579    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16478739-adc6-44e5-870c-dc2f7e737d9c-proc\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.272671 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.272630    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16478739-adc6-44e5-870c-dc2f7e737d9c-sys\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.272785 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.272701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8tx5\" (UniqueName: \"kubernetes.io/projected/16478739-adc6-44e5-870c-dc2f7e737d9c-kube-api-access-w8tx5\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.373730 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.373695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16478739-adc6-44e5-870c-dc2f7e737d9c-proc\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.373927 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.373743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16478739-adc6-44e5-870c-dc2f7e737d9c-sys\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.373927 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.373801    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8tx5\" (UniqueName: \"kubernetes.io/projected/16478739-adc6-44e5-870c-dc2f7e737d9c-kube-api-access-w8tx5\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.373927 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.373825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16478739-adc6-44e5-870c-dc2f7e737d9c-podres\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.373927 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.373830    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16478739-adc6-44e5-870c-dc2f7e737d9c-proc\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.373927 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.373846    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16478739-adc6-44e5-870c-dc2f7e737d9c-lib-modules\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.373927 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.373897    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16478739-adc6-44e5-870c-dc2f7e737d9c-sys\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.374189 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.373959    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16478739-adc6-44e5-870c-dc2f7e737d9c-podres\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.374189 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.373974    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16478739-adc6-44e5-870c-dc2f7e737d9c-lib-modules\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.382460 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.382440    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8tx5\" (UniqueName: \"kubernetes.io/projected/16478739-adc6-44e5-870c-dc2f7e737d9c-kube-api-access-w8tx5\") pod \"perf-node-gather-daemonset-5vcrh\" (UID: \"16478739-adc6-44e5-870c-dc2f7e737d9c\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.522933 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.522835    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.654168 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.654016    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"]
Jul 22 17:11:14.657332 ip-10-0-136-140 kubenswrapper[2580]: W0722 17:11:14.657289    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod16478739_adc6_44e5_870c_dc2f7e737d9c.slice/crio-a6de835afd316c09e76d16e20a8779113f96f6e270f3c7165f4fdf59356d344b WatchSource:0}: Error finding container a6de835afd316c09e76d16e20a8779113f96f6e270f3c7165f4fdf59356d344b: Status 404 returned error can't find the container with id a6de835afd316c09e76d16e20a8779113f96f6e270f3c7165f4fdf59356d344b
Jul 22 17:11:14.832336 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.832202    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh" event={"ID":"16478739-adc6-44e5-870c-dc2f7e737d9c","Type":"ContainerStarted","Data":"9015da4e158098b6d9534f5b04b4d25cc00e651bd0f390fcde8d81fbe9e8f266"}
Jul 22 17:11:14.832336 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.832293    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh" event={"ID":"16478739-adc6-44e5-870c-dc2f7e737d9c","Type":"ContainerStarted","Data":"a6de835afd316c09e76d16e20a8779113f96f6e270f3c7165f4fdf59356d344b"}
Jul 22 17:11:14.832543 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.832346    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:14.849380 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:14.849327    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh" podStartSLOduration=0.849310474 podStartE2EDuration="849.310474ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:11:14.848114244 +0000 UTC m=+3041.040317563" watchObservedRunningTime="2026-07-22 17:11:14.849310474 +0000 UTC m=+3041.041513792"
Jul 22 17:11:16.077046 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:16.077014    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/1.log"
Jul 22 17:11:16.081274 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:16.081246    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5x5qt_a165dc47-9c65-4843-8011-596009f64244/console-operator/2.log"
Jul 22 17:11:17.159603 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:17.159574    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-xkjnk_648f9a98-2cc7-44da-bb10-a1dac37c1299/volume-data-source-validator/0.log"
Jul 22 17:11:18.411356 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:18.411315    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5h2xr_6b43f2cc-b438-4d0f-b109-14165ae92064/dns/0.log"
Jul 22 17:11:18.439190 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:18.439161    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5h2xr_6b43f2cc-b438-4d0f-b109-14165ae92064/kube-rbac-proxy/0.log"
Jul 22 17:11:18.472645 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:18.472610    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2cr6p_3878f729-87e8-49d0-83bb-b172496e2119/dns-node-resolver/0.log"
Jul 22 17:11:19.559142 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:19.559107    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-smnmv_3318273d-8948-43bf-bee1-d2072dc02332/node-ca/0.log"
Jul 22 17:11:20.846176 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:20.846149    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-5vcrh"
Jul 22 17:11:20.875845 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:20.875821    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-788547964b-pn7d7_eac28e04-a397-4df2-8d39-1a1c95d2413d/kube-auth-proxy/0.log"
Jul 22 17:11:21.974303 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:21.974274    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pw65x_63e12931-5100-4df3-a0c6-6a9943036f02/serve-healthcheck-canary/0.log"
Jul 22 17:11:22.528188 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:22.528162    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5phwh_c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544/kube-rbac-proxy/0.log"
Jul 22 17:11:22.549967 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:22.549934    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5phwh_c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544/exporter/0.log"
Jul 22 17:11:22.572432 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:22.572404    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5phwh_c642f4e6-81ae-4a5b-9c08-a6f6ed5dd544/extractor/0.log"
Jul 22 17:11:24.768100 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:24.768072    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-788547964b-pn7d7_eac28e04-a397-4df2-8d39-1a1c95d2413d/kube-auth-proxy/0.log"
Jul 22 17:11:26.123651 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:26.123618    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cb6494f8-ckzld_7c3fb72a-404b-41a7-b8b2-bec416ea307e/manager/0.log"
Jul 22 17:11:26.144302 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:26.144280    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cb6494f8-ckzld_7c3fb72a-404b-41a7-b8b2-bec416ea307e/copy-manifests/0.log"
Jul 22 17:11:26.412530 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:26.412450    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-788547964b-pn7d7_eac28e04-a397-4df2-8d39-1a1c95d2413d/kube-auth-proxy/0.log"
Jul 22 17:11:27.683895 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:27.683844    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66c589788b-22fhh_2a89bf05-77d1-46fc-8981-94dc65365989/manager/0.log"
Jul 22 17:11:32.188609 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:32.188579    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-dwql2_9eff726e-481c-44ee-afce-07e63cb934ad/migrator/0.log"
Jul 22 17:11:32.210742 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:32.210712    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-dwql2_9eff726e-481c-44ee-afce-07e63cb934ad/graceful-termination/0.log"
Jul 22 17:11:32.593302 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:32.593269    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-ft9q2_3896ccdb-c971-43c1-bdcc-5b5b60f932c8/kube-storage-version-migrator-operator/1.log"
Jul 22 17:11:32.593939 ip-10-0-136-140 kubenswrapper[2580]: I0722 17:11:32.593921    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-ft9q2_3896ccdb-c971-43c1-bdcc-5b5b60f932c8/kube-storage-version-migrator-operator/0.log"